Jun 06 16:47:17.892512 ip-10-0-131-127 systemd[1]: Starting Kubernetes Kubelet... Jun 06 16:47:18.325272 ip-10-0-131-127 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 16:47:18.325272 ip-10-0-131-127 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 16:47:18.325272 ip-10-0-131-127 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 16:47:18.325272 ip-10-0-131-127 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 16:47:18.325272 ip-10-0-131-127 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 16:47:18.327190 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.327100 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 16:47:18.331980 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.331956 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:18.331980 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.331980 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:18.331980 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.331984 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:18.331980 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.331987 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:18.331980 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.331990 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.331993 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.331996 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.331999 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332002 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332004 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332009 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332013 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332017 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332020 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332022 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332026 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332028 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332031 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332034 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332037 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332040 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332043 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332046 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332054 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:18.332123 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332057 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332059 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332062 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332065 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332067 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332070 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332073 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332076 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332079 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332081 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332085 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332087 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332090 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332092 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332096 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332099 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332101 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332105 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332108 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332111 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:18.332647 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332113 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332116 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332119 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332121 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332124 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332127 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332129 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332132 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332135 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332138 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332141 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332143 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332146 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332148 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332151 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332154 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332156 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332159 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332162 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332165 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:18.333147 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332168 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332170 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332173 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332176 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332178 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332181 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332183 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332186 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332189 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332192 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332195 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332198 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332200 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332203 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332205 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332208 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332211 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332213 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332216 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332219 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:18.333641 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332222 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332237 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332240 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332243 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332245 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332250 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332255 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332259 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332262 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332265 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332269 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332271 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332274 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332277 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.332280 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333011 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333018 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333021 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333025 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:18.334127 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333028 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333031 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333035 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333038 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333041 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333043 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333046 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333049 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333051 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333054 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333057 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333060 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333063 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333065 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333068 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333071 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333074 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333078 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333080 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333083 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:18.334602 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333086 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333089 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333092 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333096 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333101 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333104 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333107 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333110 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333113 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333115 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333118 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333121 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333123 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333126 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333129 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333131 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333134 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333137 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333139 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:18.335129 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333142 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333144 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333148 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333151 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333153 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333156 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333159 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333162 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333164 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333167 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333170 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333172 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333177 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333182 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333185 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333187 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333190 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333193 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333197 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:18.335612 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333201 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333204 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333208 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333210 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333213 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333216 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333219 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333222 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333239 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333242 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333245 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333248 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333250 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333253 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333256 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333258 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333261 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333264 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333266 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333269 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:18.336087 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333271 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333274 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333276 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333279 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333281 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333284 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333287 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333290 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333292 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333295 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333298 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333301 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333304 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333306 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333308 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333311 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333313 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333707 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333712 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333715 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:18.336589 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333718 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333727 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333730 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333732 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333735 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333739 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333742 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333744 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333747 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333749 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333752 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333755 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333758 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333761 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333763 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333766 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333769 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333773 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333777 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333780 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:18.337086 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333783 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333786 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333788 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333791 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333794 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333797 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333799 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333802 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333805 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333808 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333811 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333813 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333816 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333818 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333824 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333826 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333829 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333832 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333835 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333837 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:18.337579 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333840 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333842 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333845 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333847 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333850 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333853 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333855 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333858 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333860 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333863 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333866 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333870 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333873 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333877 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333880 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333882 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333885 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333888 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333891 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:18.338068 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333894 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333896 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333899 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333902 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333904 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333907 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333909 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333913 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333916 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333918 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333921 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333923 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333926 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333929 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333933 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333935 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333938 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333941 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333944 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:18.338540 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333946 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333949 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333951 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333958 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333961 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333963 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333965 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333969 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333971 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333974 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333977 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333979 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333982 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333984 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333987 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333990 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333992 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.333994 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334061 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334068 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334074 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 16:47:18.338999 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334079 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334084 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334090 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334094 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334100 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334105 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334108 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334112 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334117 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334122 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334125 2577 flags.go:64] FLAG: --cgroup-root="" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334130 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334135 2577 flags.go:64] FLAG: --client-ca-file="" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334138 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334143 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334148 2577 flags.go:64] FLAG: --cluster-domain="" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334151 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334154 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334158 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334161 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334165 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334168 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334171 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 16:47:18.339521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334175 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334178 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334181 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334184 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334187 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334190 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334194 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334197 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334200 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334203 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334206 2577 flags.go:64] FLAG: --enable-server="true" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334210 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334214 2577 flags.go:64] FLAG: --event-burst="100" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334217 2577 flags.go:64] FLAG: --event-qps="50" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334220 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334223 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334239 2577 flags.go:64] FLAG: --eviction-hard="" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334243 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334246 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334249 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334252 2577 flags.go:64] FLAG: --eviction-soft="" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334255 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334258 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334263 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334266 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 16:47:18.340083 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334269 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334272 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334275 2577 flags.go:64] FLAG: --feature-gates="" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334279 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334282 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334285 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334288 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334291 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334294 2577 flags.go:64] FLAG: --help="false" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334297 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334300 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334304 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334307 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334310 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334313 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334316 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334319 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334322 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334330 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334333 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334336 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334339 2577 flags.go:64] FLAG: --kube-reserved="" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334342 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334345 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 16:47:18.340745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334348 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334351 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334354 2577 flags.go:64] FLAG: --lock-file="" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334357 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334360 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334363 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334370 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334373 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334376 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334379 2577 flags.go:64] FLAG: --logging-format="text" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334382 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334385 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334388 2577 flags.go:64] FLAG: --manifest-url="" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334391 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334396 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334399 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334403 2577 flags.go:64] FLAG: --max-pods="110" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334406 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334409 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334412 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334415 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334418 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334421 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334424 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334431 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 16:47:18.341337 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334434 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334439 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334442 2577 flags.go:64] FLAG: --pod-cidr="" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334447 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334453 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334456 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334459 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334462 2577 flags.go:64] FLAG: --port="10250" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334465 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334468 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-099f9dd9a09d89032" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334471 2577 flags.go:64] FLAG: --qos-reserved="" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334474 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334477 2577 flags.go:64] FLAG: --register-node="true" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334480 2577 flags.go:64] FLAG: --register-with-taints="" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334485 2577 flags.go:64] FLAG: --registry-burst="10" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334488 2577 flags.go:64] FLAG: --registry-qps="5" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334491 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334494 2577 flags.go:64] FLAG: --reserved-memory="" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334498 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334501 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334504 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334507 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334510 2577 flags.go:64] FLAG: --runonce="false" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334513 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334516 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 16:47:18.342380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334519 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334522 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334525 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334528 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334531 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334534 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334537 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334540 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334544 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334547 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334550 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334553 2577 flags.go:64] FLAG: --system-cgroups="" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334556 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334561 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334564 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334567 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334572 2577 flags.go:64] FLAG: --tls-min-version="" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334574 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334577 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334580 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334583 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334587 2577 flags.go:64] FLAG: --v="2" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334591 2577 flags.go:64] FLAG: --version="false" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334595 2577 flags.go:64] FLAG: --vmodule="" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334599 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 16:47:18.343477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.334602 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334756 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334760 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334764 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334767 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334770 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334773 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334776 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334779 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334781 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334784 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334787 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334789 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334792 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334794 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334799 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334801 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334804 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334807 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:18.344566 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334810 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334813 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334816 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334818 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334821 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334824 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334826 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334829 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334831 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334835 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334838 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334840 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334843 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334845 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334848 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334850 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334853 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334855 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334858 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334861 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:18.345371 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334863 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334866 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334868 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334870 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334873 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334876 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334878 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334881 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334884 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334887 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334889 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334893 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334897 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334900 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334903 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334905 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334908 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334911 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334913 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334916 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:18.345856 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334919 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334922 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334924 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334927 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334930 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334933 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334935 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334938 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334940 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334943 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334946 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334949 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334952 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334955 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334957 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334960 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334964 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334967 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334970 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:18.346716 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334973 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334977 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334980 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334983 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334985 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334989 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334993 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334996 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.334999 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335002 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335004 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335007 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335010 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335013 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335016 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335019 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335021 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335024 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335027 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335029 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:18.347475 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335032 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.335034 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.335901 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.343737 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.343756 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.343778 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.343788 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343871 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343880 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343886 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343891 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343896 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343901 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343905 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343910 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:18.347981 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343914 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343918 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343922 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343927 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343931 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343936 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343940 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343945 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343949 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343953 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343960 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343966 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343970 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343975 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343980 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343984 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343989 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343993 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.343998 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344002 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:18.348426 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344006 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344013 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344018 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344022 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344027 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344032 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344036 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344040 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344045 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344049 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344053 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344057 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344061 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344067 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344071 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344075 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344080 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344084 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344088 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:18.348925 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344093 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344097 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344102 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344106 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344110 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344115 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344119 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344125 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344131 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344135 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344140 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344144 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344149 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344153 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344158 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344164 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344168 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344173 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344177 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344181 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:18.349561 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344186 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344190 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344194 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344198 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344202 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344207 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344211 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344215 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344219 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344242 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344248 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344253 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344257 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344261 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344266 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344270 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344275 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344279 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344283 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:18.350090 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344288 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344292 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344296 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344301 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344305 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344310 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344314 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344320 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344324 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344330 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344335 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344339 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344343 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.344352 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 16:47:18.350569 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344532 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344541 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344546 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344551 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344557 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344561 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344565 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344571 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344577 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344581 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344586 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344590 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344595 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344599 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344603 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344608 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344612 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344617 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344621 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:18.350976 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344626 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344630 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344634 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344639 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344645 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344651 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344656 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344661 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344666 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344672 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344676 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344680 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344685 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344689 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344694 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344698 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344702 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344707 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344711 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:18.351490 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344715 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344719 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344724 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344728 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344733 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344737 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344741 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344746 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344750 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344755 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344759 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344763 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344768 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344772 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344776 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344780 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344784 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344789 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344793 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344797 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:18.352018 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344802 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344806 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344811 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344816 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344820 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344824 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344828 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344833 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344837 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344841 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344845 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344849 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344853 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344857 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344862 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344865 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344870 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344874 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344878 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:18.352563 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344882 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344887 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344891 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344895 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344900 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344907 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344913 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344918 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344923 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344927 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344932 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344936 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344940 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344945 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344949 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344954 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344958 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344963 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344967 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344971 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:18.353026 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344976 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:18.353711 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:18.344980 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:18.353711 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.344988 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 16:47:18.353711 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.345136 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 16:47:18.353711 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.349126 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 16:47:18.353711 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.350820 2577 server.go:1019] "Starting client certificate rotation" Jun 06 16:47:18.353711 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.350931 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 16:47:18.353711 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.351797 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 16:47:18.354014 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.353949 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 16:47:18.358509 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.358488 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 16:47:18.372992 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.372976 2577 log.go:25] "Validated CRI v1 runtime API" Jun 06 16:47:18.376171 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.376154 2577 log.go:25] "Validated CRI v1 image API" Jun 06 16:47:18.376945 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.376932 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 16:47:18.378913 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.378891 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 16:47:18.381702 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.381685 2577 fs.go:135] Filesystem UUIDs: map[099a281f-8d40-4592-9395-ba87c3853b6b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e53f8172-86b4-43c2-a7e8-8d531ba3d000:/dev/nvme0n1p4] Jun 06 16:47:18.381774 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.381702 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 16:47:18.386791 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.386684 2577 manager.go:216] Machine: {Timestamp:2026-06-06 16:47:18.385269047 +0000 UTC m=+0.366743864 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101912 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20050d205bebfa56d761ece3ebc598 SystemUUID:ec20050d-205b-ebfa-56d7-61ece3ebc598 BootID:8b49d30a-dd18-4ad6-b6a4-adfa5735c5ec Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:cd:a8:d9:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:cd:a8:d9:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:df:3d:d7:cb:21 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 16:47:18.386791 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.386785 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 16:47:18.386898 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.386860 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 16:47:18.390745 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.390705 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 16:47:18.390876 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.390749 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-127.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 16:47:18.391681 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.391671 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 16:47:18.391729 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.391683 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 16:47:18.391729 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.391699 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 16:47:18.392569 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.392559 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 16:47:18.393737 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.393727 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 16:47:18.398188 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398177 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 06 16:47:18.398320 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398310 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 16:47:18.398359 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398344 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 06 16:47:18.398359 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398357 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 16:47:18.398413 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398371 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 16:47:18.398413 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398382 2577 kubelet.go:398] "Adding apiserver pod source" Jun 06 16:47:18.398413 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398391 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 16:47:18.398747 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398736 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 16:47:18.398785 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.398753 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 16:47:18.401207 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.401190 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 16:47:18.404052 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.403890 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 16:47:18.404052 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.403955 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 16:47:18.405565 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405547 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405571 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405578 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405584 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405594 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405605 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405614 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405619 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405636 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 16:47:18.405643 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405644 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 16:47:18.405993 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405668 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 16:47:18.405993 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.405674 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 16:47:18.407653 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.407635 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 16:47:18.407721 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.407663 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 16:47:18.410609 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.410592 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-127.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 16:47:18.411282 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.411269 2577 server.go:1268] "Started kubelet" Jun 06 16:47:18.411392 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.411355 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 16:47:18.411392 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.411355 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 16:47:18.411540 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.411369 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 16:47:18.411540 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.411408 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 16:47:18.411540 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.411466 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 16:47:18.412156 ip-10-0-131-127 systemd[1]: Started Kubernetes Kubelet. Jun 06 16:47:18.413551 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.413528 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 16:47:18.413609 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.413565 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 06 16:47:18.417120 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.416050 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-127.ec2.internal.18b68bd2642673f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-127.ec2.internal,UID:ip-10-0-131-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-127.ec2.internal,},FirstTimestamp:2026-06-06 16:47:18.411244529 +0000 UTC m=+0.392719345,LastTimestamp:2026-06-06 16:47:18.411244529 +0000 UTC m=+0.392719345,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-127.ec2.internal,}" Jun 06 16:47:18.419397 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.419382 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gsffr" Jun 06 16:47:18.421274 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.421253 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 16:47:18.421357 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.421337 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 16:47:18.421407 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.421363 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 16:47:18.421450 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.421425 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:18.422383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.422276 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 16:47:18.422383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.422276 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 16:47:18.422383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.422301 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 16:47:18.422547 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.422417 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 06 16:47:18.422547 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.422426 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 06 16:47:18.423836 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.423820 2577 factory.go:55] Registering systemd factory Jun 06 16:47:18.423918 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.423839 2577 factory.go:223] Registration of the systemd container factory successfully Jun 06 16:47:18.424082 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.424067 2577 factory.go:153] Registering CRI-O factory Jun 06 16:47:18.424082 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.424081 2577 factory.go:223] Registration of the crio container factory successfully Jun 06 16:47:18.424205 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.424143 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 16:47:18.424205 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.424172 2577 factory.go:103] Registering Raw factory Jun 06 16:47:18.424205 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.424187 2577 manager.go:1196] Started watching for new ooms in manager Jun 06 16:47:18.424688 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.424675 2577 manager.go:349] Starting recovery of all containers Jun 06 16:47:18.426405 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.426384 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gsffr" Jun 06 16:47:18.435033 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.435014 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:18.435785 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.435767 2577 manager.go:354] Recovery completed Jun 06 16:47:18.437360 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.437340 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-127.ec2.internal\" not found" node="ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.439830 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.439816 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:18.441901 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.441884 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:18.441973 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.441915 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:18.441973 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.441925 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:18.442424 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.442412 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 16:47:18.442506 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.442424 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:18.442506 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.442424 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 16:47:18.442506 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.442455 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 06 16:47:18.443027 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.443013 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:18.443075 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.443038 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:18.443075 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.443048 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:18.444351 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.444337 2577 policy_none.go:49] "None policy: Start" Jun 06 16:47:18.444412 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.444364 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 16:47:18.444412 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.444378 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 16:47:18.446004 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.445992 2577 policy_none.go:47] "Start" Jun 06 16:47:18.487911 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.487897 2577 manager.go:337] "Starting Device Plugin manager" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.487927 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.487936 2577 server.go:87] "Starting device plugin registration server" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.488210 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.488224 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.488331 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.488406 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.488415 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.488907 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.488944 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.499966 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.501257 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.501292 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.501312 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.501376 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 16:47:18.508656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.503369 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:18.588572 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.588515 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:18.589767 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.589749 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:18.589855 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.589780 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:18.589855 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.589791 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:18.589855 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.589818 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.599564 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.599548 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.599607 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.599569 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-127.ec2.internal\": node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:18.602007 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.601974 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal"] Jun 06 16:47:18.602106 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.602043 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:18.602852 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.602837 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:18.602951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.602861 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:18.602951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.602872 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:18.605237 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.605213 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:18.605334 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.605320 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.605388 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.605359 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:18.605989 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.605967 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:18.606075 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.605997 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:18.606075 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.606008 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:18.606789 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.606775 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:18.606858 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.606806 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:18.606858 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.606815 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:18.608297 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.608283 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.608363 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.608307 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:18.608976 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.608963 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:18.609032 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.608988 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:18.609032 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.609002 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:18.620320 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.620304 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:18.623459 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.623444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b31fdc435829d99562e702fe92d4b1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal\" (UID: \"6b31fdc435829d99562e702fe92d4b1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.623511 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.623469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b31fdc435829d99562e702fe92d4b1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal\" (UID: \"6b31fdc435829d99562e702fe92d4b1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.623511 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.623485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b23e8a4da2bc68dc238258b631d7995b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-127.ec2.internal\" (UID: \"b23e8a4da2bc68dc238258b631d7995b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.632825 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.632806 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-127.ec2.internal\" not found" node="ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.636975 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.636956 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-127.ec2.internal\" not found" node="ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.720966 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.720940 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:18.724206 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.724192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b31fdc435829d99562e702fe92d4b1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal\" (UID: \"6b31fdc435829d99562e702fe92d4b1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.724279 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.724216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b31fdc435829d99562e702fe92d4b1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal\" (UID: \"6b31fdc435829d99562e702fe92d4b1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.724279 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.724248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b23e8a4da2bc68dc238258b631d7995b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-127.ec2.internal\" (UID: \"b23e8a4da2bc68dc238258b631d7995b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.724358 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.724279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b31fdc435829d99562e702fe92d4b1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal\" (UID: \"6b31fdc435829d99562e702fe92d4b1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.724358 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.724292 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b31fdc435829d99562e702fe92d4b1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal\" (UID: \"6b31fdc435829d99562e702fe92d4b1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.724358 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.724313 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b23e8a4da2bc68dc238258b631d7995b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-127.ec2.internal\" (UID: \"b23e8a4da2bc68dc238258b631d7995b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.821399 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.821370 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:18.922131 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:18.922062 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:18.939462 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.939437 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:18.944117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:18.943873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" Jun 06 16:47:19.023171 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:19.023135 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:19.123592 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:19.123564 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:19.224159 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:19.224090 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:19.324606 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:19.324577 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:19.349912 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.349887 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 16:47:19.350584 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.350052 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 16:47:19.350584 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.350073 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 16:47:19.424904 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:19.424872 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:19.430571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.430542 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 16:42:18 +0000 UTC" deadline="2028-02-09 01:47:43.537059918 +0000 UTC" Jun 06 16:47:19.430571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.430570 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14697h0m24.106493416s" Jun 06 16:47:19.443557 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.443530 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:19.525500 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:19.525328 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-127.ec2.internal\" not found" Jun 06 16:47:19.609284 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.609254 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:19.622024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.622004 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" Jun 06 16:47:19.634187 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.634170 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 16:47:19.635549 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.635532 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" Jun 06 16:47:19.644489 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.644468 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 16:47:19.645777 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:19.645755 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b31fdc435829d99562e702fe92d4b1a.slice/crio-5b4f3e5ae6259379d917702a6af0cceb4143a388196aee6bdaef26d241c81f38 WatchSource:0}: Error finding container 5b4f3e5ae6259379d917702a6af0cceb4143a388196aee6bdaef26d241c81f38: Status 404 returned error can't find the container with id 5b4f3e5ae6259379d917702a6af0cceb4143a388196aee6bdaef26d241c81f38 Jun 06 16:47:19.646630 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:19.646615 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23e8a4da2bc68dc238258b631d7995b.slice/crio-6c48bcdc242ab4f13c5f89590b96fe3d5f996f591a0f669461462b9cc20bd844 WatchSource:0}: Error finding container 6c48bcdc242ab4f13c5f89590b96fe3d5f996f591a0f669461462b9cc20bd844: Status 404 returned error can't find the container with id 6c48bcdc242ab4f13c5f89590b96fe3d5f996f591a0f669461462b9cc20bd844 Jun 06 16:47:19.652034 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:19.652019 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 16:47:20.278986 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.278954 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:20.399833 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.399795 2577 apiserver.go:52] "Watching apiserver" Jun 06 16:47:20.406622 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.406598 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 16:47:20.408191 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.408165 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-7t4sp","kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc","openshift-cluster-node-tuning-operator/tuned-7k42m","openshift-image-registry/node-ca-lt6md","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal","openshift-multus/multus-q85xn","openshift-multus/network-metrics-daemon-nl9nt","openshift-network-diagnostics/network-check-target-7p6t7","kube-system/global-pull-secret-syncer-cqnr6","kube-system/konnectivity-agent-7tmll","openshift-dns/node-resolver-ms7c9","openshift-multus/multus-additional-cni-plugins-dp6g5","openshift-network-operator/iptables-alerter-tsgpt"] Jun 06 16:47:20.411061 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.411042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.413091 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.413070 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.414115 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.413582 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 16:47:20.414115 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.413675 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 16:47:20.414115 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.413581 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ns8dn\"" Jun 06 16:47:20.414115 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.413939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 16:47:20.415297 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.414781 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 16:47:20.415297 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.415143 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wlsrw\"" Jun 06 16:47:20.415297 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.415194 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 16:47:20.415535 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.415464 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 16:47:20.416244 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.416064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.418190 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.418035 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 16:47:20.420283 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.419278 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 16:47:20.420283 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.419483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zwsp5\"" Jun 06 16:47:20.420283 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.419720 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 16:47:20.423094 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.420690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.423094 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.422179 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 16:47:20.423094 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.422862 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:47:20.423094 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.423013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f2mpq\"" Jun 06 16:47:20.423418 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.423118 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 16:47:20.424442 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.424142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.426009 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.425988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 16:47:20.426487 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.426335 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 16:47:20.426779 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.426598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.426779 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.426642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kr2z4\"" Jun 06 16:47:20.427601 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.427019 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 16:47:20.428671 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.428654 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:20.428754 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.428744 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 16:47:20.429063 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.428738 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:20.429462 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.429198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:47:20.429462 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.429284 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 16:47:20.429462 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.429299 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mdpn4\"" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-cni-bin\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-os-release\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-run\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-sys\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-var-lib-kubelet\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bcd27ac-3a7a-4331-9782-99e278104b92-host\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-system-cni-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-cni-multus\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-host\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngrl\" (UniqueName: \"kubernetes.io/projected/547e34f1-cca3-4313-866a-2c1aafea4661-kube-api-access-tngrl\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-kubelet\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-registration-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-modprobe-d\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysconfig\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.436982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-kubernetes\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.440323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/547e34f1-cca3-4313-866a-2c1aafea4661-tmp\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52ttg\" (UniqueName: \"kubernetes.io/projected/16f46035-4803-471e-a507-15ca392f5b48-kube-api-access-52ttg\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-cnibin\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-conf-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-device-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dh68\" (UniqueName: \"kubernetes.io/projected/0bcd27ac-3a7a-4331-9782-99e278104b92-kube-api-access-2dh68\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-hostroot\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-socket-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-sys-fs\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bcd27ac-3a7a-4331-9782-99e278104b92-serviceca\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-netns\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-etc-kubernetes\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysctl-conf\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-systemd\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.441250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-lib-modules\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-socket-dir-parent\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-cni-binary-copy\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdz59\" (UniqueName: \"kubernetes.io/projected/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-kube-api-access-pdz59\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysctl-d\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/547e34f1-cca3-4313-866a-2c1aafea4661-etc-tuned\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-os-release\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-cni-binary-copy\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-k8s-cni-cncf-io\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-daemon-config\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-multus-certs\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85t5k\" (UniqueName: \"kubernetes.io/projected/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-kube-api-access-85t5k\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-system-cni-dir\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-cnibin\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.437999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-cni-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.442044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.438334 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.442844 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.439010 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 16:47:20.442844 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.439948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:20.442844 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.440032 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:20.442844 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.442453 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 16:47:20.442844 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.442741 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 16:47:20.443064 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.442846 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r4dzk\"" Jun 06 16:47:20.443064 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.442959 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 16:47:20.444293 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.443221 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 16:47:20.444293 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.443445 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 16:47:20.444293 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.444068 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 16:47:20.444293 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.444104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.444293 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.444191 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:20.444734 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.444709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:20.446909 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.446888 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 16:47:20.447041 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.447024 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 16:47:20.447101 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.447084 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x5nks\"" Jun 06 16:47:20.448156 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.448138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.450324 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.450305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 16:47:20.450503 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.450488 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 16:47:20.450592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.450572 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b9glt\"" Jun 06 16:47:20.451159 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.451140 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-klqc8" Jun 06 16:47:20.458601 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.458580 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-klqc8" Jun 06 16:47:20.505071 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.505047 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:20.507200 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.507133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" event={"ID":"b23e8a4da2bc68dc238258b631d7995b","Type":"ContainerStarted","Data":"6c48bcdc242ab4f13c5f89590b96fe3d5f996f591a0f669461462b9cc20bd844"} Jun 06 16:47:20.508577 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.508547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" event={"ID":"6b31fdc435829d99562e702fe92d4b1a","Type":"ContainerStarted","Data":"5b4f3e5ae6259379d917702a6af0cceb4143a388196aee6bdaef26d241c81f38"} Jun 06 16:47:20.524204 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.524186 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 16:47:20.538696 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-env-overrides\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.538794 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-lib-modules\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.538794 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/afb5018c-8c36-49a0-be9c-f6b4afb1b47c-konnectivity-ca\") pod \"konnectivity-agent-7tmll\" (UID: \"afb5018c-8c36-49a0-be9c-f6b4afb1b47c\") " pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:20.538901 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-systemd\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.538901 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-socket-dir-parent\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539008 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-cni-binary-copy\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.539008 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-lib-modules\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.539008 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.539008 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdz59\" (UniqueName: \"kubernetes.io/projected/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-kube-api-access-pdz59\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.539008 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.538980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/547e34f1-cca3-4313-866a-2c1aafea4661-etc-tuned\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539036 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-socket-dir-parent\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-os-release\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-daemon-config\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-multus-certs\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-sys\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e95cec1e-d673-4db1-b626-d983df240fed-kubelet-config\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-kubelet\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.539307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-ovn\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-node-log\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-multus-certs\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539382 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-cni-bin\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539428 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-os-release\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-cni-bin\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-sys\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-systemd-units\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-var-lib-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-cni-binary-copy\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.539707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovnkube-config\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5v5\" (UniqueName: \"kubernetes.io/projected/5e002503-6534-49d4-bdc0-d70cc8ffabb8-kube-api-access-2r5v5\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-cni-multus\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-registration-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-cni-multus\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-daemon-config\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.539961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-registration-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mss64\" (UniqueName: \"kubernetes.io/projected/c6205570-13cf-4c02-b34b-f7513bb8cfed-kube-api-access-mss64\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52ttg\" (UniqueName: \"kubernetes.io/projected/16f46035-4803-471e-a507-15ca392f5b48-kube-api-access-52ttg\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-conf-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dh68\" (UniqueName: \"kubernetes.io/projected/0bcd27ac-3a7a-4331-9782-99e278104b92-kube-api-access-2dh68\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e95cec1e-d673-4db1-b626-d983df240fed-dbus\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.540157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-conf-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-run-netns\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-cni-netd\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-hostroot\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-socket-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dfj8\" (UniqueName: \"kubernetes.io/projected/3e695554-c5d2-49b9-bb26-548ce9449317-kube-api-access-8dfj8\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-hostroot\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-netns\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-etc-kubernetes\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysctl-conf\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-netns\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-systemd\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540521 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-socket-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/afb5018c-8c36-49a0-be9c-f6b4afb1b47c-agent-certs\") pod \"konnectivity-agent-7tmll\" (UID: \"afb5018c-8c36-49a0-be9c-f6b4afb1b47c\") " pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysctl-d\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.540853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngrl\" (UniqueName: \"kubernetes.io/projected/547e34f1-cca3-4313-866a-2c1aafea4661-kube-api-access-tngrl\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysctl-conf\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-systemd\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540780 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-etc-kubernetes\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-cni-binary-copy\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-k8s-cni-cncf-io\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysctl-d\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.540918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85t5k\" (UniqueName: \"kubernetes.io/projected/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-kube-api-access-85t5k\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-system-cni-dir\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-run-k8s-cni-cncf-io\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-cnibin\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-system-cni-dir\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bcd27ac-3a7a-4331-9782-99e278104b92-host\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6205570-13cf-4c02-b34b-f7513bb8cfed-hosts-file\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-cnibin\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.541627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovn-node-metrics-cert\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bcd27ac-3a7a-4331-9782-99e278104b92-host\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-cni-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-os-release\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-run\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-multus-cni-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-var-lib-kubelet\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-etc-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16f46035-4803-471e-a507-15ca392f5b48-os-release\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-system-cni-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-cni-binary-copy\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-var-lib-kubelet\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-run\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-system-cni-dir\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-host\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnvhr\" (UniqueName: \"kubernetes.io/projected/5491b72a-033f-4bb1-b3cd-18a1b8e63176-kube-api-access-mnvhr\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:20.542431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-host\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e695554-c5d2-49b9-bb26-548ce9449317-iptables-alerter-script\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-log-socket\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovnkube-script-lib\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-kubelet\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.541967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-modprobe-d\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysconfig\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-kubernetes\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-host-var-lib-kubelet\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/547e34f1-cca3-4313-866a-2c1aafea4661-tmp\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-slash\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542114 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-sysconfig\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-cnibin\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-device-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542200 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-modprobe-d\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542210 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6205570-13cf-4c02-b34b-f7513bb8cfed-tmp-dir\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.543265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e695554-c5d2-49b9-bb26-548ce9449317-host-slash\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/547e34f1-cca3-4313-866a-2c1aafea4661-etc-kubernetes\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-cni-bin\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-sys-fs\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bcd27ac-3a7a-4331-9782-99e278104b92-serviceca\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542665 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-device-dir\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-cnibin\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542898 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bcd27ac-3a7a-4331-9782-99e278104b92-serviceca\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.542987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-sys-fs\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.543043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/547e34f1-cca3-4313-866a-2c1aafea4661-etc-tuned\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.543117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.544150 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.543307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16f46035-4803-471e-a507-15ca392f5b48-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.546382 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.545305 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/547e34f1-cca3-4313-866a-2c1aafea4661-tmp\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.548129 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.548100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dh68\" (UniqueName: \"kubernetes.io/projected/0bcd27ac-3a7a-4331-9782-99e278104b92-kube-api-access-2dh68\") pod \"node-ca-lt6md\" (UID: \"0bcd27ac-3a7a-4331-9782-99e278104b92\") " pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.548317 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.548287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdz59\" (UniqueName: \"kubernetes.io/projected/dda7f7e1-c3b2-456f-be6e-291f2eaee5c3-kube-api-access-pdz59\") pod \"aws-ebs-csi-driver-node-mrfgc\" (UID: \"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.549309 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.549271 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85t5k\" (UniqueName: \"kubernetes.io/projected/d1d0f509-b45c-43b0-9ce9-b2de8de20b42-kube-api-access-85t5k\") pod \"multus-q85xn\" (UID: \"d1d0f509-b45c-43b0-9ce9-b2de8de20b42\") " pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.549859 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.549834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngrl\" (UniqueName: \"kubernetes.io/projected/547e34f1-cca3-4313-866a-2c1aafea4661-kube-api-access-tngrl\") pod \"tuned-7k42m\" (UID: \"547e34f1-cca3-4313-866a-2c1aafea4661\") " pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.549936 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.549889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52ttg\" (UniqueName: \"kubernetes.io/projected/16f46035-4803-471e-a507-15ca392f5b48-kube-api-access-52ttg\") pod \"multus-additional-cni-plugins-dp6g5\" (UID: \"16f46035-4803-471e-a507-15ca392f5b48\") " pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.643383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6205570-13cf-4c02-b34b-f7513bb8cfed-hosts-file\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.643528 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovn-node-metrics-cert\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.643528 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-etc-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.643528 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643462 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-etc-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.643528 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6205570-13cf-4c02-b34b-f7513bb8cfed-hosts-file\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.643706 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnvhr\" (UniqueName: \"kubernetes.io/projected/5491b72a-033f-4bb1-b3cd-18a1b8e63176-kube-api-access-mnvhr\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:20.643706 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e695554-c5d2-49b9-bb26-548ce9449317-iptables-alerter-script\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.643706 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-log-socket\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.643706 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643659 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-log-socket\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.643896 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovnkube-script-lib\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.643896 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-slash\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.643896 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6205570-13cf-4c02-b34b-f7513bb8cfed-tmp-dir\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.643896 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e695554-c5d2-49b9-bb26-548ce9449317-host-slash\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.643896 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-cni-bin\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.643896 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-slash\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-env-overrides\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643931 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e695554-c5d2-49b9-bb26-548ce9449317-host-slash\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/afb5018c-8c36-49a0-be9c-f6b4afb1b47c-konnectivity-ca\") pod \"konnectivity-agent-7tmll\" (UID: \"afb5018c-8c36-49a0-be9c-f6b4afb1b47c\") " pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-systemd\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.643977 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e95cec1e-d673-4db1-b626-d983df240fed-kubelet-config\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644020 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-cni-bin\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-kubelet\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e95cec1e-d673-4db1-b626-d983df240fed-kubelet-config\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-systemd\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e695554-c5d2-49b9-bb26-548ce9449317-iptables-alerter-script\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-ovn\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-kubelet\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6205570-13cf-4c02-b34b-f7513bb8cfed-tmp-dir\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-node-log\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644294 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-node-log\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-systemd-units\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-var-lib-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovnkube-config\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-systemd-units\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-ovn\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644385 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovnkube-script-lib\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5v5\" (UniqueName: \"kubernetes.io/projected/5e002503-6534-49d4-bdc0-d70cc8ffabb8-kube-api-access-2r5v5\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644459 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mss64\" (UniqueName: \"kubernetes.io/projected/c6205570-13cf-4c02-b34b-f7513bb8cfed-kube-api-access-mss64\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-var-lib-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-env-overrides\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.644571 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.644948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e95cec1e-d673-4db1-b626-d983df240fed-dbus\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e95cec1e-d673-4db1-b626-d983df240fed-dbus\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.644641 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:21.144616476 +0000 UTC m=+3.126091285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/afb5018c-8c36-49a0-be9c-f6b4afb1b47c-konnectivity-ca\") pod \"konnectivity-agent-7tmll\" (UID: \"afb5018c-8c36-49a0-be9c-f6b4afb1b47c\") " pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-run-netns\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-cni-netd\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.644743 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dfj8\" (UniqueName: \"kubernetes.io/projected/3e695554-c5d2-49b9-bb26-548ce9449317-kube-api-access-8dfj8\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/afb5018c-8c36-49a0-be9c-f6b4afb1b47c-agent-certs\") pod \"konnectivity-agent-7tmll\" (UID: \"afb5018c-8c36-49a0-be9c-f6b4afb1b47c\") " pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.644819 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret podName:e95cec1e-d673-4db1-b626-d983df240fed nodeName:}" failed. No retries permitted until 2026-06-06 16:47:21.144802761 +0000 UTC m=+3.126277569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret") pod "global-pull-secret-syncer-cqnr6" (UID: "e95cec1e-d673-4db1-b626-d983df240fed") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-cni-netd\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-host-run-netns\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.644883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e002503-6534-49d4-bdc0-d70cc8ffabb8-run-openvswitch\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.645610 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.645563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovnkube-config\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.646393 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.646357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e002503-6534-49d4-bdc0-d70cc8ffabb8-ovn-node-metrics-cert\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.647146 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.647123 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/afb5018c-8c36-49a0-be9c-f6b4afb1b47c-agent-certs\") pod \"konnectivity-agent-7tmll\" (UID: \"afb5018c-8c36-49a0-be9c-f6b4afb1b47c\") " pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:20.650526 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.650348 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:20.650526 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.650369 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:20.650526 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.650381 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hz854 for pod openshift-network-diagnostics/network-check-target-7p6t7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:20.650526 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:20.650429 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854 podName:3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d nodeName:}" failed. No retries permitted until 2026-06-06 16:47:21.150414001 +0000 UTC m=+3.131888821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hz854" (UniqueName: "kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854") pod "network-check-target-7p6t7" (UID: "3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:20.651462 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.651440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnvhr\" (UniqueName: \"kubernetes.io/projected/5491b72a-033f-4bb1-b3cd-18a1b8e63176-kube-api-access-mnvhr\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:20.652574 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.652554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5v5\" (UniqueName: \"kubernetes.io/projected/5e002503-6534-49d4-bdc0-d70cc8ffabb8-kube-api-access-2r5v5\") pod \"ovnkube-node-7t4sp\" (UID: \"5e002503-6534-49d4-bdc0-d70cc8ffabb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.652990 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.652970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mss64\" (UniqueName: \"kubernetes.io/projected/c6205570-13cf-4c02-b34b-f7513bb8cfed-kube-api-access-mss64\") pod \"node-resolver-ms7c9\" (UID: \"c6205570-13cf-4c02-b34b-f7513bb8cfed\") " pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:20.652990 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.652960 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dfj8\" (UniqueName: \"kubernetes.io/projected/3e695554-c5d2-49b9-bb26-548ce9449317-kube-api-access-8dfj8\") pod \"iptables-alerter-tsgpt\" (UID: \"3e695554-c5d2-49b9-bb26-548ce9449317\") " pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.726080 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.726044 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q85xn" Jun 06 16:47:20.744460 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.744438 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" Jun 06 16:47:20.757856 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.757834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" Jun 06 16:47:20.763412 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.763391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7k42m" Jun 06 16:47:20.773896 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.773881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lt6md" Jun 06 16:47:20.781299 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.781279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tsgpt" Jun 06 16:47:20.789886 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.789838 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:20.798392 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.798371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:20.804855 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:20.804834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ms7c9" Jun 06 16:47:21.148966 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:21.148866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:21.148966 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:21.148931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:21.149192 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.149037 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:21.149192 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.149108 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:22.149093425 +0000 UTC m=+4.130568233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:21.149192 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.149039 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:21.149358 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.149196 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret podName:e95cec1e-d673-4db1-b626-d983df240fed nodeName:}" failed. No retries permitted until 2026-06-06 16:47:22.149178152 +0000 UTC m=+4.130652964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret") pod "global-pull-secret-syncer-cqnr6" (UID: "e95cec1e-d673-4db1-b626-d983df240fed") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:21.249459 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:21.249429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:21.249602 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.249561 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:21.249602 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.249575 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:21.249602 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.249584 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hz854 for pod openshift-network-diagnostics/network-check-target-7p6t7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:21.249697 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.249628 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854 podName:3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d nodeName:}" failed. No retries permitted until 2026-06-06 16:47:22.249616465 +0000 UTC m=+4.231091268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz854" (UniqueName: "kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854") pod "network-check-target-7p6t7" (UID: "3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:21.462561 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:21.462483 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 16:42:20 +0000 UTC" deadline="2027-11-10 09:04:36.995975867 +0000 UTC" Jun 06 16:47:21.462561 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:21.462509 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12520h17m15.533469537s" Jun 06 16:47:21.501901 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:21.501870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:21.502061 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:21.502006 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:21.607206 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.607179 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bcd27ac_3a7a_4331_9782_99e278104b92.slice/crio-7d30d1d076b54c9a5e39321a1bfdb43e1124912cbf5a31be0a96d68f165325e1 WatchSource:0}: Error finding container 7d30d1d076b54c9a5e39321a1bfdb43e1124912cbf5a31be0a96d68f165325e1: Status 404 returned error can't find the container with id 7d30d1d076b54c9a5e39321a1bfdb43e1124912cbf5a31be0a96d68f165325e1 Jun 06 16:47:21.608356 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.608325 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb5018c_8c36_49a0_be9c_f6b4afb1b47c.slice/crio-c07011590b58786a739626d8fef1f944ddf90f0af068bc24686ff3ed48932076 WatchSource:0}: Error finding container c07011590b58786a739626d8fef1f944ddf90f0af068bc24686ff3ed48932076: Status 404 returned error can't find the container with id c07011590b58786a739626d8fef1f944ddf90f0af068bc24686ff3ed48932076 Jun 06 16:47:21.609155 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.609083 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda7f7e1_c3b2_456f_be6e_291f2eaee5c3.slice/crio-6eb1985cfc38db2ffa4a7c87d8deb08efd288d23131846b058626cc30c2623af WatchSource:0}: Error finding container 6eb1985cfc38db2ffa4a7c87d8deb08efd288d23131846b058626cc30c2623af: Status 404 returned error can't find the container with id 6eb1985cfc38db2ffa4a7c87d8deb08efd288d23131846b058626cc30c2623af Jun 06 16:47:21.614912 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.614888 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6205570_13cf_4c02_b34b_f7513bb8cfed.slice/crio-8437122e3d6e3961d36b202f181521f0ed190c6f8bbf4a7bfacb10dd50dc314f WatchSource:0}: Error finding container 8437122e3d6e3961d36b202f181521f0ed190c6f8bbf4a7bfacb10dd50dc314f: Status 404 returned error can't find the container with id 8437122e3d6e3961d36b202f181521f0ed190c6f8bbf4a7bfacb10dd50dc314f Jun 06 16:47:21.615573 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.615541 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d0f509_b45c_43b0_9ce9_b2de8de20b42.slice/crio-60cb64b92acc8161f33bc945530e54f107c45c3bc56d994fa62219a99e5af892 WatchSource:0}: Error finding container 60cb64b92acc8161f33bc945530e54f107c45c3bc56d994fa62219a99e5af892: Status 404 returned error can't find the container with id 60cb64b92acc8161f33bc945530e54f107c45c3bc56d994fa62219a99e5af892 Jun 06 16:47:21.618193 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.618171 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e695554_c5d2_49b9_bb26_548ce9449317.slice/crio-a5d122ff2baa757a2ad705d45ac402441e8bbe228bc16f7eeb4fcf3e44cbf3ca WatchSource:0}: Error finding container a5d122ff2baa757a2ad705d45ac402441e8bbe228bc16f7eeb4fcf3e44cbf3ca: Status 404 returned error can't find the container with id a5d122ff2baa757a2ad705d45ac402441e8bbe228bc16f7eeb4fcf3e44cbf3ca Jun 06 16:47:21.618836 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.618815 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e002503_6534_49d4_bdc0_d70cc8ffabb8.slice/crio-712ef9c025f5f609ff47e46b5115418bd4e86f7c5e0addaace46434a587df434 WatchSource:0}: Error finding container 712ef9c025f5f609ff47e46b5115418bd4e86f7c5e0addaace46434a587df434: Status 404 returned error can't find the container with id 712ef9c025f5f609ff47e46b5115418bd4e86f7c5e0addaace46434a587df434 Jun 06 16:47:21.620460 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.620444 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547e34f1_cca3_4313_866a_2c1aafea4661.slice/crio-121092c5eaa22c455bd0f6b01b552008b4d8bad3110ceaf46e9cd795521e3456 WatchSource:0}: Error finding container 121092c5eaa22c455bd0f6b01b552008b4d8bad3110ceaf46e9cd795521e3456: Status 404 returned error can't find the container with id 121092c5eaa22c455bd0f6b01b552008b4d8bad3110ceaf46e9cd795521e3456 Jun 06 16:47:21.648289 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:21.648271 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f46035_4803_471e_a507_15ca392f5b48.slice/crio-28210d5ffd2d9598b49fce6824a121beb809fd6517d8a5a169074f91ca697ad4 WatchSource:0}: Error finding container 28210d5ffd2d9598b49fce6824a121beb809fd6517d8a5a169074f91ca697ad4: Status 404 returned error can't find the container with id 28210d5ffd2d9598b49fce6824a121beb809fd6517d8a5a169074f91ca697ad4 Jun 06 16:47:22.155068 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.154756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:22.155221 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.154922 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:22.155221 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.155106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:22.155221 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.155160 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret podName:e95cec1e-d673-4db1-b626-d983df240fed nodeName:}" failed. No retries permitted until 2026-06-06 16:47:24.15513443 +0000 UTC m=+6.136609234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret") pod "global-pull-secret-syncer-cqnr6" (UID: "e95cec1e-d673-4db1-b626-d983df240fed") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:22.155414 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.155223 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:22.155414 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.155294 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:24.155276717 +0000 UTC m=+6.136751534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:22.256097 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.255477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:22.256097 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.255651 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:22.256097 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.255669 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:22.256097 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.255682 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hz854 for pod openshift-network-diagnostics/network-check-target-7p6t7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:22.256097 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.255775 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854 podName:3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d nodeName:}" failed. No retries permitted until 2026-06-06 16:47:24.255755307 +0000 UTC m=+6.237230126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz854" (UniqueName: "kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854") pod "network-check-target-7p6t7" (UID: "3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:22.463908 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.463084 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 16:42:20 +0000 UTC" deadline="2028-02-05 09:34:59.867806447 +0000 UTC" Jun 06 16:47:22.463908 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.463143 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14608h47m37.404667656s" Jun 06 16:47:22.504966 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.504331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:22.504966 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.504444 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:22.504966 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.504804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:22.504966 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:22.504885 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:22.518660 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.518628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7tmll" event={"ID":"afb5018c-8c36-49a0-be9c-f6b4afb1b47c","Type":"ContainerStarted","Data":"c07011590b58786a739626d8fef1f944ddf90f0af068bc24686ff3ed48932076"} Jun 06 16:47:22.527516 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.527487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" event={"ID":"b23e8a4da2bc68dc238258b631d7995b","Type":"ContainerStarted","Data":"6f308b5cc99ceb6759c3e4e6d87a90ce44c48f83cd6a49db1f4f9c54fc559be3"} Jun 06 16:47:22.534664 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.534640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"712ef9c025f5f609ff47e46b5115418bd4e86f7c5e0addaace46434a587df434"} Jun 06 16:47:22.541486 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.541442 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-127.ec2.internal" podStartSLOduration=3.541425299 podStartE2EDuration="3.541425299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:22.540567559 +0000 UTC m=+4.522042388" watchObservedRunningTime="2026-06-06 16:47:22.541425299 +0000 UTC m=+4.522900125" Jun 06 16:47:22.542559 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.542533 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q85xn" event={"ID":"d1d0f509-b45c-43b0-9ce9-b2de8de20b42","Type":"ContainerStarted","Data":"60cb64b92acc8161f33bc945530e54f107c45c3bc56d994fa62219a99e5af892"} Jun 06 16:47:22.544340 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.544319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ms7c9" event={"ID":"c6205570-13cf-4c02-b34b-f7513bb8cfed","Type":"ContainerStarted","Data":"8437122e3d6e3961d36b202f181521f0ed190c6f8bbf4a7bfacb10dd50dc314f"} Jun 06 16:47:22.546448 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.546423 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lt6md" event={"ID":"0bcd27ac-3a7a-4331-9782-99e278104b92","Type":"ContainerStarted","Data":"7d30d1d076b54c9a5e39321a1bfdb43e1124912cbf5a31be0a96d68f165325e1"} Jun 06 16:47:22.550975 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.550455 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b31fdc435829d99562e702fe92d4b1a" containerID="58b09095873ea38b02fc0a967c3b732454c29f4ae364791752c64bdcad931e95" exitCode=0 Jun 06 16:47:22.550975 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.550605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" event={"ID":"6b31fdc435829d99562e702fe92d4b1a","Type":"ContainerDied","Data":"58b09095873ea38b02fc0a967c3b732454c29f4ae364791752c64bdcad931e95"} Jun 06 16:47:22.562904 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.562835 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerStarted","Data":"28210d5ffd2d9598b49fce6824a121beb809fd6517d8a5a169074f91ca697ad4"} Jun 06 16:47:22.571296 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.571268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7k42m" event={"ID":"547e34f1-cca3-4313-866a-2c1aafea4661","Type":"ContainerStarted","Data":"121092c5eaa22c455bd0f6b01b552008b4d8bad3110ceaf46e9cd795521e3456"} Jun 06 16:47:22.600566 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.600539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tsgpt" event={"ID":"3e695554-c5d2-49b9-bb26-548ce9449317","Type":"ContainerStarted","Data":"a5d122ff2baa757a2ad705d45ac402441e8bbe228bc16f7eeb4fcf3e44cbf3ca"} Jun 06 16:47:22.611800 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:22.611773 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" event={"ID":"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3","Type":"ContainerStarted","Data":"6eb1985cfc38db2ffa4a7c87d8deb08efd288d23131846b058626cc30c2623af"} Jun 06 16:47:23.501689 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:23.501639 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:23.502142 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:23.501778 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:23.639428 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:23.639347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" event={"ID":"6b31fdc435829d99562e702fe92d4b1a","Type":"ContainerStarted","Data":"cc9e89d8fbd5f244e5a218be0711aa6b8b6a8c6154e8a32a7ddeda466b602b9f"} Jun 06 16:47:24.170834 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:24.170798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:24.171043 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:24.170867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:24.171123 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.171050 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:24.171123 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.171113 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret podName:e95cec1e-d673-4db1-b626-d983df240fed nodeName:}" failed. No retries permitted until 2026-06-06 16:47:28.17109108 +0000 UTC m=+10.152565898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret") pod "global-pull-secret-syncer-cqnr6" (UID: "e95cec1e-d673-4db1-b626-d983df240fed") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:24.171528 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.171509 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:24.171607 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.171573 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:28.171548619 +0000 UTC m=+10.153023424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:24.272170 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:24.272019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:24.272365 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.272266 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:24.272365 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.272293 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:24.272365 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.272306 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hz854 for pod openshift-network-diagnostics/network-check-target-7p6t7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:24.272532 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.272373 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854 podName:3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d nodeName:}" failed. No retries permitted until 2026-06-06 16:47:28.272352176 +0000 UTC m=+10.253826993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz854" (UniqueName: "kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854") pod "network-check-target-7p6t7" (UID: "3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:24.504295 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:24.504202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:24.504915 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.504345 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:24.504915 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:24.504414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:24.504915 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:24.504492 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:25.502296 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:25.502260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:25.502470 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:25.502409 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:26.501880 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:26.501837 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:26.502367 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:26.501978 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:26.502646 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:26.502457 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:26.502646 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:26.502540 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:27.501922 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:27.501886 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:27.502410 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:27.502010 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:28.203048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:28.202439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:28.203048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:28.202497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:28.203048 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.202673 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:28.203048 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.202730 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret podName:e95cec1e-d673-4db1-b626-d983df240fed nodeName:}" failed. No retries permitted until 2026-06-06 16:47:36.202711444 +0000 UTC m=+18.184186279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret") pod "global-pull-secret-syncer-cqnr6" (UID: "e95cec1e-d673-4db1-b626-d983df240fed") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:28.203048 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.202858 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:28.203048 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.202917 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:36.202899921 +0000 UTC m=+18.184374726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:28.303579 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:28.303522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:28.303752 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.303726 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:28.303752 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.303750 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:28.303864 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.303763 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hz854 for pod openshift-network-diagnostics/network-check-target-7p6t7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:28.303864 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.303824 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854 podName:3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d nodeName:}" failed. No retries permitted until 2026-06-06 16:47:36.303804331 +0000 UTC m=+18.285279139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz854" (UniqueName: "kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854") pod "network-check-target-7p6t7" (UID: "3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:28.502588 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:28.502516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:28.503004 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.502620 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:28.503004 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:28.502978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:28.503099 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:28.503067 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:29.502147 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:29.502060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:29.502367 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:29.502204 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:30.502155 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:30.501690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:30.502155 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:30.501787 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:30.502155 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:30.502088 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:30.502734 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:30.502392 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:31.502414 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:31.502369 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:31.502842 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:31.502507 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:32.501483 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:32.501445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:32.501655 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:32.501563 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:32.501655 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:32.501623 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:32.501755 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:32.501733 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:33.501931 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:33.501901 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:33.502332 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:33.502027 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:34.502219 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:34.502186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:34.502640 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:34.502186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:34.502640 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:34.502317 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:34.502640 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:34.502426 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:35.502298 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:35.502264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:35.502762 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:35.502403 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:36.262971 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:36.262937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:36.263158 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:36.263042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:36.263158 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.263078 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:36.263158 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.263145 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:36.263158 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.263158 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret podName:e95cec1e-d673-4db1-b626-d983df240fed nodeName:}" failed. No retries permitted until 2026-06-06 16:47:52.263136629 +0000 UTC m=+34.244611431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret") pod "global-pull-secret-syncer-cqnr6" (UID: "e95cec1e-d673-4db1-b626-d983df240fed") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:36.263402 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.263191 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:52.263174017 +0000 UTC m=+34.244648836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:36.363749 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:36.363711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:36.363915 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.363886 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:36.363915 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.363908 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:36.364033 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.363920 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hz854 for pod openshift-network-diagnostics/network-check-target-7p6t7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:36.364033 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.363985 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854 podName:3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d nodeName:}" failed. No retries permitted until 2026-06-06 16:47:52.363967357 +0000 UTC m=+34.345442179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz854" (UniqueName: "kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854") pod "network-check-target-7p6t7" (UID: "3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:36.502049 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:36.502007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:36.502211 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:36.502007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:36.502211 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.502144 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:36.502354 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:36.502251 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:37.502039 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:37.502001 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:37.502223 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:37.502134 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:38.502666 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:38.502632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:38.503128 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:38.502738 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:38.503128 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:38.502804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:38.503128 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:38.502934 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:39.502243 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:39.502201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:39.502474 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:39.502352 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:40.502156 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:40.502127 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:40.502541 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:40.502251 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:40.502541 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:40.502332 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:40.502541 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:40.502248 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:41.502620 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.502412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:41.503323 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:41.502709 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:41.679778 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.679689 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"a4f2d463b483f19790f11ed70bb09332a903a035f2cf14010adb77b8e84ffc20"} Jun 06 16:47:41.679927 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.679784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"ebdde54d7eab8aa1e99b0cbb675808b8a245db3e1f070e19779cc7b40ad1b4a0"} Jun 06 16:47:41.679927 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.679838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"182af9537a82d033df53e60091a9b05d03c24924fbe9e5af345f5ef7ec12ae53"} Jun 06 16:47:41.679927 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.679886 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"5a1426ad748a89d86412158b58b3d9ab638872bde89750d4f2263c8731821ab0"} Jun 06 16:47:41.679927 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.679921 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"931305845acf7ae365cf6204a79572af606c5dc9b0b04cd0bd6c0e5cd03e3fab"} Jun 06 16:47:41.680105 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.679965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"ddb43159b9ba11a8cc6d0b33356f2da6779c8c36a85a3589bf7eb10f920169db"} Jun 06 16:47:41.681403 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.681369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q85xn" event={"ID":"d1d0f509-b45c-43b0-9ce9-b2de8de20b42","Type":"ContainerStarted","Data":"6abfd34382cb7b1e088a48af40cf239832d0eec2b10f185c0f3c0f95f1550ae6"} Jun 06 16:47:41.682975 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.682930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ms7c9" event={"ID":"c6205570-13cf-4c02-b34b-f7513bb8cfed","Type":"ContainerStarted","Data":"f10d473cdef57e0d7c95bd97504ebd72c76685e189cf823d465a452382a34f2d"} Jun 06 16:47:41.684542 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.684515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lt6md" event={"ID":"0bcd27ac-3a7a-4331-9782-99e278104b92","Type":"ContainerStarted","Data":"f63fc80dd597813d7f0b82b1360f2fa3707edfa7f63ae4e11ea6ddd0a4a5b505"} Jun 06 16:47:41.686206 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.686181 2577 generic.go:356] "Generic (PLEG): container finished" podID="16f46035-4803-471e-a507-15ca392f5b48" containerID="c33f3b8e35b1bae571dd9b6c3cb93c7ac16419adce39595dce77140ed76d736a" exitCode=0 Jun 06 16:47:41.686332 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.686264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerDied","Data":"c33f3b8e35b1bae571dd9b6c3cb93c7ac16419adce39595dce77140ed76d736a"} Jun 06 16:47:41.687925 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.687878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7k42m" event={"ID":"547e34f1-cca3-4313-866a-2c1aafea4661","Type":"ContainerStarted","Data":"5d3846688d9f855d8b13dff52dd020153ec67d795d81af324a6a4e54c2d056d6"} Jun 06 16:47:41.689392 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.689366 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" event={"ID":"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3","Type":"ContainerStarted","Data":"313d5c66cb5e9fdb5315444ce4757f783a5951eb1e3ecfb1eb26621fe61c08e4"} Jun 06 16:47:41.690862 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.690838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7tmll" event={"ID":"afb5018c-8c36-49a0-be9c-f6b4afb1b47c","Type":"ContainerStarted","Data":"be15caebadbe13bb6fe12db96fb048ff0acfdaae5213115979dd287dd6a54faf"} Jun 06 16:47:41.697502 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.697454 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-127.ec2.internal" podStartSLOduration=22.697441336 podStartE2EDuration="22.697441336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:23.65442478 +0000 UTC m=+5.635899606" watchObservedRunningTime="2026-06-06 16:47:41.697441336 +0000 UTC m=+23.678916157" Jun 06 16:47:41.697623 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.697531 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q85xn" podStartSLOduration=4.5757898390000005 podStartE2EDuration="23.697526886s" totalImagesPullingTime="19.121737047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:41.69686644 +0000 UTC m=+23.678341265" watchObservedRunningTime="2026-06-06 16:47:41.697526886 +0000 UTC m=+23.679001711" Jun 06 16:47:41.733947 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.733892 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7k42m" podStartSLOduration=4.667123212 podStartE2EDuration="23.733875512s" totalImagesPullingTime="19.0667523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:41.733836056 +0000 UTC m=+23.715310892" watchObservedRunningTime="2026-06-06 16:47:41.733875512 +0000 UTC m=+23.715350337" Jun 06 16:47:41.746656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.746612 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lt6md" podStartSLOduration=4.65444488 podStartE2EDuration="23.746597081s" totalImagesPullingTime="19.092152201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:41.74643838 +0000 UTC m=+23.727913205" watchObservedRunningTime="2026-06-06 16:47:41.746597081 +0000 UTC m=+23.728071906" Jun 06 16:47:41.761893 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.761845 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7tmll" podStartSLOduration=4.672648162 podStartE2EDuration="23.76182967s" totalImagesPullingTime="19.089181508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:41.76135009 +0000 UTC m=+23.742824939" watchObservedRunningTime="2026-06-06 16:47:41.76182967 +0000 UTC m=+23.743304494" Jun 06 16:47:41.777062 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.777032 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:41.777613 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.777593 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:41.800883 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:41.800826 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ms7c9" podStartSLOduration=4.685377645 podStartE2EDuration="23.800810818s" totalImagesPullingTime="19.115433173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:41.785150341 +0000 UTC m=+23.766625188" watchObservedRunningTime="2026-06-06 16:47:41.800810818 +0000 UTC m=+23.782285643" Jun 06 16:47:42.239734 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.239698 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 16:47:42.502107 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.502016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:42.502323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.502016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:42.502323 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:42.502146 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:42.502323 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:42.502196 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:42.502517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.502419 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T16:47:42.239728711Z","UUID":"950ffa04-8ccb-4c48-bebf-a636c8f2f42d","Handler":null,"Name":"","Endpoint":""} Jun 06 16:47:42.504109 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.504088 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 16:47:42.504719 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.504131 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 16:47:42.694864 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.694832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tsgpt" event={"ID":"3e695554-c5d2-49b9-bb26-548ce9449317","Type":"ContainerStarted","Data":"d31c187f538c7fc48f4361e089fa4594b110fcb61997bc9e90cbaf879598767a"} Jun 06 16:47:42.697139 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.697106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" event={"ID":"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3","Type":"ContainerStarted","Data":"b1dc751bd1ffbf892fe954e7e85ed24a8fa14c3c63caea115b22daeb502a8bb1"} Jun 06 16:47:42.709199 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:42.709140 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tsgpt" podStartSLOduration=5.590075209 podStartE2EDuration="24.709120866s" totalImagesPullingTime="19.119045657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:42.708890667 +0000 UTC m=+24.690365504" watchObservedRunningTime="2026-06-06 16:47:42.709120866 +0000 UTC m=+24.690595695" Jun 06 16:47:43.501922 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:43.501895 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:43.502245 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:43.502019 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:43.703787 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:43.703749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"7f3afcc96802cdfcd81c7419a039fb1280a3b4ca48a9d14db25d89363648e0d2"} Jun 06 16:47:43.706069 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:43.705909 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" event={"ID":"dda7f7e1-c3b2-456f-be6e-291f2eaee5c3","Type":"ContainerStarted","Data":"e4ea3ee07550382a1ae63dcfb36ab0fb1c1a1129132b33d739d44f449acfd61f"} Jun 06 16:47:43.706241 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:43.706165 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 06 16:47:43.723019 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:43.722965 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrfgc" podStartSLOduration=4.219109725 podStartE2EDuration="25.722945091s" totalImagesPullingTime="21.503835366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:43.722843279 +0000 UTC m=+25.704318139" watchObservedRunningTime="2026-06-06 16:47:43.722945091 +0000 UTC m=+25.704419918" Jun 06 16:47:44.502314 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:44.502212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:44.502314 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:44.502281 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:44.502521 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:44.502350 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:44.502521 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:44.502503 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:45.031813 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:45.031778 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:45.032427 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:45.031907 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 06 16:47:45.032650 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:45.032626 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7tmll" Jun 06 16:47:45.502174 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:45.502143 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:45.502372 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:45.502298 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:46.502533 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.502357 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:46.502952 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.502419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:46.502952 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:46.502621 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:46.502952 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:46.502667 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:46.714586 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.714547 2577 generic.go:356] "Generic (PLEG): container finished" podID="16f46035-4803-471e-a507-15ca392f5b48" containerID="3553b40988cb32d4d4c1eedb1ae84e77d8d5439fbe352d51e470dab537438697" exitCode=0 Jun 06 16:47:46.714747 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.714626 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerDied","Data":"3553b40988cb32d4d4c1eedb1ae84e77d8d5439fbe352d51e470dab537438697"} Jun 06 16:47:46.718567 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.718542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" event={"ID":"5e002503-6534-49d4-bdc0-d70cc8ffabb8","Type":"ContainerStarted","Data":"8a57405f69e00190433b4f89c2fcd813772bd4b7a70eb14d2975ceca4f994e39"} Jun 06 16:47:46.718811 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.718781 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:46.718909 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.718857 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:46.718909 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.718905 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:46.734012 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.733971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:46.734174 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.734155 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:47:46.755478 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:46.755402 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" podStartSLOduration=9.608621185 podStartE2EDuration="28.755389461s" totalImagesPullingTime="19.146768276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:46.754827486 +0000 UTC m=+28.736302343" watchObservedRunningTime="2026-06-06 16:47:46.755389461 +0000 UTC m=+28.736864286" Jun 06 16:47:47.502257 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:47.502065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:47.502674 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:47.502370 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:47.819181 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:47.819151 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cqnr6"] Jun 06 16:47:47.819336 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:47.819284 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:47.819416 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:47.819395 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:47.825883 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:47.825468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nl9nt"] Jun 06 16:47:47.825883 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:47.825659 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:47.825883 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:47.825808 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:47.826444 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:47.826107 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7p6t7"] Jun 06 16:47:47.826574 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:47.826539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:47.826652 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:47.826631 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:48.725028 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:48.724994 2577 generic.go:356] "Generic (PLEG): container finished" podID="16f46035-4803-471e-a507-15ca392f5b48" containerID="8c26b308242c8d4d3976e61ca492b1f33f13dd14b7856d60122a614c0b236336" exitCode=0 Jun 06 16:47:48.725502 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:48.725080 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerDied","Data":"8c26b308242c8d4d3976e61ca492b1f33f13dd14b7856d60122a614c0b236336"} Jun 06 16:47:49.501713 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:49.501680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:49.501852 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:49.501680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:49.501852 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:49.501813 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:49.501948 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:49.501876 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:49.501948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:49.501686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:49.502019 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:49.501963 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:49.729255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:49.729209 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerStarted","Data":"028a6abde7232f1ad63fa24b6f247c0bebc89e9628dcbb52af1eadaa8b545b58"} Jun 06 16:47:50.733846 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:50.733754 2577 generic.go:356] "Generic (PLEG): container finished" podID="16f46035-4803-471e-a507-15ca392f5b48" containerID="028a6abde7232f1ad63fa24b6f247c0bebc89e9628dcbb52af1eadaa8b545b58" exitCode=0 Jun 06 16:47:50.733846 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:50.733796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerDied","Data":"028a6abde7232f1ad63fa24b6f247c0bebc89e9628dcbb52af1eadaa8b545b58"} Jun 06 16:47:51.502384 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:51.502346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:51.502570 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:51.502389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:51.502570 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:51.502357 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:51.502570 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:51.502476 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnr6" podUID="e95cec1e-d673-4db1-b626-d983df240fed" Jun 06 16:47:51.502570 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:51.502546 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:47:51.502772 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:51.502601 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7p6t7" podUID="3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d" Jun 06 16:47:52.280265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:52.280197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:52.280772 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:52.280273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:52.280772 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:52.280378 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:52.280772 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:52.280462 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret podName:e95cec1e-d673-4db1-b626-d983df240fed nodeName:}" failed. No retries permitted until 2026-06-06 16:48:24.280440794 +0000 UTC m=+66.261915624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret") pod "global-pull-secret-syncer-cqnr6" (UID: "e95cec1e-d673-4db1-b626-d983df240fed") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:52.280772 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:52.280378 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:52.280772 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:52.280534 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:24.280517448 +0000 UTC m=+66.261992251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:52.381181 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:52.381128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:52.381437 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:52.381310 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:52.381437 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:52.381342 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:52.381437 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:52.381357 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hz854 for pod openshift-network-diagnostics/network-check-target-7p6t7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:52.381437 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:52.381415 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854 podName:3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d nodeName:}" failed. No retries permitted until 2026-06-06 16:48:24.381396943 +0000 UTC m=+66.362871748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hz854" (UniqueName: "kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854") pod "network-check-target-7p6t7" (UID: "3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:53.298297 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.298264 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-127.ec2.internal" event="NodeReady" Jun 06 16:47:53.298695 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.298408 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 16:47:53.328942 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.328908 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d987fdfd8-42gvx"] Jun 06 16:47:53.330587 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.330571 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.332910 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.332859 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 16:47:53.333099 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.333080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 16:47:53.333194 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.333177 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 16:47:53.333314 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.333294 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n4rxq\"" Jun 06 16:47:53.337743 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.337723 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 16:47:53.340380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.340359 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rwsjk"] Jun 06 16:47:53.342054 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.342036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.344223 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.344202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 16:47:53.344223 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.344214 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 16:47:53.344383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.344294 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6gpx\"" Jun 06 16:47:53.345781 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.345762 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d987fdfd8-42gvx"] Jun 06 16:47:53.346271 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.346253 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wdr9h"] Jun 06 16:47:53.347751 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.347732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdr9h" Jun 06 16:47:53.350626 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.350164 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 16:47:53.350626 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.350252 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhvrz\"" Jun 06 16:47:53.350626 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.350168 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 16:47:53.350626 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.350522 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 16:47:53.351518 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.351417 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwsjk"] Jun 06 16:47:53.356899 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.356881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdr9h"] Jun 06 16:47:53.489035 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwkx\" (UniqueName: \"kubernetes.io/projected/a96ffa7a-747b-4550-a213-58068599c779-kube-api-access-ppwkx\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.489204 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-registry-certificates\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.489204 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-trusted-ca\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.489204 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-bound-sa-token\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.489204 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a96ffa7a-747b-4550-a213-58068599c779-tmp-dir\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.489204 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82b46097-10e3-42a0-8135-becb1bf44c20-ca-trust-extracted\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.489491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gcvv\" (UniqueName: \"kubernetes.io/projected/30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f-kube-api-access-4gcvv\") pod \"ingress-canary-wdr9h\" (UID: \"30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f\") " pod="openshift-ingress-canary/ingress-canary-wdr9h" Jun 06 16:47:53.489491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f-cert\") pod \"ingress-canary-wdr9h\" (UID: \"30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f\") " pod="openshift-ingress-canary/ingress-canary-wdr9h" Jun 06 16:47:53.489491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.489491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-installation-pull-secrets\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.489491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzlc6\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-kube-api-access-qzlc6\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.489491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-image-registry-private-configuration\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.489491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a96ffa7a-747b-4550-a213-58068599c779-config-volume\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.489491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.489473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.502129 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.502078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:47:53.502220 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.502078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:47:53.502386 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.502078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:47:53.504591 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.504576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tbbrh\"" Jun 06 16:47:53.504686 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.504650 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjp89\"" Jun 06 16:47:53.504760 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.504744 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 16:47:53.504872 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.504859 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 16:47:53.504938 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.504862 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 16:47:53.504938 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.504907 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 16:47:53.589935 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.589904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.590117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.589941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwkx\" (UniqueName: \"kubernetes.io/projected/a96ffa7a-747b-4550-a213-58068599c779-kube-api-access-ppwkx\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.590117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.589961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-registry-certificates\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.589985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-trusted-ca\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-bound-sa-token\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590117 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:53.590055 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:47:53.590117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a96ffa7a-747b-4550-a213-58068599c779-tmp-dir\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.590117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82b46097-10e3-42a0-8135-becb1bf44c20-ca-trust-extracted\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:53.590129 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:54.090109592 +0000 UTC m=+36.071584412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gcvv\" (UniqueName: \"kubernetes.io/projected/30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f-kube-api-access-4gcvv\") pod \"ingress-canary-wdr9h\" (UID: \"30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f\") " pod="openshift-ingress-canary/ingress-canary-wdr9h" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f-cert\") pod \"ingress-canary-wdr9h\" (UID: \"30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f\") " pod="openshift-ingress-canary/ingress-canary-wdr9h" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-installation-pull-secrets\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzlc6\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-kube-api-access-qzlc6\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:53.590411 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:53.590427 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-image-registry-private-configuration\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:53.590476 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:54.090457576 +0000 UTC m=+36.071932382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a96ffa7a-747b-4550-a213-58068599c779-config-volume\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590541 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82b46097-10e3-42a0-8135-becb1bf44c20-ca-trust-extracted\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.590571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a96ffa7a-747b-4550-a213-58068599c779-tmp-dir\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.591046 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-registry-certificates\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.591197 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.590982 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a96ffa7a-747b-4550-a213-58068599c779-config-volume\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.591682 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.591654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-trusted-ca\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.594404 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.594378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-installation-pull-secrets\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.594522 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.594501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-image-registry-private-configuration\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.594589 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.594560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f-cert\") pod \"ingress-canary-wdr9h\" (UID: \"30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f\") " pod="openshift-ingress-canary/ingress-canary-wdr9h" Jun 06 16:47:53.598463 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.598432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-bound-sa-token\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.598558 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.598491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwkx\" (UniqueName: \"kubernetes.io/projected/a96ffa7a-747b-4550-a213-58068599c779-kube-api-access-ppwkx\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:53.598612 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.598586 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzlc6\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-kube-api-access-qzlc6\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:53.598981 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.598966 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gcvv\" (UniqueName: \"kubernetes.io/projected/30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f-kube-api-access-4gcvv\") pod \"ingress-canary-wdr9h\" (UID: \"30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f\") " pod="openshift-ingress-canary/ingress-canary-wdr9h" Jun 06 16:47:53.659361 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.659319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdr9h" Jun 06 16:47:53.807198 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:53.807169 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdr9h"] Jun 06 16:47:53.811754 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:47:53.811724 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30aa7a02_16e5_4ff5_bfbd_d2ecdfbb9e5f.slice/crio-f3d89d4b9dd1095c461c48cefcb16a922065202425fd279404b5119f015f050e WatchSource:0}: Error finding container f3d89d4b9dd1095c461c48cefcb16a922065202425fd279404b5119f015f050e: Status 404 returned error can't find the container with id f3d89d4b9dd1095c461c48cefcb16a922065202425fd279404b5119f015f050e Jun 06 16:47:54.094040 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:54.093954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:54.094200 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:54.094062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:54.094200 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:54.094135 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:47:54.094200 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:54.094191 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:47:54.094383 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:54.094205 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:47:54.094383 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:54.094216 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:55.094193926 +0000 UTC m=+37.075668731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:47:54.094383 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:54.094269 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:55.09425304 +0000 UTC m=+37.075727857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:47:54.745108 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:54.745064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdr9h" event={"ID":"30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f","Type":"ContainerStarted","Data":"f3d89d4b9dd1095c461c48cefcb16a922065202425fd279404b5119f015f050e"} Jun 06 16:47:55.103403 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:55.103317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:55.103572 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:55.103420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:55.103572 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:55.103483 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:47:55.103572 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:55.103531 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:47:55.103572 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:55.103545 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:47:55.103572 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:55.103561 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:57.103545242 +0000 UTC m=+39.085020049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:47:55.103845 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:55.103590 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:57.103575996 +0000 UTC m=+39.085050802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:47:55.751510 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:55.751474 2577 generic.go:356] "Generic (PLEG): container finished" podID="16f46035-4803-471e-a507-15ca392f5b48" containerID="ffa380127ffc21d40562d402e12167934bdd31cca7b4cffb3d54da114834e3b9" exitCode=0 Jun 06 16:47:55.751972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:55.751521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerDied","Data":"ffa380127ffc21d40562d402e12167934bdd31cca7b4cffb3d54da114834e3b9"} Jun 06 16:47:56.756901 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:56.756750 2577 generic.go:356] "Generic (PLEG): container finished" podID="16f46035-4803-471e-a507-15ca392f5b48" containerID="2eb3b4324fd9acc65aa445a64bfb749761ba5d474e64fd9b7be2d7f00c58f4de" exitCode=0 Jun 06 16:47:56.757367 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:56.756830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerDied","Data":"2eb3b4324fd9acc65aa445a64bfb749761ba5d474e64fd9b7be2d7f00c58f4de"} Jun 06 16:47:57.120389 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:57.120277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:47:57.120389 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:57.120363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:47:57.120626 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:57.120458 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:47:57.120626 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:57.120472 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:47:57.120626 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:57.120517 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:01.120502091 +0000 UTC m=+43.101976894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:47:57.120626 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:57.120458 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:47:57.120626 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:47:57.120603 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:01.120583279 +0000 UTC m=+43.102058084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:47:57.760716 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:57.760684 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdr9h" event={"ID":"30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f","Type":"ContainerStarted","Data":"785d5fc1343e8879ff68fa511dff0f2b43348e7ad525419492474b5cd9c7b2b0"} Jun 06 16:47:57.766606 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:57.766577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" event={"ID":"16f46035-4803-471e-a507-15ca392f5b48","Type":"ContainerStarted","Data":"6d73c6145c33dd9a53cd10b74eb626ea854b5c58a2a87ea19adf3cc03e848ef4"} Jun 06 16:47:57.775932 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:57.775891 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wdr9h" podStartSLOduration=1.896798204 podStartE2EDuration="4.775878581s" totalImagesPullingTime="2.879080377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:57.775155386 +0000 UTC m=+39.756630211" watchObservedRunningTime="2026-06-06 16:47:57.775878581 +0000 UTC m=+39.757353405" Jun 06 16:47:57.795662 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:57.795618 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dp6g5" podStartSLOduration=9.829446973 podStartE2EDuration="39.79560459s" totalImagesPullingTime="29.966157617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:57.795017141 +0000 UTC m=+39.776491993" watchObservedRunningTime="2026-06-06 16:47:57.79560459 +0000 UTC m=+39.777079415" Jun 06 16:47:57.927070 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:57.927037 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:47:58.003112 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:58.003085 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:47:58.104883 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:58.104810 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:47:58.787646 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:58.787614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:47:58.833546 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:47:58.833521 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:01.147147 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:01.147116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:48:01.147523 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:01.147161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:48:01.147523 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:01.147281 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:48:01.147523 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:01.147300 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:48:01.147523 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:01.147299 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:01.147523 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:01.147356 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:09.147338016 +0000 UTC m=+51.128812822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:48:01.147523 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:01.147375 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:09.147367452 +0000 UTC m=+51.128842256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:48:02.011167 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:02.011135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:02.077359 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:02.077325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:02.177367 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:02.177330 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:02.276604 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:02.276528 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:02.328383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:02.328343 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:09.207135 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:09.207090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:48:09.207598 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:09.207165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:48:09.207598 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:09.207254 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:09.207598 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:09.207281 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:48:09.207598 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:09.207291 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:48:09.207598 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:09.207318 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:25.207301152 +0000 UTC m=+67.188775955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:48:09.207598 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:09.207338 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:25.207326899 +0000 UTC m=+67.188801703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:48:11.277435 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:11.277402 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:11.330642 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:11.330617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:12.308269 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:12.308223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:12.356279 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:12.356219 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:15.147058 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:15.147020 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:18.734904 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:18.734879 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7t4sp" Jun 06 16:48:18.879729 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:18.879693 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:18.926281 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:18.926256 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:23.206282 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:23.206239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:23.307159 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:23.307130 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:23.540766 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:23.540679 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:23.639825 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:23.639796 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:24.245921 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.245882 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:24.307079 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.307051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:48:24.307207 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.307088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:48:24.310565 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.310541 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 16:48:24.310667 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.310597 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 16:48:24.318497 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:24.318478 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 16:48:24.318552 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:24.318541 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:49:28.318521653 +0000 UTC m=+130.299996459 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : secret "metrics-daemon-secret" not found Jun 06 16:48:24.321667 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.321642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e95cec1e-d673-4db1-b626-d983df240fed-original-pull-secret\") pod \"global-pull-secret-syncer-cqnr6\" (UID: \"e95cec1e-d673-4db1-b626-d983df240fed\") " pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:48:24.346469 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.346439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:24.407787 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.407758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:48:24.410141 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.410127 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 16:48:24.420948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.420927 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 16:48:24.421983 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.421968 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnr6" Jun 06 16:48:24.431418 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.431398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz854\" (UniqueName: \"kubernetes.io/projected/3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d-kube-api-access-hz854\") pod \"network-check-target-7p6t7\" (UID: \"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d\") " pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:48:24.558997 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.558971 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cqnr6"] Jun 06 16:48:24.562439 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:48:24.562418 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95cec1e_d673_4db1_b626_d983df240fed.slice/crio-b5d727a28d9347debe62c2843935eee9248d01fdb79ffb62239710ca3b04239b WatchSource:0}: Error finding container b5d727a28d9347debe62c2843935eee9248d01fdb79ffb62239710ca3b04239b: Status 404 returned error can't find the container with id b5d727a28d9347debe62c2843935eee9248d01fdb79ffb62239710ca3b04239b Jun 06 16:48:24.718544 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.718523 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjp89\"" Jun 06 16:48:24.727252 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.727238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:48:24.826885 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.826858 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cqnr6" event={"ID":"e95cec1e-d673-4db1-b626-d983df240fed","Type":"ContainerStarted","Data":"b5d727a28d9347debe62c2843935eee9248d01fdb79ffb62239710ca3b04239b"} Jun 06 16:48:24.839258 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:24.839223 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7p6t7"] Jun 06 16:48:24.842046 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:48:24.842023 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0a5502_b6bd_43e6_9e04_22f3b4eaab1d.slice/crio-8291f733e1bc42d30b6fd4db30f5fc526ccab2c4fd7b7ed27f3711f5c8f17fe0 WatchSource:0}: Error finding container 8291f733e1bc42d30b6fd4db30f5fc526ccab2c4fd7b7ed27f3711f5c8f17fe0: Status 404 returned error can't find the container with id 8291f733e1bc42d30b6fd4db30f5fc526ccab2c4fd7b7ed27f3711f5c8f17fe0 Jun 06 16:48:25.148330 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:25.148260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:25.215304 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:25.215268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:48:25.215456 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:25.215339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:48:25.215524 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:25.215449 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:25.215524 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:25.215475 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:48:25.215524 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:25.215490 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:48:25.215686 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:25.215539 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:57.215516995 +0000 UTC m=+99.196991801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:48:25.215686 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:25.215560 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:57.215549599 +0000 UTC m=+99.197024402 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:48:25.374540 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:25.374504 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:25.428002 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:25.427891 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:25.831474 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:25.831436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7p6t7" event={"ID":"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d","Type":"ContainerStarted","Data":"8291f733e1bc42d30b6fd4db30f5fc526ccab2c4fd7b7ed27f3711f5c8f17fe0"} Jun 06 16:48:28.897394 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:28.897359 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:28.950695 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:28.950630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:29.843729 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:29.843629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cqnr6" event={"ID":"e95cec1e-d673-4db1-b626-d983df240fed","Type":"ContainerStarted","Data":"24eaf44e695852ff36d712a54bc3c69e9a4e7a4aa84f896c17e40575c2f4f9d2"} Jun 06 16:48:29.845047 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:29.845026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7p6t7" event={"ID":"3e0a5502-b6bd-43e6-9e04-22f3b4eaab1d","Type":"ContainerStarted","Data":"02698e83db4b0826f14c150f6d7ddfb5e8c6c5d148330c8bd82b64e5b826d653"} Jun 06 16:48:29.845171 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:29.845149 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:48:29.857065 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:29.857028 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cqnr6" podStartSLOduration=66.96425182 podStartE2EDuration="1m11.857016057s" totalImagesPullingTime="4.892764237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:29.856566519 +0000 UTC m=+71.838041353" watchObservedRunningTime="2026-06-06 16:48:29.857016057 +0000 UTC m=+71.838490881" Jun 06 16:48:29.869085 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:29.869049 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7p6t7" podStartSLOduration=67.267210298 podStartE2EDuration="1m11.869028444s" totalImagesPullingTime="4.601818146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:29.868742924 +0000 UTC m=+71.850217782" watchObservedRunningTime="2026-06-06 16:48:29.869028444 +0000 UTC m=+71.850503269" Jun 06 16:48:36.877974 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:36.877913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:36.926415 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:36.926380 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:39.291797 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:39.291678 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:39.392073 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:39.392037 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:40.051330 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:40.051299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:49.365852 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:49.365792 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:49.413529 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:49.413501 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:48:57.230050 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:57.230002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:48:57.230501 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:48:57.230078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:48:57.230501 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:57.230144 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:57.230501 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:57.230211 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:48:57.230501 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:57.230245 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:48:57.230501 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:57.230260 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:50:01.230243556 +0000 UTC m=+163.211718371 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:48:57.230501 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:48:57.230314 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:50:01.230297391 +0000 UTC m=+163.211772195 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:49:00.848915 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:49:00.848883 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7p6t7" Jun 06 16:49:02.247618 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:49:02.247582 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:49:02.303241 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:49:02.303205 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:49:28.342629 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:49:28.342580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:49:28.343106 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:49:28.342724 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 16:49:28.343106 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:49:28.342804 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs podName:5491b72a-033f-4bb1-b3cd-18a1b8e63176 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:30.342786573 +0000 UTC m=+252.324261375 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs") pod "network-metrics-daemon-nl9nt" (UID: "5491b72a-033f-4bb1-b3cd-18a1b8e63176") : secret "metrics-daemon-secret" not found Jun 06 16:49:56.342893 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:49:56.342857 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" podUID="82b46097-10e3-42a0-8135-becb1bf44c20" Jun 06 16:49:56.353989 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:49:56.353963 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rwsjk" podUID="a96ffa7a-747b-4550-a213-58068599c779" Jun 06 16:49:56.511216 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:49:56.511183 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nl9nt" podUID="5491b72a-033f-4bb1-b3cd-18a1b8e63176" Jun 06 16:49:57.044348 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:49:57.044318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:49:57.044528 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:49:57.044318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwsjk" Jun 06 16:50:01.269375 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:50:01.269332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:50:01.269886 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:50:01.269395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:50:01.269886 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:50:01.269498 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:50:01.269886 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:50:01.269509 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d987fdfd8-42gvx: secret "image-registry-tls" not found Jun 06 16:50:01.269886 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:50:01.269510 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:50:01.269886 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:50:01.269560 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls podName:82b46097-10e3-42a0-8135-becb1bf44c20 nodeName:}" failed. No retries permitted until 2026-06-06 16:52:03.269547442 +0000 UTC m=+285.251022245 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls") pod "image-registry-6d987fdfd8-42gvx" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20") : secret "image-registry-tls" not found Jun 06 16:50:01.269886 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:50:01.269596 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls podName:a96ffa7a-747b-4550-a213-58068599c779 nodeName:}" failed. No retries permitted until 2026-06-06 16:52:03.269577295 +0000 UTC m=+285.251052114 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls") pod "dns-default-rwsjk" (UID: "a96ffa7a-747b-4550-a213-58068599c779") : secret "dns-default-metrics-tls" not found Jun 06 16:50:08.502596 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:50:08.502499 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:50:47.807595 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:50:47.807568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:10.086687 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.086656 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854"] Jun 06 16:51:10.089439 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.089423 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z"] Jun 06 16:51:10.089555 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.089535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:10.092008 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.091990 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-qpbdr"] Jun 06 16:51:10.092136 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.092091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:10.092677 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.092661 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 06 16:51:10.092907 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.092885 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 06 16:51:10.093254 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.093218 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:51:10.093343 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.093223 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sktml\"" Jun 06 16:51:10.094520 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.094501 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.095357 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.095341 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 06 16:51:10.095701 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.095680 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 06 16:51:10.096831 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.096815 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-554b47b59-bkb9r"] Jun 06 16:51:10.098924 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.098906 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 06 16:51:10.099016 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.098953 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 06 16:51:10.099076 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.099022 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mfk5c\"" Jun 06 16:51:10.099190 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.099172 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j9kfb\"" Jun 06 16:51:10.099341 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.099319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.099430 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.099395 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:51:10.099921 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.099317 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 06 16:51:10.101154 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.101136 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z"] Jun 06 16:51:10.101403 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.101387 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 06 16:51:10.101473 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.101423 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 16:51:10.101895 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.101879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-628l2\"" Jun 06 16:51:10.101979 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.101925 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 06 16:51:10.101979 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.101938 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 16:51:10.101979 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.101870 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 06 16:51:10.102837 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.102822 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 06 16:51:10.105423 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.105406 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854"] Jun 06 16:51:10.105566 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.105466 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 06 16:51:10.106988 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.106969 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-qpbdr"] Jun 06 16:51:10.115382 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.115358 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-554b47b59-bkb9r"] Jun 06 16:51:10.129264 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.129346 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4m5m\" (UniqueName: \"kubernetes.io/projected/722ff46c-6ce4-4617-88d3-36e20ff703c9-kube-api-access-b4m5m\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.129395 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/722ff46c-6ce4-4617-88d3-36e20ff703c9-config\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.129441 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.129510 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-default-certificate\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.129566 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-694x8\" (UniqueName: \"kubernetes.io/projected/ec9b0760-5e94-4884-909b-ce8401782701-kube-api-access-694x8\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:10.129620 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:10.129620 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08e010e7-b1ee-4152-869b-2b9f665dff68-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:10.129728 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/722ff46c-6ce4-4617-88d3-36e20ff703c9-serving-cert\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.129728 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722ff46c-6ce4-4617-88d3-36e20ff703c9-trusted-ca\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.129728 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmv4\" (UniqueName: \"kubernetes.io/projected/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-kube-api-access-mqmv4\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.129728 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:10.129883 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.129750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-stats-auth\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.181379 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.181349 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz"] Jun 06 16:51:10.186263 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.186239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz" Jun 06 16:51:10.188456 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.188430 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd"] Jun 06 16:51:10.188895 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.188875 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 06 16:51:10.188895 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.188889 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vcpmk\"" Jun 06 16:51:10.189509 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.189493 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:51:10.190983 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.190963 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-mv2bv"] Jun 06 16:51:10.191112 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.191083 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.193541 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.193404 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 16:51:10.193541 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.193492 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9trx9\"" Jun 06 16:51:10.193665 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.193624 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 16:51:10.194072 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.194038 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz"] Jun 06 16:51:10.194158 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.194125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.194555 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.194536 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 06 16:51:10.194662 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.194610 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 06 16:51:10.196435 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.196416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 16:51:10.196571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.196536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6pc24\"" Jun 06 16:51:10.196656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.196619 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 06 16:51:10.196725 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.196544 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 06 16:51:10.196725 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.196713 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 16:51:10.201687 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.201671 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 06 16:51:10.203776 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.203752 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-mv2bv"] Jun 06 16:51:10.204757 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.204737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd"] Jun 06 16:51:10.230491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/722ff46c-6ce4-4617-88d3-36e20ff703c9-serving-cert\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.230636 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722ff46c-6ce4-4617-88d3-36e20ff703c9-trusted-ca\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.230636 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmv4\" (UniqueName: \"kubernetes.io/projected/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-kube-api-access-mqmv4\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.230757 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:10.230757 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1847750e-7617-4d3f-8137-138bcd90302a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.230757 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-serving-cert\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.230757 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-stats-auth\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.230928 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.230767 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 16:51:10.230928 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-trusted-ca-bundle\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.230928 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfc5f\" (UniqueName: \"kubernetes.io/projected/0e56049c-46d0-47f8-8759-1903b3cee6da-kube-api-access-cfc5f\") pod \"volume-data-source-validator-78dd696465-mrjxz\" (UID: \"0e56049c-46d0-47f8-8759-1903b3cee6da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz" Jun 06 16:51:10.230928 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.230928 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.230863 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert podName:08e010e7-b1ee-4152-869b-2b9f665dff68 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:10.730844912 +0000 UTC m=+232.712319727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7z64z" (UID: "08e010e7-b1ee-4152-869b-2b9f665dff68") : secret "networking-console-plugin-cert" not found Jun 06 16:51:10.230928 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmt8q\" (UniqueName: \"kubernetes.io/projected/1847750e-7617-4d3f-8137-138bcd90302a-kube-api-access-gmt8q\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.230928 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.230909 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 16:51:10.230928 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-tmp\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.231331 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.230954 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:10.730941893 +0000 UTC m=+232.712416698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : secret "router-metrics-certs-default" not found Jun 06 16:51:10.231331 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.230989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4m5m\" (UniqueName: \"kubernetes.io/projected/722ff46c-6ce4-4617-88d3-36e20ff703c9-kube-api-access-b4m5m\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.231331 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/722ff46c-6ce4-4617-88d3-36e20ff703c9-config\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.231331 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l5qk\" (UniqueName: \"kubernetes.io/projected/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-kube-api-access-6l5qk\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.231331 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.231331 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-default-certificate\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.231331 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-694x8\" (UniqueName: \"kubernetes.io/projected/ec9b0760-5e94-4884-909b-ce8401782701-kube-api-access-694x8\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:10.231331 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.231350 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:10.731331353 +0000 UTC m=+232.712806159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : configmap references non-existent config key: service-ca.crt Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-snapshots\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-service-ca-bundle\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08e010e7-b1ee-4152-869b-2b9f665dff68-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231485 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722ff46c-6ce4-4617-88d3-36e20ff703c9-trusted-ca\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.231590 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.231633 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls podName:ec9b0760-5e94-4884-909b-ce8401782701 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:10.731618696 +0000 UTC m=+232.713093500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qq854" (UID: "ec9b0760-5e94-4884-909b-ce8401782701") : secret "samples-operator-tls" not found Jun 06 16:51:10.231726 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.231646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/722ff46c-6ce4-4617-88d3-36e20ff703c9-config\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.232175 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.232064 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08e010e7-b1ee-4152-869b-2b9f665dff68-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:10.233359 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.233333 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/722ff46c-6ce4-4617-88d3-36e20ff703c9-serving-cert\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.233505 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.233486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-stats-auth\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.233633 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.233616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-default-certificate\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.252424 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.252404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4m5m\" (UniqueName: \"kubernetes.io/projected/722ff46c-6ce4-4617-88d3-36e20ff703c9-kube-api-access-b4m5m\") pod \"console-operator-668fdbf85c-qpbdr\" (UID: \"722ff46c-6ce4-4617-88d3-36e20ff703c9\") " pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.252827 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.252812 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmv4\" (UniqueName: \"kubernetes.io/projected/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-kube-api-access-mqmv4\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.253330 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.253310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-694x8\" (UniqueName: \"kubernetes.io/projected/ec9b0760-5e94-4884-909b-ce8401782701-kube-api-access-694x8\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:10.285591 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.285567 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff"] Jun 06 16:51:10.289670 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.289657 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.291696 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.291681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 06 16:51:10.291805 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.291768 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 06 16:51:10.291805 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.291780 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2rk7r\"" Jun 06 16:51:10.291916 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.291769 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:51:10.292039 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.292027 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 06 16:51:10.297189 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.297172 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff"] Jun 06 16:51:10.332463 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.332547 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-snapshots\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.332547 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-service-ca-bundle\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.332547 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50001a40-7b39-4edf-aa51-05de9b94fa87-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.332674 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.332572 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:10.332674 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1847750e-7617-4d3f-8137-138bcd90302a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.332674 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.332650 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls podName:1847750e-7617-4d3f-8137-138bcd90302a nodeName:}" failed. No retries permitted until 2026-06-06 16:51:10.832605059 +0000 UTC m=+232.814079868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcwqd" (UID: "1847750e-7617-4d3f-8137-138bcd90302a") : secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:10.332799 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-serving-cert\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.332799 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khlgd\" (UniqueName: \"kubernetes.io/projected/50001a40-7b39-4edf-aa51-05de9b94fa87-kube-api-access-khlgd\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.332879 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50001a40-7b39-4edf-aa51-05de9b94fa87-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.332923 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-trusted-ca-bundle\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.332976 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfc5f\" (UniqueName: \"kubernetes.io/projected/0e56049c-46d0-47f8-8759-1903b3cee6da-kube-api-access-cfc5f\") pod \"volume-data-source-validator-78dd696465-mrjxz\" (UID: \"0e56049c-46d0-47f8-8759-1903b3cee6da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz" Jun 06 16:51:10.333037 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.332994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmt8q\" (UniqueName: \"kubernetes.io/projected/1847750e-7617-4d3f-8137-138bcd90302a-kube-api-access-gmt8q\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.333037 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.333019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-tmp\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.333140 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.333064 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-service-ca-bundle\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.333140 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.333087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l5qk\" (UniqueName: \"kubernetes.io/projected/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-kube-api-access-6l5qk\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.333140 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.333132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-snapshots\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.333322 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.333253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1847750e-7617-4d3f-8137-138bcd90302a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.333456 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.333435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-tmp\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.333667 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.333649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-trusted-ca-bundle\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.334752 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.334735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-serving-cert\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.342472 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.342423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmt8q\" (UniqueName: \"kubernetes.io/projected/1847750e-7617-4d3f-8137-138bcd90302a-kube-api-access-gmt8q\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.342916 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.342895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfc5f\" (UniqueName: \"kubernetes.io/projected/0e56049c-46d0-47f8-8759-1903b3cee6da-kube-api-access-cfc5f\") pod \"volume-data-source-validator-78dd696465-mrjxz\" (UID: \"0e56049c-46d0-47f8-8759-1903b3cee6da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz" Jun 06 16:51:10.343580 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.343560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l5qk\" (UniqueName: \"kubernetes.io/projected/6c108fee-d835-41a7-a67e-fc6d5f8de8aa-kube-api-access-6l5qk\") pod \"insights-operator-896549976-mv2bv\" (UID: \"6c108fee-d835-41a7-a67e-fc6d5f8de8aa\") " pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.357471 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.357451 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:10.403435 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.403413 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:10.420805 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.420782 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:10.433828 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.433808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50001a40-7b39-4edf-aa51-05de9b94fa87-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.433893 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.433874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khlgd\" (UniqueName: \"kubernetes.io/projected/50001a40-7b39-4edf-aa51-05de9b94fa87-kube-api-access-khlgd\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.433988 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.433971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50001a40-7b39-4edf-aa51-05de9b94fa87-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.434295 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.434279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50001a40-7b39-4edf-aa51-05de9b94fa87-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.435935 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.435918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50001a40-7b39-4edf-aa51-05de9b94fa87-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.441029 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.441011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khlgd\" (UniqueName: \"kubernetes.io/projected/50001a40-7b39-4edf-aa51-05de9b94fa87-kube-api-access-khlgd\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f4vff\" (UID: \"50001a40-7b39-4edf-aa51-05de9b94fa87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.497572 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.497542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz" Jun 06 16:51:10.510885 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.510863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-mv2bv" Jun 06 16:51:10.538920 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.538888 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-qpbdr"] Jun 06 16:51:10.542298 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:10.542268 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722ff46c_6ce4_4617_88d3_36e20ff703c9.slice/crio-cb9344d456cf91a2ef9bb244db05553b24cc8ae5305cf14d53d485aaeed0c4d3 WatchSource:0}: Error finding container cb9344d456cf91a2ef9bb244db05553b24cc8ae5305cf14d53d485aaeed0c4d3: Status 404 returned error can't find the container with id cb9344d456cf91a2ef9bb244db05553b24cc8ae5305cf14d53d485aaeed0c4d3 Jun 06 16:51:10.598695 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.598394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" Jun 06 16:51:10.627485 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.627395 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz"] Jun 06 16:51:10.630396 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:10.630364 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e56049c_46d0_47f8_8759_1903b3cee6da.slice/crio-4a3478710ae84b0bcbcbc1e1d39ed3231adaf5606148068f45d53921db8e9db2 WatchSource:0}: Error finding container 4a3478710ae84b0bcbcbc1e1d39ed3231adaf5606148068f45d53921db8e9db2: Status 404 returned error can't find the container with id 4a3478710ae84b0bcbcbc1e1d39ed3231adaf5606148068f45d53921db8e9db2 Jun 06 16:51:10.642716 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.642693 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-mv2bv"] Jun 06 16:51:10.646059 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:10.646033 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c108fee_d835_41a7_a67e_fc6d5f8de8aa.slice/crio-058d9da3f0198904f30f76323f4496a532f8411a040261c704db879869397a6c WatchSource:0}: Error finding container 058d9da3f0198904f30f76323f4496a532f8411a040261c704db879869397a6c: Status 404 returned error can't find the container with id 058d9da3f0198904f30f76323f4496a532f8411a040261c704db879869397a6c Jun 06 16:51:10.722049 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.722020 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff"] Jun 06 16:51:10.724601 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:10.724578 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50001a40_7b39_4edf_aa51_05de9b94fa87.slice/crio-31d8226be5841e439df729690eefcd6e3a8fec7a73edffb84801fd4c22c7f077 WatchSource:0}: Error finding container 31d8226be5841e439df729690eefcd6e3a8fec7a73edffb84801fd4c22c7f077: Status 404 returned error can't find the container with id 31d8226be5841e439df729690eefcd6e3a8fec7a73edffb84801fd4c22c7f077 Jun 06 16:51:10.736140 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.736121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.736216 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.736156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:10.736216 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.736182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:10.736308 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.736276 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 16:51:10.736308 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.736294 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:11.73627474 +0000 UTC m=+233.717749544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : configmap references non-existent config key: service-ca.crt Jun 06 16:51:10.736391 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.736322 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 16:51:10.736391 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.736341 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert podName:08e010e7-b1ee-4152-869b-2b9f665dff68 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:11.736330844 +0000 UTC m=+233.717805650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7z64z" (UID: "08e010e7-b1ee-4152-869b-2b9f665dff68") : secret "networking-console-plugin-cert" not found Jun 06 16:51:10.736391 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.736322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:10.736391 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.736360 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls podName:ec9b0760-5e94-4884-909b-ce8401782701 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:11.736351374 +0000 UTC m=+233.717826186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qq854" (UID: "ec9b0760-5e94-4884-909b-ce8401782701") : secret "samples-operator-tls" not found Jun 06 16:51:10.736391 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.736387 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 16:51:10.736559 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.736431 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:11.73641569 +0000 UTC m=+233.717890510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : secret "router-metrics-certs-default" not found Jun 06 16:51:10.837565 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:10.837535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:10.837704 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.837673 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:10.837744 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:10.837733 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls podName:1847750e-7617-4d3f-8137-138bcd90302a nodeName:}" failed. No retries permitted until 2026-06-06 16:51:11.837717649 +0000 UTC m=+233.819192452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcwqd" (UID: "1847750e-7617-4d3f-8137-138bcd90302a") : secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:11.209090 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.209028 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" event={"ID":"722ff46c-6ce4-4617-88d3-36e20ff703c9","Type":"ContainerStarted","Data":"cb9344d456cf91a2ef9bb244db05553b24cc8ae5305cf14d53d485aaeed0c4d3"} Jun 06 16:51:11.210538 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.210503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" event={"ID":"50001a40-7b39-4edf-aa51-05de9b94fa87","Type":"ContainerStarted","Data":"31d8226be5841e439df729690eefcd6e3a8fec7a73edffb84801fd4c22c7f077"} Jun 06 16:51:11.211659 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.211626 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mv2bv" event={"ID":"6c108fee-d835-41a7-a67e-fc6d5f8de8aa","Type":"ContainerStarted","Data":"058d9da3f0198904f30f76323f4496a532f8411a040261c704db879869397a6c"} Jun 06 16:51:11.212987 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.212961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz" event={"ID":"0e56049c-46d0-47f8-8759-1903b3cee6da","Type":"ContainerStarted","Data":"4a3478710ae84b0bcbcbc1e1d39ed3231adaf5606148068f45d53921db8e9db2"} Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.745664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.745735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.745782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.745836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.745911 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:13.74589131 +0000 UTC m=+235.727366124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : configmap references non-existent config key: service-ca.crt Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.745958 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.745992 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:13.745981722 +0000 UTC m=+235.727456525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : secret "router-metrics-certs-default" not found Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.746043 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.746072 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls podName:ec9b0760-5e94-4884-909b-ce8401782701 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:13.746062805 +0000 UTC m=+235.727537608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qq854" (UID: "ec9b0760-5e94-4884-909b-ce8401782701") : secret "samples-operator-tls" not found Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.746117 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 16:51:11.746169 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.746143 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert podName:08e010e7-b1ee-4152-869b-2b9f665dff68 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:13.74613488 +0000 UTC m=+235.727609683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7z64z" (UID: "08e010e7-b1ee-4152-869b-2b9f665dff68") : secret "networking-console-plugin-cert" not found Jun 06 16:51:11.847265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:11.846647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:11.847265 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.846848 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:11.847265 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:11.846908 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls podName:1847750e-7617-4d3f-8137-138bcd90302a nodeName:}" failed. No retries permitted until 2026-06-06 16:51:13.846890058 +0000 UTC m=+235.828364875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcwqd" (UID: "1847750e-7617-4d3f-8137-138bcd90302a") : secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:12.216432 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:12.216400 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz" event={"ID":"0e56049c-46d0-47f8-8759-1903b3cee6da","Type":"ContainerStarted","Data":"ba33fa7761ca6a31140c0cfbaa22394770ab694531e692b41bc5905504db5827"} Jun 06 16:51:12.232010 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:12.231963 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-mrjxz" podStartSLOduration=0.944833312 podStartE2EDuration="2.231947309s" totalImagesPullingTime="1.287113997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:12.231127748 +0000 UTC m=+234.212602574" watchObservedRunningTime="2026-06-06 16:51:12.231947309 +0000 UTC m=+234.213422134" Jun 06 16:51:12.295335 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:12.295303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:12.342417 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:12.342386 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:13.766064 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:13.766037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:13.766344 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:13.766102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:13.766344 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:13.766149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:13.766344 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.766199 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 16:51:13.766344 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.766272 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 16:51:13.766344 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.766210 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:17.766190676 +0000 UTC m=+239.747665492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : configmap references non-existent config key: service-ca.crt Jun 06 16:51:13.766344 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.766311 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert podName:08e010e7-b1ee-4152-869b-2b9f665dff68 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:17.766299002 +0000 UTC m=+239.747773805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7z64z" (UID: "08e010e7-b1ee-4152-869b-2b9f665dff68") : secret "networking-console-plugin-cert" not found Jun 06 16:51:13.766344 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:13.766307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:13.766344 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.766328 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls podName:ec9b0760-5e94-4884-909b-ce8401782701 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:17.766319396 +0000 UTC m=+239.747794205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qq854" (UID: "ec9b0760-5e94-4884-909b-ce8401782701") : secret "samples-operator-tls" not found Jun 06 16:51:13.766600 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.766366 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 16:51:13.766600 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.766409 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:17.766396055 +0000 UTC m=+239.747870858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : secret "router-metrics-certs-default" not found Jun 06 16:51:13.866950 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:13.866916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:13.867077 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.867057 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:13.867135 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:13.867125 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls podName:1847750e-7617-4d3f-8137-138bcd90302a nodeName:}" failed. No retries permitted until 2026-06-06 16:51:17.867107613 +0000 UTC m=+239.848582419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcwqd" (UID: "1847750e-7617-4d3f-8137-138bcd90302a") : secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:14.012608 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.012547 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:14.112488 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.112464 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:14.224674 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.224656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/0.log" Jun 06 16:51:14.224797 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.224689 2577 generic.go:356] "Generic (PLEG): container finished" podID="722ff46c-6ce4-4617-88d3-36e20ff703c9" containerID="671f7809b8cef204901e2d085f4964a1ef402ae4faa2109648b5a9dccf642c64" exitCode=255 Jun 06 16:51:14.224797 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.224720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" event={"ID":"722ff46c-6ce4-4617-88d3-36e20ff703c9","Type":"ContainerDied","Data":"671f7809b8cef204901e2d085f4964a1ef402ae4faa2109648b5a9dccf642c64"} Jun 06 16:51:14.224972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.224958 2577 scope.go:117] "RemoveContainer" containerID="671f7809b8cef204901e2d085f4964a1ef402ae4faa2109648b5a9dccf642c64" Jun 06 16:51:14.226295 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.226270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" event={"ID":"50001a40-7b39-4edf-aa51-05de9b94fa87","Type":"ContainerStarted","Data":"e85f5fb400ce740fc99ace4b791ba43b22b69b98a351ca0c9c75ae7309cee30c"} Jun 06 16:51:14.227937 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.227914 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mv2bv" event={"ID":"6c108fee-d835-41a7-a67e-fc6d5f8de8aa","Type":"ContainerStarted","Data":"eb15cea9b478ec5ffa5bcf12b6f81e2219d921ba096de5579fd3c19c1ed6a015"} Jun 06 16:51:14.253543 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.253499 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-mv2bv" podStartSLOduration=1.17530799 podStartE2EDuration="4.253483234s" totalImagesPullingTime="3.078175244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:14.252532082 +0000 UTC m=+236.234006909" watchObservedRunningTime="2026-06-06 16:51:14.253483234 +0000 UTC m=+236.234958061" Jun 06 16:51:14.266043 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.265955 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" podStartSLOduration=1.264109129 podStartE2EDuration="4.265935056s" totalImagesPullingTime="3.001825927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:14.265295125 +0000 UTC m=+236.246769963" watchObservedRunningTime="2026-06-06 16:51:14.265935056 +0000 UTC m=+236.247409881" Jun 06 16:51:14.755063 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.755030 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:14.803826 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:14.803796 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:15.232425 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:15.232398 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/1.log" Jun 06 16:51:15.232791 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:15.232778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/0.log" Jun 06 16:51:15.232849 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:15.232808 2577 generic.go:356] "Generic (PLEG): container finished" podID="722ff46c-6ce4-4617-88d3-36e20ff703c9" containerID="1b7edfafd057329404dd557f158cd908617379a1ec720201a0fd73f9e8abc2c2" exitCode=255 Jun 06 16:51:15.232909 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:15.232885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" event={"ID":"722ff46c-6ce4-4617-88d3-36e20ff703c9","Type":"ContainerDied","Data":"1b7edfafd057329404dd557f158cd908617379a1ec720201a0fd73f9e8abc2c2"} Jun 06 16:51:15.232957 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:15.232935 2577 scope.go:117] "RemoveContainer" containerID="671f7809b8cef204901e2d085f4964a1ef402ae4faa2109648b5a9dccf642c64" Jun 06 16:51:15.233117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:15.233097 2577 scope.go:117] "RemoveContainer" containerID="1b7edfafd057329404dd557f158cd908617379a1ec720201a0fd73f9e8abc2c2" Jun 06 16:51:15.233316 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:15.233295 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-qpbdr_openshift-console-operator(722ff46c-6ce4-4617-88d3-36e20ff703c9)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" podUID="722ff46c-6ce4-4617-88d3-36e20ff703c9" Jun 06 16:51:15.618238 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:15.618149 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:15.717448 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:15.717415 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:16.237285 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.237258 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/1.log" Jun 06 16:51:16.237633 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.237568 2577 scope.go:117] "RemoveContainer" containerID="1b7edfafd057329404dd557f158cd908617379a1ec720201a0fd73f9e8abc2c2" Jun 06 16:51:16.237719 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:16.237699 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-qpbdr_openshift-console-operator(722ff46c-6ce4-4617-88d3-36e20ff703c9)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" podUID="722ff46c-6ce4-4617-88d3-36e20ff703c9" Jun 06 16:51:16.313180 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.313155 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8vcfd"] Jun 06 16:51:16.317202 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.317188 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.319383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.319361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 06 16:51:16.319491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.319412 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 06 16:51:16.319549 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.319501 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 06 16:51:16.319589 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.319571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sfs8v\"" Jun 06 16:51:16.319645 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.319608 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 06 16:51:16.323100 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.323082 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8vcfd"] Jun 06 16:51:16.346270 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.346246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:16.390278 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.390258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/692631bc-048c-4ea5-9caa-73de6c072582-signing-cabundle\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.390363 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.390282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56glv\" (UniqueName: \"kubernetes.io/projected/692631bc-048c-4ea5-9caa-73de6c072582-kube-api-access-56glv\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.390363 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.390315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/692631bc-048c-4ea5-9caa-73de6c072582-signing-key\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.392381 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.392362 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:16.491064 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.491009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/692631bc-048c-4ea5-9caa-73de6c072582-signing-cabundle\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.491064 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.491037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56glv\" (UniqueName: \"kubernetes.io/projected/692631bc-048c-4ea5-9caa-73de6c072582-kube-api-access-56glv\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.491257 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.491071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/692631bc-048c-4ea5-9caa-73de6c072582-signing-key\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.491637 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.491618 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/692631bc-048c-4ea5-9caa-73de6c072582-signing-cabundle\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.493294 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.493275 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/692631bc-048c-4ea5-9caa-73de6c072582-signing-key\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.498140 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.498117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56glv\" (UniqueName: \"kubernetes.io/projected/692631bc-048c-4ea5-9caa-73de6c072582-kube-api-access-56glv\") pod \"service-ca-7d74d578b8-8vcfd\" (UID: \"692631bc-048c-4ea5-9caa-73de6c072582\") " pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.626509 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.626483 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" Jun 06 16:51:16.647215 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.647173 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:16.673559 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.673546 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ms7c9_c6205570-13cf-4c02-b34b-f7513bb8cfed/dns-node-resolver/0.log" Jun 06 16:51:16.703418 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.703385 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:16.744144 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:16.744074 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8vcfd"] Jun 06 16:51:16.746738 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:16.746717 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692631bc_048c_4ea5_9caa_73de6c072582.slice/crio-1c71aeecb19f4cf1826359b9b1a5733faf5b186e666795e229a8148cfd0357cd WatchSource:0}: Error finding container 1c71aeecb19f4cf1826359b9b1a5733faf5b186e666795e229a8148cfd0357cd: Status 404 returned error can't find the container with id 1c71aeecb19f4cf1826359b9b1a5733faf5b186e666795e229a8148cfd0357cd Jun 06 16:51:17.174179 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:17.174109 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:17.241563 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:17.241529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" event={"ID":"692631bc-048c-4ea5-9caa-73de6c072582","Type":"ContainerStarted","Data":"1c71aeecb19f4cf1826359b9b1a5733faf5b186e666795e229a8148cfd0357cd"} Jun 06 16:51:17.802650 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:17.802616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:17.802838 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:17.802670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:17.802838 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:17.802709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:17.802838 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.802767 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:25.802750122 +0000 UTC m=+247.784224924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : configmap references non-existent config key: service-ca.crt Jun 06 16:51:17.802838 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:17.802791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:17.803047 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.802847 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 16:51:17.803047 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.802888 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 16:51:17.803047 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.802906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls podName:ec9b0760-5e94-4884-909b-ce8401782701 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:25.802890052 +0000 UTC m=+247.784364857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-qq854" (UID: "ec9b0760-5e94-4884-909b-ce8401782701") : secret "samples-operator-tls" not found Jun 06 16:51:17.803047 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.802926 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs podName:5e8c01c0-4fcd-4de9-af24-9b33f1ed9238 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:25.802915124 +0000 UTC m=+247.784389931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs") pod "router-default-554b47b59-bkb9r" (UID: "5e8c01c0-4fcd-4de9-af24-9b33f1ed9238") : secret "router-metrics-certs-default" not found Jun 06 16:51:17.803047 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.802960 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 16:51:17.803047 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.802997 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert podName:08e010e7-b1ee-4152-869b-2b9f665dff68 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:25.802988669 +0000 UTC m=+247.784463475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7z64z" (UID: "08e010e7-b1ee-4152-869b-2b9f665dff68") : secret "networking-console-plugin-cert" not found Jun 06 16:51:17.873601 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:17.873574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lt6md_0bcd27ac-3a7a-4331-9782-99e278104b92/node-ca/0.log" Jun 06 16:51:17.903985 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:17.903960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:17.904119 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.904096 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:17.904169 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:17.904150 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls podName:1847750e-7617-4d3f-8137-138bcd90302a nodeName:}" failed. No retries permitted until 2026-06-06 16:51:25.9041356 +0000 UTC m=+247.885610403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcwqd" (UID: "1847750e-7617-4d3f-8137-138bcd90302a") : secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:18.672986 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:18.672908 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdr9h_30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f/serve-healthcheck-canary/0.log" Jun 06 16:51:19.251398 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:19.251349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" event={"ID":"692631bc-048c-4ea5-9caa-73de6c072582","Type":"ContainerStarted","Data":"61982cb86884c32dcd312eed936d7c51f3300b740cd52a611914d1fd8e8e3729"} Jun 06 16:51:19.266817 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:19.266758 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-8vcfd" podStartSLOduration=1.597500468 podStartE2EDuration="3.266738664s" totalImagesPullingTime="1.669238196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:19.265827463 +0000 UTC m=+241.247302314" watchObservedRunningTime="2026-06-06 16:51:19.266738664 +0000 UTC m=+241.248213491" Jun 06 16:51:19.391731 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:19.391683 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:19.677520 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:19.677438 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:19.778448 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:19.778422 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:19.942048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:19.942014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:20.042450 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:20.042421 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:20.142178 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:20.142145 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:20.284573 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:20.284509 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:20.421515 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:20.421493 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:20.421639 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:20.421532 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:20.421820 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:20.421809 2577 scope.go:117] "RemoveContainer" containerID="1b7edfafd057329404dd557f158cd908617379a1ec720201a0fd73f9e8abc2c2" Jun 06 16:51:20.421987 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:20.421970 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-qpbdr_openshift-console-operator(722ff46c-6ce4-4617-88d3-36e20ff703c9)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" podUID="722ff46c-6ce4-4617-88d3-36e20ff703c9" Jun 06 16:51:21.085121 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:21.085092 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:21.485513 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:21.485485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:21.686065 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:21.686036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:21.888122 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:21.888041 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:22.090857 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:22.090832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:22.892992 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:22.892940 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:23.290191 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:23.290129 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:23.338667 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:23.338612 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:23.573173 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:23.573079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:23.687435 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:23.687407 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:23.889622 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:23.889565 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:24.486309 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:24.486279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:24.889800 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:24.889732 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:25.285006 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.284958 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:25.483407 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.483379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:25.794469 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.794437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:25.866919 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.866890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:25.867068 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.866951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:25.867068 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.866988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:25.867068 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.867019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:25.867256 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:25.867120 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 16:51:25.867256 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:25.867185 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert podName:08e010e7-b1ee-4152-869b-2b9f665dff68 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:41.867167173 +0000 UTC m=+263.848641975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7z64z" (UID: "08e010e7-b1ee-4152-869b-2b9f665dff68") : secret "networking-console-plugin-cert" not found Jun 06 16:51:25.867731 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.867706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-service-ca-bundle\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:25.869346 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.869324 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec9b0760-5e94-4884-909b-ce8401782701-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-qq854\" (UID: \"ec9b0760-5e94-4884-909b-ce8401782701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:25.869425 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.869361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e8c01c0-4fcd-4de9-af24-9b33f1ed9238-metrics-certs\") pod \"router-default-554b47b59-bkb9r\" (UID: \"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238\") " pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:25.894743 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.894699 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:25.967352 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:25.967329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:25.967441 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:25.967429 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:25.967493 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:25.967485 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls podName:1847750e-7617-4d3f-8137-138bcd90302a nodeName:}" failed. No retries permitted until 2026-06-06 16:51:41.967472753 +0000 UTC m=+263.948947555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcwqd" (UID: "1847750e-7617-4d3f-8137-138bcd90302a") : secret "cluster-monitoring-operator-tls" not found Jun 06 16:51:26.000729 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.000708 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sktml\"" Jun 06 16:51:26.009442 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.009425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" Jun 06 16:51:26.019279 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.019259 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-628l2\"" Jun 06 16:51:26.027114 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.027082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:26.136582 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.136557 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854"] Jun 06 16:51:26.156674 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.156652 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-554b47b59-bkb9r"] Jun 06 16:51:26.159180 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:26.159159 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8c01c0_4fcd_4de9_af24_9b33f1ed9238.slice/crio-a05645888cadc01c33611cd55f3b1dbfff056721a44afecaf82e5b7176fdea3d WatchSource:0}: Error finding container a05645888cadc01c33611cd55f3b1dbfff056721a44afecaf82e5b7176fdea3d: Status 404 returned error can't find the container with id a05645888cadc01c33611cd55f3b1dbfff056721a44afecaf82e5b7176fdea3d Jun 06 16:51:26.274450 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.274417 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" event={"ID":"ec9b0760-5e94-4884-909b-ce8401782701","Type":"ContainerStarted","Data":"44b4b902dc1b49a4d89d569ec226a43aeca626e138dcfb353beaf4d25ea6067d"} Jun 06 16:51:26.275693 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.275662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-554b47b59-bkb9r" event={"ID":"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238","Type":"ContainerStarted","Data":"b4ce4557aeec5baeb8ed404404177536f05e7c4708b8c78cf31ab0c491c65bc0"} Jun 06 16:51:26.275819 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.275707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-554b47b59-bkb9r" event={"ID":"5e8c01c0-4fcd-4de9-af24-9b33f1ed9238","Type":"ContainerStarted","Data":"a05645888cadc01c33611cd55f3b1dbfff056721a44afecaf82e5b7176fdea3d"} Jun 06 16:51:26.292383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.292344 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-554b47b59-bkb9r" podStartSLOduration=16.29233094 podStartE2EDuration="16.29233094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:26.291477568 +0000 UTC m=+248.272952433" watchObservedRunningTime="2026-06-06 16:51:26.29233094 +0000 UTC m=+248.273805743" Jun 06 16:51:26.685332 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:26.685281 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:27.027516 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.027441 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:27.030292 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.030268 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:27.085414 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.085383 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:27.137754 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.137730 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:27.279442 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.279368 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:27.280787 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.280758 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-554b47b59-bkb9r" Jun 06 16:51:27.284334 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.284309 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:27.491967 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.491933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:27.884048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:27.884017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:28.282792 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:28.282768 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:28.283616 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:28.283589 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" event={"ID":"ec9b0760-5e94-4884-909b-ce8401782701","Type":"ContainerStarted","Data":"ef3dd2e66383e53f529c3f88f7822afa78f3344de4327c625433fc4534df4802"} Jun 06 16:51:28.283731 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:28.283639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" event={"ID":"ec9b0760-5e94-4884-909b-ce8401782701","Type":"ContainerStarted","Data":"335801ed3f76c531bace668a0e049795d5f47ee548bfac88094d4d9806d7909e"} Jun 06 16:51:28.297732 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:28.297619 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-qq854" podStartSLOduration=16.363627151 podStartE2EDuration="18.29760175s" totalImagesPullingTime="1.933974599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:28.297375811 +0000 UTC m=+250.278850669" watchObservedRunningTime="2026-06-06 16:51:28.29760175 +0000 UTC m=+250.279076576" Jun 06 16:51:28.884629 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:28.884598 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:29.487865 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:29.487828 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:29.690470 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:29.690439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:29.887419 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:29.887339 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:30.085669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:30.085637 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:30.401852 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:30.401813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:51:30.404092 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:30.404072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5491b72a-033f-4bb1-b3cd-18a1b8e63176-metrics-certs\") pod \"network-metrics-daemon-nl9nt\" (UID: \"5491b72a-033f-4bb1-b3cd-18a1b8e63176\") " pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:51:30.706417 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:30.706389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tbbrh\"" Jun 06 16:51:30.713842 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:30.713825 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nl9nt" Jun 06 16:51:30.835323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:30.835264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nl9nt"] Jun 06 16:51:30.840111 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:30.839244 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5491b72a_033f_4bb1_b3cd_18a1b8e63176.slice/crio-363981b1421c7a10e9219d6ccf87367126ccf7af78373286da7e71070572ced5 WatchSource:0}: Error finding container 363981b1421c7a10e9219d6ccf87367126ccf7af78373286da7e71070572ced5: Status 404 returned error can't find the container with id 363981b1421c7a10e9219d6ccf87367126ccf7af78373286da7e71070572ced5 Jun 06 16:51:31.294209 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:31.294173 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nl9nt" event={"ID":"5491b72a-033f-4bb1-b3cd-18a1b8e63176","Type":"ContainerStarted","Data":"363981b1421c7a10e9219d6ccf87367126ccf7af78373286da7e71070572ced5"} Jun 06 16:51:32.299933 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:32.299892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nl9nt" event={"ID":"5491b72a-033f-4bb1-b3cd-18a1b8e63176","Type":"ContainerStarted","Data":"027dd4449f4d98ce00bb348bc860873d9d0aaa3f0db1fa84dc23f25427fd4774"} Jun 06 16:51:32.502578 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:32.502549 2577 scope.go:117] "RemoveContainer" containerID="1b7edfafd057329404dd557f158cd908617379a1ec720201a0fd73f9e8abc2c2" Jun 06 16:51:33.304490 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:33.304453 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nl9nt" event={"ID":"5491b72a-033f-4bb1-b3cd-18a1b8e63176","Type":"ContainerStarted","Data":"198153218c1244fc0b8f70127567e852cedecd1f83f90768e5d0a67edb92c6c1"} Jun 06 16:51:33.305895 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:33.305875 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 16:51:33.306211 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:33.306194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/1.log" Jun 06 16:51:33.306311 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:33.306249 2577 generic.go:356] "Generic (PLEG): container finished" podID="722ff46c-6ce4-4617-88d3-36e20ff703c9" containerID="77e506d4b78476bda38d55bb9b8ac4e6c33b3891af7edcddbee99d79930c8d0f" exitCode=255 Jun 06 16:51:33.306353 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:33.306313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" event={"ID":"722ff46c-6ce4-4617-88d3-36e20ff703c9","Type":"ContainerDied","Data":"77e506d4b78476bda38d55bb9b8ac4e6c33b3891af7edcddbee99d79930c8d0f"} Jun 06 16:51:33.306386 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:33.306358 2577 scope.go:117] "RemoveContainer" containerID="1b7edfafd057329404dd557f158cd908617379a1ec720201a0fd73f9e8abc2c2" Jun 06 16:51:33.306666 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:33.306649 2577 scope.go:117] "RemoveContainer" containerID="77e506d4b78476bda38d55bb9b8ac4e6c33b3891af7edcddbee99d79930c8d0f" Jun 06 16:51:33.306797 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:33.306780 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-qpbdr_openshift-console-operator(722ff46c-6ce4-4617-88d3-36e20ff703c9)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" podUID="722ff46c-6ce4-4617-88d3-36e20ff703c9" Jun 06 16:51:33.318690 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:33.318654 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nl9nt" podStartSLOduration=254.05232389 podStartE2EDuration="4m15.318637533s" totalImagesPullingTime="1.266313643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:33.31845232 +0000 UTC m=+255.299927147" watchObservedRunningTime="2026-06-06 16:51:33.318637533 +0000 UTC m=+255.300112363" Jun 06 16:51:34.312502 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:34.312441 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 16:51:37.493765 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.493736 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-56fw7"] Jun 06 16:51:37.496834 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.496808 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.500567 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.500547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 16:51:37.500692 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.500567 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dk5mp\"" Jun 06 16:51:37.500692 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.500601 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 16:51:37.512827 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.512800 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-56fw7"] Jun 06 16:51:37.545545 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.545522 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:37.636278 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.636252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:37.655181 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.655158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f747c769-576b-4619-93c2-ba71aac4b1d4-data-volume\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.655290 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.655220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpfk7\" (UniqueName: \"kubernetes.io/projected/f747c769-576b-4619-93c2-ba71aac4b1d4-kube-api-access-xpfk7\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.655290 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.655269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f747c769-576b-4619-93c2-ba71aac4b1d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.655383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.655307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f747c769-576b-4619-93c2-ba71aac4b1d4-crio-socket\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.655383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.655332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f747c769-576b-4619-93c2-ba71aac4b1d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.736557 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.736504 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:37.756595 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.756572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f747c769-576b-4619-93c2-ba71aac4b1d4-crio-socket\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.756668 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.756604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f747c769-576b-4619-93c2-ba71aac4b1d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.756668 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.756625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f747c769-576b-4619-93c2-ba71aac4b1d4-data-volume\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.756735 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.756683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpfk7\" (UniqueName: \"kubernetes.io/projected/f747c769-576b-4619-93c2-ba71aac4b1d4-kube-api-access-xpfk7\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.756735 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.756689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f747c769-576b-4619-93c2-ba71aac4b1d4-crio-socket\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.756735 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.756703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f747c769-576b-4619-93c2-ba71aac4b1d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.757033 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.757017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f747c769-576b-4619-93c2-ba71aac4b1d4-data-volume\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.757177 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.757160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f747c769-576b-4619-93c2-ba71aac4b1d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.758899 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.758880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f747c769-576b-4619-93c2-ba71aac4b1d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.763720 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.763701 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpfk7\" (UniqueName: \"kubernetes.io/projected/f747c769-576b-4619-93c2-ba71aac4b1d4-kube-api-access-xpfk7\") pod \"insights-runtime-extractor-56fw7\" (UID: \"f747c769-576b-4619-93c2-ba71aac4b1d4\") " pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.806307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.806284 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-56fw7" Jun 06 16:51:37.960640 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:37.960613 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-56fw7"] Jun 06 16:51:37.964990 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:37.964969 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf747c769_576b_4619_93c2_ba71aac4b1d4.slice/crio-815d95547c253d332194380950e749dd2c7b9db0a0149d707daa6eed0866a263 WatchSource:0}: Error finding container 815d95547c253d332194380950e749dd2c7b9db0a0149d707daa6eed0866a263: Status 404 returned error can't find the container with id 815d95547c253d332194380950e749dd2c7b9db0a0149d707daa6eed0866a263 Jun 06 16:51:38.326101 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:38.326005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-56fw7" event={"ID":"f747c769-576b-4619-93c2-ba71aac4b1d4","Type":"ContainerStarted","Data":"528632e813945defe675513aa4bf28a56ba063ee1933966c7f38eb5f088b63d8"} Jun 06 16:51:38.326101 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:38.326062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-56fw7" event={"ID":"f747c769-576b-4619-93c2-ba71aac4b1d4","Type":"ContainerStarted","Data":"815d95547c253d332194380950e749dd2c7b9db0a0149d707daa6eed0866a263"} Jun 06 16:51:38.463701 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:38.463670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:38.563284 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:38.563254 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:39.331051 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:39.331015 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-56fw7" event={"ID":"f747c769-576b-4619-93c2-ba71aac4b1d4","Type":"ContainerStarted","Data":"b779a165be967ae3e5f0cbdc368530759e8053e8987d468a4d4b0b1dad97a623"} Jun 06 16:51:40.340006 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:40.339976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-56fw7" event={"ID":"f747c769-576b-4619-93c2-ba71aac4b1d4","Type":"ContainerStarted","Data":"4e3ff47b84fefc4077f9cc4f5b28e5b38ba29763d175eccdaacf5efe0220feff"} Jun 06 16:51:40.356223 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:40.356181 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-56fw7" podStartSLOduration=1.260934719 podStartE2EDuration="3.356169153s" totalImagesPullingTime="2.095234434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:51:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:40.354600727 +0000 UTC m=+262.336075551" watchObservedRunningTime="2026-06-06 16:51:40.356169153 +0000 UTC m=+262.337643978" Jun 06 16:51:40.421126 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:40.421054 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:40.421126 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:40.421110 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:40.421391 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:40.421379 2577 scope.go:117] "RemoveContainer" containerID="77e506d4b78476bda38d55bb9b8ac4e6c33b3891af7edcddbee99d79930c8d0f" Jun 06 16:51:40.421526 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:40.421508 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-qpbdr_openshift-console-operator(722ff46c-6ce4-4617-88d3-36e20ff703c9)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" podUID="722ff46c-6ce4-4617-88d3-36e20ff703c9" Jun 06 16:51:41.888600 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:41.888558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:41.890792 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:41.890762 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08e010e7-b1ee-4152-869b-2b9f665dff68-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7z64z\" (UID: \"08e010e7-b1ee-4152-869b-2b9f665dff68\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:41.911239 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:41.911215 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j9kfb\"" Jun 06 16:51:41.919621 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:41.919605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" Jun 06 16:51:41.989838 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:41.989811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:41.992263 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:41.992195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1847750e-7617-4d3f-8137-138bcd90302a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcwqd\" (UID: \"1847750e-7617-4d3f-8137-138bcd90302a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:42.007910 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:42.007886 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9trx9\"" Jun 06 16:51:42.015670 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:42.015641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" Jun 06 16:51:42.038179 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:42.038153 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z"] Jun 06 16:51:42.040623 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:42.040599 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e010e7_b1ee_4152_869b_2b9f665dff68.slice/crio-f4e16216de6b98428b05bfd2a4100a99919a0903e469d6f27900e91e0ee8e039 WatchSource:0}: Error finding container f4e16216de6b98428b05bfd2a4100a99919a0903e469d6f27900e91e0ee8e039: Status 404 returned error can't find the container with id f4e16216de6b98428b05bfd2a4100a99919a0903e469d6f27900e91e0ee8e039 Jun 06 16:51:42.135212 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:42.135184 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd"] Jun 06 16:51:42.137935 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:42.137904 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1847750e_7617_4d3f_8137_138bcd90302a.slice/crio-cdacb9ce936fbf336a89d760a0e22506d78bf7040951f37c9388d72cf37eeab9 WatchSource:0}: Error finding container cdacb9ce936fbf336a89d760a0e22506d78bf7040951f37c9388d72cf37eeab9: Status 404 returned error can't find the container with id cdacb9ce936fbf336a89d760a0e22506d78bf7040951f37c9388d72cf37eeab9 Jun 06 16:51:42.347815 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:42.347779 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" event={"ID":"1847750e-7617-4d3f-8137-138bcd90302a","Type":"ContainerStarted","Data":"cdacb9ce936fbf336a89d760a0e22506d78bf7040951f37c9388d72cf37eeab9"} Jun 06 16:51:42.348886 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:42.348865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" event={"ID":"08e010e7-b1ee-4152-869b-2b9f665dff68","Type":"ContainerStarted","Data":"f4e16216de6b98428b05bfd2a4100a99919a0903e469d6f27900e91e0ee8e039"} Jun 06 16:51:44.331800 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.331715 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:44.358987 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.358950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" event={"ID":"1847750e-7617-4d3f-8137-138bcd90302a","Type":"ContainerStarted","Data":"83aa70c71491e43e43626ec1a4201b9fbea83d5f49a5c88e12457ca5031bc53f"} Jun 06 16:51:44.360447 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.360419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" event={"ID":"08e010e7-b1ee-4152-869b-2b9f665dff68","Type":"ContainerStarted","Data":"35d249c7bfa687c745d118e27f180b0ba663213d4472c4edbe81148e588836a4"} Jun 06 16:51:44.373837 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.373793 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcwqd" podStartSLOduration=32.479630988 podStartE2EDuration="34.373762924s" totalImagesPullingTime="1.894131936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:44.373504177 +0000 UTC m=+266.354979003" watchObservedRunningTime="2026-06-06 16:51:44.373762924 +0000 UTC m=+266.355237749" Jun 06 16:51:44.386818 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.386772 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7z64z" podStartSLOduration=32.952881045 podStartE2EDuration="34.386758531s" totalImagesPullingTime="1.433877486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:44.386076956 +0000 UTC m=+266.367551809" watchObservedRunningTime="2026-06-06 16:51:44.386758531 +0000 UTC m=+266.368233355" Jun 06 16:51:44.391146 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.391126 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:44.484177 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.484124 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:44.484416 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.484395 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9"] Jun 06 16:51:44.487715 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.487699 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" Jun 06 16:51:44.490786 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.490765 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 06 16:51:44.490911 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.490832 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5gr2t\"" Jun 06 16:51:44.496651 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.496631 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9"] Jun 06 16:51:44.549174 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.549153 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:44.613346 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.613289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cf174a4-71f7-4b87-9f14-677feae31e0b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-8pvs9\" (UID: \"9cf174a4-71f7-4b87-9f14-677feae31e0b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" Jun 06 16:51:44.663953 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.660339 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:44.714461 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.714436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cf174a4-71f7-4b87-9f14-677feae31e0b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-8pvs9\" (UID: \"9cf174a4-71f7-4b87-9f14-677feae31e0b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" Jun 06 16:51:44.716765 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.716747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cf174a4-71f7-4b87-9f14-677feae31e0b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-8pvs9\" (UID: \"9cf174a4-71f7-4b87-9f14-677feae31e0b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" Jun 06 16:51:44.797931 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.797899 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" Jun 06 16:51:44.915348 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:44.915325 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9"] Jun 06 16:51:44.917520 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:44.917495 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf174a4_71f7_4b87_9f14_677feae31e0b.slice/crio-66117f333f789bf3f52568c284be5097fe80d78a03fe489b4d3b9fc7fcea2c99 WatchSource:0}: Error finding container 66117f333f789bf3f52568c284be5097fe80d78a03fe489b4d3b9fc7fcea2c99: Status 404 returned error can't find the container with id 66117f333f789bf3f52568c284be5097fe80d78a03fe489b4d3b9fc7fcea2c99 Jun 06 16:51:45.366141 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:45.366101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" event={"ID":"9cf174a4-71f7-4b87-9f14-677feae31e0b","Type":"ContainerStarted","Data":"66117f333f789bf3f52568c284be5097fe80d78a03fe489b4d3b9fc7fcea2c99"} Jun 06 16:51:46.370528 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:46.370495 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" event={"ID":"9cf174a4-71f7-4b87-9f14-677feae31e0b","Type":"ContainerStarted","Data":"f6cd216df56f744bf7f3cbbf9984c164de84cce2827b1f8f266179c971d5887e"} Jun 06 16:51:46.370910 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:46.370691 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" Jun 06 16:51:46.375531 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:46.375507 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" Jun 06 16:51:46.385205 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:46.385164 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8pvs9" podStartSLOduration=1.460633627 podStartE2EDuration="2.385151296s" totalImagesPullingTime="924.517669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:46.384054864 +0000 UTC m=+268.365529702" watchObservedRunningTime="2026-06-06 16:51:46.385151296 +0000 UTC m=+268.366626121" Jun 06 16:51:46.502107 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:46.502070 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:46.602538 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:46.602506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:46.738384 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:46.738356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:48.402395 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:48.402362 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:50.616115 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.616084 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:50.835076 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.835043 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:50.853790 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.853761 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd"] Jun 06 16:51:50.857735 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.857717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:50.859871 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.859851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 16:51:50.860014 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.859972 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 06 16:51:50.860162 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.860144 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 06 16:51:50.861036 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.860998 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5xpwc\"" Jun 06 16:51:50.863026 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.863007 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zrvdk"] Jun 06 16:51:50.867520 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.867470 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd"] Jun 06 16:51:50.867683 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.867659 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.869988 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.869970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 16:51:50.870188 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.870165 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 16:51:50.870375 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.870356 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2snng\"" Jun 06 16:51:50.870520 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.870458 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 16:51:50.925847 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.925824 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:50.962511 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bng7s\" (UniqueName: \"kubernetes.io/projected/12531c35-9636-45ec-9e64-afca91581456-kube-api-access-bng7s\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.962648 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12531c35-9636-45ec-9e64-afca91581456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.962648 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12531c35-9636-45ec-9e64-afca91581456-node-exporter-textfile\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.962648 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:50.962648 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee884edc-77d8-4d47-ab25-abd41fefd681-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:50.962648 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12531c35-9636-45ec-9e64-afca91581456-metrics-client-ca\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.962903 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pz2l\" (UniqueName: \"kubernetes.io/projected/ee884edc-77d8-4d47-ab25-abd41fefd681-kube-api-access-9pz2l\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:50.962903 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12531c35-9636-45ec-9e64-afca91581456-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.962903 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12531c35-9636-45ec-9e64-afca91581456-node-exporter-tls\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.962903 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-sys\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.962903 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-root\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.962903 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:50.962903 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.962835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-node-exporter-wtmp\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:50.988008 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:50.987982 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:51.063597 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.063557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12531c35-9636-45ec-9e64-afca91581456-node-exporter-textfile\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.063770 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.063612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.063770 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.063649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee884edc-77d8-4d47-ab25-abd41fefd681-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.063770 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.063685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12531c35-9636-45ec-9e64-afca91581456-metrics-client-ca\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.063929 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:51.063804 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 06 16:51:51.063929 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:51:51.063880 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-tls podName:ee884edc-77d8-4d47-ab25-abd41fefd681 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:51.563856551 +0000 UTC m=+273.545331366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-n6ttd" (UID: "ee884edc-77d8-4d47-ab25-abd41fefd681") : secret "openshift-state-metrics-tls" not found Jun 06 16:51:51.063929 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.063864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pz2l\" (UniqueName: \"kubernetes.io/projected/ee884edc-77d8-4d47-ab25-abd41fefd681-kube-api-access-9pz2l\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.063929 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.063919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12531c35-9636-45ec-9e64-afca91581456-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064122 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.063955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12531c35-9636-45ec-9e64-afca91581456-node-exporter-textfile\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064122 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.063967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12531c35-9636-45ec-9e64-afca91581456-node-exporter-tls\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064122 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-sys\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064122 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-root\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064122 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.064122 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-node-exporter-wtmp\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064427 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bng7s\" (UniqueName: \"kubernetes.io/projected/12531c35-9636-45ec-9e64-afca91581456-kube-api-access-bng7s\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064427 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12531c35-9636-45ec-9e64-afca91581456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064427 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12531c35-9636-45ec-9e64-afca91581456-metrics-client-ca\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064427 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-root\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064620 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-sys\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064620 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12531c35-9636-45ec-9e64-afca91581456-node-exporter-wtmp\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.064804 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.064771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee884edc-77d8-4d47-ab25-abd41fefd681-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.065374 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.065351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12531c35-9636-45ec-9e64-afca91581456-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.066593 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.066569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12531c35-9636-45ec-9e64-afca91581456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.066671 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.066623 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.067101 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.067087 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12531c35-9636-45ec-9e64-afca91581456-node-exporter-tls\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.074367 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.074349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pz2l\" (UniqueName: \"kubernetes.io/projected/ee884edc-77d8-4d47-ab25-abd41fefd681-kube-api-access-9pz2l\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.074457 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.074405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bng7s\" (UniqueName: \"kubernetes.io/projected/12531c35-9636-45ec-9e64-afca91581456-kube-api-access-bng7s\") pod \"node-exporter-zrvdk\" (UID: \"12531c35-9636-45ec-9e64-afca91581456\") " pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.086849 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.086809 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:51.178523 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.178443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zrvdk" Jun 06 16:51:51.197658 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:51.197629 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12531c35_9636_45ec_9e64_afca91581456.slice/crio-9865fcccbaee9a5293edb92ae82df768ed8fbce214166bec150d3328bad569a6 WatchSource:0}: Error finding container 9865fcccbaee9a5293edb92ae82df768ed8fbce214166bec150d3328bad569a6: Status 404 returned error can't find the container with id 9865fcccbaee9a5293edb92ae82df768ed8fbce214166bec150d3328bad569a6 Jun 06 16:51:51.220495 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.220473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:51.386757 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.386728 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:51.389266 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.389242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvdk" event={"ID":"12531c35-9636-45ec-9e64-afca91581456","Type":"ContainerStarted","Data":"9865fcccbaee9a5293edb92ae82df768ed8fbce214166bec150d3328bad569a6"} Jun 06 16:51:51.441032 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.441008 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:51.568508 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.568482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.570675 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.570653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee884edc-77d8-4d47-ab25-abd41fefd681-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n6ttd\" (UID: \"ee884edc-77d8-4d47-ab25-abd41fefd681\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.769109 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.769031 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" Jun 06 16:51:51.783831 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.783794 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:51.885052 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.884563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:51.916597 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.916562 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd"] Jun 06 16:51:51.921029 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.921009 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:51:51.925539 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.925518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:51.927858 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.927840 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 16:51:51.928112 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928051 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 16:51:51.928214 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 16:51:51.928214 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928190 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rs9bz\"" Jun 06 16:51:51.928347 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928286 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 16:51:51.928404 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928363 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 16:51:51.928596 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 16:51:51.928596 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928498 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 16:51:51.928596 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928533 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 16:51:51.928596 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.928564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 16:51:51.940950 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.940925 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:51:51.949307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:51.949283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:52.075394 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2xxx\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-kube-api-access-p2xxx\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075394 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075394 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075655 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075655 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075655 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075655 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075655 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-config-out\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075892 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075892 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075892 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075892 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-config-volume\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.075892 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.075814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-web-config\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.134285 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:52.134255 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee884edc_77d8_4d47_ab25_abd41fefd681.slice/crio-dc78f8344284aafcf3069c57ec8fe3ea2bf61d50bddd4cde08c0db8707ef401e WatchSource:0}: Error finding container dc78f8344284aafcf3069c57ec8fe3ea2bf61d50bddd4cde08c0db8707ef401e: Status 404 returned error can't find the container with id dc78f8344284aafcf3069c57ec8fe3ea2bf61d50bddd4cde08c0db8707ef401e Jun 06 16:51:52.177119 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177206 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177206 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177206 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177386 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177386 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-config-out\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177386 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177386 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-config-volume\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-web-config\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2xxx\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-kube-api-access-p2xxx\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.177911 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.177885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.178279 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.178255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.181151 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.181062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.181532 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.181493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-config-out\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.181618 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.181527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-config-volume\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.181674 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.181640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.181770 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.181745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.182487 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.182452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.182487 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.182481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.182613 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.182520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-web-config\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.184429 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.184403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.185595 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.185569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2xxx\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-kube-api-access-p2xxx\") pod \"alertmanager-main-0\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.198521 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.198485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:52.237818 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.237801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:51:52.392993 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.392961 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:51:52.398950 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:52.398926 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc659e2f9_72ed_476e_8d3e_3193b9053222.slice/crio-6355b6ec5a2f120c454de6d9add0ac49fc69b6b17ad148f2f104b8bcc020ada7 WatchSource:0}: Error finding container 6355b6ec5a2f120c454de6d9add0ac49fc69b6b17ad148f2f104b8bcc020ada7: Status 404 returned error can't find the container with id 6355b6ec5a2f120c454de6d9add0ac49fc69b6b17ad148f2f104b8bcc020ada7 Jun 06 16:51:52.400396 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.400371 2577 generic.go:356] "Generic (PLEG): container finished" podID="12531c35-9636-45ec-9e64-afca91581456" containerID="6d06aa19511b877e0e9dd7ba1335fc2a632fe5d9ef29d1d4a0216f849cf2cd69" exitCode=0 Jun 06 16:51:52.400503 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.400462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvdk" event={"ID":"12531c35-9636-45ec-9e64-afca91581456","Type":"ContainerDied","Data":"6d06aa19511b877e0e9dd7ba1335fc2a632fe5d9ef29d1d4a0216f849cf2cd69"} Jun 06 16:51:52.402781 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.402760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" event={"ID":"ee884edc-77d8-4d47-ab25-abd41fefd681","Type":"ContainerStarted","Data":"726e5495e39faa4a691e1e27a2e78dff6a188bee0a5e31628e3565b3fce361d9"} Jun 06 16:51:52.402876 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.402810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" event={"ID":"ee884edc-77d8-4d47-ab25-abd41fefd681","Type":"ContainerStarted","Data":"ecf915cdcc1de5b6b6aad29e492299fbd6629a0424c23cf4c8c9a69830175135"} Jun 06 16:51:52.402876 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:52.402841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" event={"ID":"ee884edc-77d8-4d47-ab25-abd41fefd681","Type":"ContainerStarted","Data":"dc78f8344284aafcf3069c57ec8fe3ea2bf61d50bddd4cde08c0db8707ef401e"} Jun 06 16:51:53.409431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:53.409387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerStarted","Data":"6355b6ec5a2f120c454de6d9add0ac49fc69b6b17ad148f2f104b8bcc020ada7"} Jun 06 16:51:53.412381 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:53.412342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvdk" event={"ID":"12531c35-9636-45ec-9e64-afca91581456","Type":"ContainerStarted","Data":"250894587ad0df3d59616873df9bb73887c9f6132c5a45ee2ce565afe888c1a2"} Jun 06 16:51:53.412512 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:53.412397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvdk" event={"ID":"12531c35-9636-45ec-9e64-afca91581456","Type":"ContainerStarted","Data":"058ce0a3d0196f6e5f7c34fe60f37e7ea6ac018a36a7f3f0dc6e03a64f05e50f"} Jun 06 16:51:53.430632 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:53.430564 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zrvdk" podStartSLOduration=2.361643671 podStartE2EDuration="3.430545293s" totalImagesPullingTime="989.283346ms" totalInitContainerRuntime="79.618276ms" isStatefulPod=true podCreationTimestamp="2026-06-06 16:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:53.42917566 +0000 UTC m=+275.410650518" watchObservedRunningTime="2026-06-06 16:51:53.430545293 +0000 UTC m=+275.412020121" Jun 06 16:51:53.502308 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:53.502287 2577 scope.go:117] "RemoveContainer" containerID="77e506d4b78476bda38d55bb9b8ac4e6c33b3891af7edcddbee99d79930c8d0f" Jun 06 16:51:53.804000 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:53.803968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:53.876318 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:53.876289 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:54.131657 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.131621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:54.261019 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.260982 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-lj4vm"] Jun 06 16:51:54.264211 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.264185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-lj4vm" Jun 06 16:51:54.266706 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.266681 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 16:51:54.266854 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.266778 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g4gkq\"" Jun 06 16:51:54.266924 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.266852 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 16:51:54.274952 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.274930 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-lj4vm"] Jun 06 16:51:54.275182 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.275166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:54.295861 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.295839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfcbr\" (UniqueName: \"kubernetes.io/projected/ff45048b-5170-4318-8136-b34efbc1a0d6-kube-api-access-mfcbr\") pod \"downloads-6657875f97-lj4vm\" (UID: \"ff45048b-5170-4318-8136-b34efbc1a0d6\") " pod="openshift-console/downloads-6657875f97-lj4vm" Jun 06 16:51:54.368307 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.368284 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:54.396598 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.396552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfcbr\" (UniqueName: \"kubernetes.io/projected/ff45048b-5170-4318-8136-b34efbc1a0d6-kube-api-access-mfcbr\") pod \"downloads-6657875f97-lj4vm\" (UID: \"ff45048b-5170-4318-8136-b34efbc1a0d6\") " pod="openshift-console/downloads-6657875f97-lj4vm" Jun 06 16:51:54.403947 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.403923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfcbr\" (UniqueName: \"kubernetes.io/projected/ff45048b-5170-4318-8136-b34efbc1a0d6-kube-api-access-mfcbr\") pod \"downloads-6657875f97-lj4vm\" (UID: \"ff45048b-5170-4318-8136-b34efbc1a0d6\") " pod="openshift-console/downloads-6657875f97-lj4vm" Jun 06 16:51:54.416134 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.416110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:54.417108 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.417087 2577 generic.go:356] "Generic (PLEG): container finished" podID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerID="9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf" exitCode=0 Jun 06 16:51:54.417186 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.417169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerDied","Data":"9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf"} Jun 06 16:51:54.419015 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.419002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 16:51:54.419098 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.419084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" event={"ID":"722ff46c-6ce4-4617-88d3-36e20ff703c9","Type":"ContainerStarted","Data":"0ceb51bfebf2b3e8bebe2045e9f500f2c7809b30f10a2f9481873dfc10ca8539"} Jun 06 16:51:54.419375 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.419353 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:54.421859 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.421839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" event={"ID":"ee884edc-77d8-4d47-ab25-abd41fefd681","Type":"ContainerStarted","Data":"755435fe047944a4d3db8e407564dabf6ffb5b5d463eb48336f84f7aab2f93ea"} Jun 06 16:51:54.424288 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.424272 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" Jun 06 16:51:54.458105 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.458070 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ttd" podStartSLOduration=3.201622927 podStartE2EDuration="4.458059086s" totalImagesPullingTime="1.256436159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:54.456861137 +0000 UTC m=+276.438335964" watchObservedRunningTime="2026-06-06 16:51:54.458059086 +0000 UTC m=+276.439533911" Jun 06 16:51:54.474377 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.474341 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-qpbdr" podStartSLOduration=41.29448059 podStartE2EDuration="44.474329744s" totalImagesPullingTime="3.179849154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:54.473084652 +0000 UTC m=+276.454559478" watchObservedRunningTime="2026-06-06 16:51:54.474329744 +0000 UTC m=+276.455804569" Jun 06 16:51:54.574007 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.573980 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-lj4vm" Jun 06 16:51:54.575424 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.575396 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:54.694145 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.694113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-lj4vm"] Jun 06 16:51:54.697051 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:54.697027 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff45048b_5170_4318_8136_b34efbc1a0d6.slice/crio-a190a2ea05a8a473e994fae2346bcec05e8d37b6897ce16cd1f89fd9afbdc4ac WatchSource:0}: Error finding container a190a2ea05a8a473e994fae2346bcec05e8d37b6897ce16cd1f89fd9afbdc4ac: Status 404 returned error can't find the container with id a190a2ea05a8a473e994fae2346bcec05e8d37b6897ce16cd1f89fd9afbdc4ac Jun 06 16:51:54.943093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:54.943056 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:55.265440 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.265371 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b6b878594-8ttqb"] Jun 06 16:51:55.268698 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.268675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.271172 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.271148 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 06 16:51:55.271973 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.271951 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5hc4r\"" Jun 06 16:51:55.272093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.271975 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 16:51:55.272093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.271995 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f4dfdgbgel1e5\"" Jun 06 16:51:55.272093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.272014 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 06 16:51:55.272093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.271957 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 06 16:51:55.277364 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.277341 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b6b878594-8ttqb"] Jun 06 16:51:55.307861 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.307827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lvqg\" (UniqueName: \"kubernetes.io/projected/1af73209-411a-4803-ac36-ce839b30fa05-kube-api-access-9lvqg\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.308046 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.307893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-secret-metrics-server-tls\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.308046 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.307955 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1af73209-411a-4803-ac36-ce839b30fa05-audit-log\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.308046 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.307984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-secret-metrics-server-client-certs\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.308046 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.308025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af73209-411a-4803-ac36-ce839b30fa05-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.308294 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.308054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1af73209-411a-4803-ac36-ce839b30fa05-metrics-server-audit-profiles\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.308294 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.308159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-client-ca-bundle\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.373215 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.373178 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:55.409148 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.409113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lvqg\" (UniqueName: \"kubernetes.io/projected/1af73209-411a-4803-ac36-ce839b30fa05-kube-api-access-9lvqg\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.409344 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.409169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-secret-metrics-server-tls\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.409344 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.409214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1af73209-411a-4803-ac36-ce839b30fa05-audit-log\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.409344 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.409290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-secret-metrics-server-client-certs\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.409344 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.409318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af73209-411a-4803-ac36-ce839b30fa05-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.409549 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.409355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1af73209-411a-4803-ac36-ce839b30fa05-metrics-server-audit-profiles\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.409549 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.409400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-client-ca-bundle\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.410029 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.409974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1af73209-411a-4803-ac36-ce839b30fa05-audit-log\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.410218 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.410174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af73209-411a-4803-ac36-ce839b30fa05-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.410585 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.410558 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1af73209-411a-4803-ac36-ce839b30fa05-metrics-server-audit-profiles\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.412505 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.412446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-client-ca-bundle\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.412505 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.412467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-secret-metrics-server-tls\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.412889 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.412868 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1af73209-411a-4803-ac36-ce839b30fa05-secret-metrics-server-client-certs\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.417168 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.416753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lvqg\" (UniqueName: \"kubernetes.io/projected/1af73209-411a-4803-ac36-ce839b30fa05-kube-api-access-9lvqg\") pod \"metrics-server-b6b878594-8ttqb\" (UID: \"1af73209-411a-4803-ac36-ce839b30fa05\") " pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.420023 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.419995 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:55.427896 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.427872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-lj4vm" event={"ID":"ff45048b-5170-4318-8136-b34efbc1a0d6","Type":"ContainerStarted","Data":"a190a2ea05a8a473e994fae2346bcec05e8d37b6897ce16cd1f89fd9afbdc4ac"} Jun 06 16:51:55.581750 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.581673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:51:55.632858 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.632815 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:55.636033 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.635366 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-86xk4"] Jun 06 16:51:55.638729 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.638704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:55.640893 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.640867 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pplt9\"" Jun 06 16:51:55.641007 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.640925 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 06 16:51:55.647383 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.647308 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-86xk4"] Jun 06 16:51:55.712465 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.712437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmwnh\" (UniqueName: \"kubernetes.io/projected/121f7784-f524-4de7-85c1-998510d12511-kube-api-access-zmwnh\") pod \"monitoring-plugin-76b68cc874-86xk4\" (UID: \"121f7784-f524-4de7-85c1-998510d12511\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:55.712576 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.712559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/121f7784-f524-4de7-85c1-998510d12511-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-86xk4\" (UID: \"121f7784-f524-4de7-85c1-998510d12511\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:55.731425 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.731373 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:55.813948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.813921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/121f7784-f524-4de7-85c1-998510d12511-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-86xk4\" (UID: \"121f7784-f524-4de7-85c1-998510d12511\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:55.814079 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.814002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmwnh\" (UniqueName: \"kubernetes.io/projected/121f7784-f524-4de7-85c1-998510d12511-kube-api-access-zmwnh\") pod \"monitoring-plugin-76b68cc874-86xk4\" (UID: \"121f7784-f524-4de7-85c1-998510d12511\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:55.816792 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.816769 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/121f7784-f524-4de7-85c1-998510d12511-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-86xk4\" (UID: \"121f7784-f524-4de7-85c1-998510d12511\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:55.821467 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.821447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmwnh\" (UniqueName: \"kubernetes.io/projected/121f7784-f524-4de7-85c1-998510d12511-kube-api-access-zmwnh\") pod \"monitoring-plugin-76b68cc874-86xk4\" (UID: \"121f7784-f524-4de7-85c1-998510d12511\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:55.826103 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.826044 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b6b878594-8ttqb"] Jun 06 16:51:55.828470 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.828386 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:55.829638 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:55.829611 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af73209_411a_4803_ac36_ce839b30fa05.slice/crio-af990383631745f73826709957986078f6e4c4b7cbd3488f0a544cee844574d6 WatchSource:0}: Error finding container af990383631745f73826709957986078f6e4c4b7cbd3488f0a544cee844574d6: Status 404 returned error can't find the container with id af990383631745f73826709957986078f6e4c4b7cbd3488f0a544cee844574d6 Jun 06 16:51:55.881855 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.881828 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:55.952181 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:55.952159 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:56.103873 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.103808 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-86xk4"] Jun 06 16:51:56.106385 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:51:56.106353 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121f7784_f524_4de7_85c1_998510d12511.slice/crio-fd4039a0b9ff63bc9adfe3e96e31ac9ea1accc5691aaa30a8488e9e0a941a21a WatchSource:0}: Error finding container fd4039a0b9ff63bc9adfe3e96e31ac9ea1accc5691aaa30a8488e9e0a941a21a: Status 404 returned error can't find the container with id fd4039a0b9ff63bc9adfe3e96e31ac9ea1accc5691aaa30a8488e9e0a941a21a Jun 06 16:51:56.171624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.171591 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:56.361191 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.361107 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:56.434543 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.434480 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" event={"ID":"121f7784-f524-4de7-85c1-998510d12511","Type":"ContainerStarted","Data":"fd4039a0b9ff63bc9adfe3e96e31ac9ea1accc5691aaa30a8488e9e0a941a21a"} Jun 06 16:51:56.439503 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.439458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerStarted","Data":"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79"} Jun 06 16:51:56.439624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.439531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerStarted","Data":"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed"} Jun 06 16:51:56.439624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.439574 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerStarted","Data":"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99"} Jun 06 16:51:56.439624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.439612 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerStarted","Data":"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622"} Jun 06 16:51:56.439793 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.439650 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerStarted","Data":"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093"} Jun 06 16:51:56.440991 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.440963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" event={"ID":"1af73209-411a-4803-ac36-ce839b30fa05","Type":"ContainerStarted","Data":"af990383631745f73826709957986078f6e4c4b7cbd3488f0a544cee844574d6"} Jun 06 16:51:56.631889 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:56.631807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:57.053363 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:57.053325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:57.133839 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:57.133770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:57.233666 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:57.233568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:57.606851 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:57.606813 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:57.657925 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:57.657893 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:51:58.452914 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:58.452849 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" event={"ID":"121f7784-f524-4de7-85c1-998510d12511","Type":"ContainerStarted","Data":"e04d375a54a1ab90628dab282cf0ecc479fda0c22f704b5b708472fb874b81e5"} Jun 06 16:51:58.452914 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:58.452912 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:58.457675 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:58.457646 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerStarted","Data":"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d"} Jun 06 16:51:58.458907 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:58.458885 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" Jun 06 16:51:58.459755 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:58.459697 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" event={"ID":"1af73209-411a-4803-ac36-ce839b30fa05","Type":"ContainerStarted","Data":"b418feb457f992b814f09739acf3c98f395b7d0bcd73a4d2eec9ca3e64b7acca"} Jun 06 16:51:58.467824 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:58.467788 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-86xk4" podStartSLOduration=1.6853711759999999 podStartE2EDuration="3.467774577s" totalImagesPullingTime="1.782403401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:58.467679197 +0000 UTC m=+280.449154023" watchObservedRunningTime="2026-06-06 16:51:58.467774577 +0000 UTC m=+280.449249403" Jun 06 16:51:58.499676 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:58.499360 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" podStartSLOduration=1.443333567 podStartE2EDuration="3.499341566s" totalImagesPullingTime="2.056007999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:58.497445428 +0000 UTC m=+280.478920281" watchObservedRunningTime="2026-06-06 16:51:58.499341566 +0000 UTC m=+280.480816408" Jun 06 16:51:58.520530 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:51:58.519727 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.2688187539999998 podStartE2EDuration="7.519709264s" totalImagesPullingTime="4.227512766s" totalInitContainerRuntime="23.377744ms" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:58.518206519 +0000 UTC m=+280.499681345" watchObservedRunningTime="2026-06-06 16:51:58.519709264 +0000 UTC m=+280.501184089" Jun 06 16:52:00.045676 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:52:00.045638 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" podUID="82b46097-10e3-42a0-8135-becb1bf44c20" Jun 06 16:52:00.045676 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:52:00.045639 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rwsjk" podUID="a96ffa7a-747b-4550-a213-58068599c779" Jun 06 16:52:00.470413 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:00.470385 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:52:00.470413 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:00.470389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwsjk" Jun 06 16:52:03.016794 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.016753 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:03.071255 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.071194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:03.282670 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.282590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:52:03.282670 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.282638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:52:03.285351 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.285323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a96ffa7a-747b-4550-a213-58068599c779-metrics-tls\") pod \"dns-default-rwsjk\" (UID: \"a96ffa7a-747b-4550-a213-58068599c779\") " pod="openshift-dns/dns-default-rwsjk" Jun 06 16:52:03.285473 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.285361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"image-registry-6d987fdfd8-42gvx\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:52:03.474119 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.474090 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n4rxq\"" Jun 06 16:52:03.474119 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.474096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6gpx\"" Jun 06 16:52:03.481976 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.481954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:52:03.482148 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.482130 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwsjk" Jun 06 16:52:03.643707 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.643631 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwsjk"] Jun 06 16:52:03.645837 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:52:03.645807 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96ffa7a_747b_4550_a213_58068599c779.slice/crio-e8f7657b2c29243d57a952d45b112200ae015853414e8d4aff4f6006f61baff3 WatchSource:0}: Error finding container e8f7657b2c29243d57a952d45b112200ae015853414e8d4aff4f6006f61baff3: Status 404 returned error can't find the container with id e8f7657b2c29243d57a952d45b112200ae015853414e8d4aff4f6006f61baff3 Jun 06 16:52:03.667452 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:03.667434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d987fdfd8-42gvx"] Jun 06 16:52:03.670125 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:52:03.670099 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b46097_10e3_42a0_8135_becb1bf44c20.slice/crio-314bf1d776efddc7e146734eb48480599942c9ac5521a9e617bd1119f0490cd8 WatchSource:0}: Error finding container 314bf1d776efddc7e146734eb48480599942c9ac5521a9e617bd1119f0490cd8: Status 404 returned error can't find the container with id 314bf1d776efddc7e146734eb48480599942c9ac5521a9e617bd1119f0490cd8 Jun 06 16:52:04.491938 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:04.491892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwsjk" event={"ID":"a96ffa7a-747b-4550-a213-58068599c779","Type":"ContainerStarted","Data":"e8f7657b2c29243d57a952d45b112200ae015853414e8d4aff4f6006f61baff3"} Jun 06 16:52:04.494002 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:04.493974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" event={"ID":"82b46097-10e3-42a0-8135-becb1bf44c20","Type":"ContainerStarted","Data":"6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360"} Jun 06 16:52:04.494144 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:04.494032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" event={"ID":"82b46097-10e3-42a0-8135-becb1bf44c20","Type":"ContainerStarted","Data":"314bf1d776efddc7e146734eb48480599942c9ac5521a9e617bd1119f0490cd8"} Jun 06 16:52:04.494144 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:04.494075 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:52:04.511725 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:04.511674 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" podStartSLOduration=262.511654946 podStartE2EDuration="4m22.511654946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:52:04.511012833 +0000 UTC m=+286.492487659" watchObservedRunningTime="2026-06-06 16:52:04.511654946 +0000 UTC m=+286.493129772" Jun 06 16:52:05.774021 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:05.773949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:05.827660 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:05.827602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:08.466214 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:08.466181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:08.567904 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:08.567866 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:09.765897 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:09.765860 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:12.531617 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:12.531578 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-lj4vm" event={"ID":"ff45048b-5170-4318-8136-b34efbc1a0d6","Type":"ContainerStarted","Data":"b731ee9fb5d2cfe8e4f19dd35909ae51ebeb2397c6b3015f65cb32f3ee0a7488"} Jun 06 16:52:12.532110 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:12.531770 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-lj4vm" Jun 06 16:52:12.534571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:12.534542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwsjk" event={"ID":"a96ffa7a-747b-4550-a213-58068599c779","Type":"ContainerStarted","Data":"9c3d99415a538196ce60d830dd19c78e6ddc94c278d519789bd8ae5f0d25cef8"} Jun 06 16:52:12.534713 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:12.534592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwsjk" event={"ID":"a96ffa7a-747b-4550-a213-58068599c779","Type":"ContainerStarted","Data":"aa07050498e641bf1c4db7af5d44cb0780abedb56078f163ecbbc27a6b470a4a"} Jun 06 16:52:12.534713 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:12.534650 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rwsjk" Jun 06 16:52:12.544909 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:12.544888 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-lj4vm" Jun 06 16:52:12.563093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:12.563048 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rwsjk" podStartSLOduration=251.466364633 podStartE2EDuration="4m19.563035464s" totalImagesPullingTime="8.096670831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:52:12.562388589 +0000 UTC m=+294.543863436" watchObservedRunningTime="2026-06-06 16:52:12.563035464 +0000 UTC m=+294.544510290" Jun 06 16:52:12.564163 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:12.564120 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-lj4vm" podStartSLOduration=1.471157451 podStartE2EDuration="18.56411128s" totalImagesPullingTime="17.092953829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:52:12.547264821 +0000 UTC m=+294.528739669" watchObservedRunningTime="2026-06-06 16:52:12.56411128 +0000 UTC m=+294.545586109" Jun 06 16:52:13.166932 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:13.166890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:13.214915 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:13.214875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:14.908608 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:14.908564 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:15.011103 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:15.011052 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:15.495016 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:15.494981 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:15.581797 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:15.581767 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:52:15.581958 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:15.581834 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:52:18.176650 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:18.176612 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:18.230439 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:18.230406 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:18.468584 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:18.468553 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 16:52:18.468801 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:18.468598 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 16:52:18.481120 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:18.481098 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 16:52:22.541457 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:22.541429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rwsjk" Jun 06 16:52:22.580550 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:22.580525 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:23.486719 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:23.486684 2577 patch_prober.go:28] interesting pod/image-registry-6d987fdfd8-42gvx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:52:23.486948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:23.486737 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" podUID="82b46097-10e3-42a0-8135-becb1bf44c20" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:52:23.585404 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:23.585370 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:25.198368 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:25.198338 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:25.504491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:25.504414 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:52:25.640843 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:25.640808 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:25.740755 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:25.740725 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:25.787783 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:25.787713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:31.506462 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:31.506431 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:31.550478 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:31.550447 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:31.644276 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:31.644246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:31.745128 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:31.745100 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:33.048392 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:33.048364 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:33.148913 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:33.148882 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:33.195584 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:33.195558 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:35.587282 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:35.587252 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:52:35.591181 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:35.591157 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b6b878594-8ttqb" Jun 06 16:52:37.882196 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:37.882166 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d987fdfd8-42gvx"] Jun 06 16:52:37.961545 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:37.961517 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:38.062917 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:38.062890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:38.162217 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:38.162145 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:38.472688 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:38.472663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:38.574848 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:38.574818 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:39.656039 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:39.656006 2577 generic.go:356] "Generic (PLEG): container finished" podID="50001a40-7b39-4edf-aa51-05de9b94fa87" containerID="e85f5fb400ce740fc99ace4b791ba43b22b69b98a351ca0c9c75ae7309cee30c" exitCode=0 Jun 06 16:52:39.656039 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:39.656030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" event={"ID":"50001a40-7b39-4edf-aa51-05de9b94fa87","Type":"ContainerDied","Data":"e85f5fb400ce740fc99ace4b791ba43b22b69b98a351ca0c9c75ae7309cee30c"} Jun 06 16:52:39.656438 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:39.656351 2577 scope.go:117] "RemoveContainer" containerID="e85f5fb400ce740fc99ace4b791ba43b22b69b98a351ca0c9c75ae7309cee30c" Jun 06 16:52:40.617365 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:40.617331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:40.661815 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:40.661779 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f4vff" event={"ID":"50001a40-7b39-4edf-aa51-05de9b94fa87","Type":"ContainerStarted","Data":"e0bfa9c82fb2de03afd41c8d37e23cafe71f12d4221ae58b12cd21ea2de46697"} Jun 06 16:52:40.662853 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:40.662835 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:44.315984 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:44.315955 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:44.367961 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:44.367939 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:44.678850 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:44.678781 2577 generic.go:356] "Generic (PLEG): container finished" podID="6c108fee-d835-41a7-a67e-fc6d5f8de8aa" containerID="eb15cea9b478ec5ffa5bcf12b6f81e2219d921ba096de5579fd3c19c1ed6a015" exitCode=0 Jun 06 16:52:44.678993 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:44.678859 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mv2bv" event={"ID":"6c108fee-d835-41a7-a67e-fc6d5f8de8aa","Type":"ContainerDied","Data":"eb15cea9b478ec5ffa5bcf12b6f81e2219d921ba096de5579fd3c19c1ed6a015"} Jun 06 16:52:44.679196 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:44.679181 2577 scope.go:117] "RemoveContainer" containerID="eb15cea9b478ec5ffa5bcf12b6f81e2219d921ba096de5579fd3c19c1ed6a015" Jun 06 16:52:45.684964 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:45.684927 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mv2bv" event={"ID":"6c108fee-d835-41a7-a67e-fc6d5f8de8aa","Type":"ContainerStarted","Data":"43558287cb9596a51a47d159dc4e09347b9b4cf4c98039ad6133e5a27681b4ac"} Jun 06 16:52:46.778960 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:46.778932 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwsjk_a96ffa7a-747b-4550-a213-58068599c779/dns/0.log" Jun 06 16:52:46.978756 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:46.978732 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwsjk_a96ffa7a-747b-4550-a213-58068599c779/kube-rbac-proxy/0.log" Jun 06 16:52:47.379358 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:47.379337 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ms7c9_c6205570-13cf-4c02-b34b-f7513bb8cfed/dns-node-resolver/0.log" Jun 06 16:52:47.779376 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:47.779351 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d987fdfd8-42gvx_82b46097-10e3-42a0-8135-becb1bf44c20/registry/0.log" Jun 06 16:52:48.779178 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:48.779151 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lt6md_0bcd27ac-3a7a-4331-9782-99e278104b92/node-ca/0.log" Jun 06 16:52:48.979099 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:48.979072 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-554b47b59-bkb9r_5e8c01c0-4fcd-4de9-af24-9b33f1ed9238/router/0.log" Jun 06 16:52:49.578546 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:49.578518 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdr9h_30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f/serve-healthcheck-canary/0.log" Jun 06 16:52:53.464309 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:53.464281 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:53.512119 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:53.512092 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:55.140607 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:55.140573 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:52:55.241361 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:52:55.241330 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:02.901139 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:02.901101 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" podUID="82b46097-10e3-42a0-8135-becb1bf44c20" containerName="registry" containerID="cri-o://6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360" gracePeriod=30 Jun 06 16:53:03.723617 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:03.723585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:03.772103 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:03.772070 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:04.143394 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.143373 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:53:04.183509 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183486 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-trusted-ca\") pod \"82b46097-10e3-42a0-8135-becb1bf44c20\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " Jun 06 16:53:04.183661 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183536 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-bound-sa-token\") pod \"82b46097-10e3-42a0-8135-becb1bf44c20\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " Jun 06 16:53:04.183661 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183581 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82b46097-10e3-42a0-8135-becb1bf44c20-ca-trust-extracted\") pod \"82b46097-10e3-42a0-8135-becb1bf44c20\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " Jun 06 16:53:04.183773 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183738 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-installation-pull-secrets\") pod \"82b46097-10e3-42a0-8135-becb1bf44c20\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " Jun 06 16:53:04.183836 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183796 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-registry-certificates\") pod \"82b46097-10e3-42a0-8135-becb1bf44c20\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " Jun 06 16:53:04.183890 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183862 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") pod \"82b46097-10e3-42a0-8135-becb1bf44c20\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " Jun 06 16:53:04.183944 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183888 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzlc6\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-kube-api-access-qzlc6\") pod \"82b46097-10e3-42a0-8135-becb1bf44c20\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " Jun 06 16:53:04.183944 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183915 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-image-registry-private-configuration\") pod \"82b46097-10e3-42a0-8135-becb1bf44c20\" (UID: \"82b46097-10e3-42a0-8135-becb1bf44c20\") " Jun 06 16:53:04.184051 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.183981 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82b46097-10e3-42a0-8135-becb1bf44c20" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:53:04.184309 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.184204 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-trusted-ca\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:04.184704 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.184656 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82b46097-10e3-42a0-8135-becb1bf44c20" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:53:04.186656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.186614 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82b46097-10e3-42a0-8135-becb1bf44c20" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:53:04.186764 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.186685 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-kube-api-access-qzlc6" (OuterVolumeSpecName: "kube-api-access-qzlc6") pod "82b46097-10e3-42a0-8135-becb1bf44c20" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20"). InnerVolumeSpecName "kube-api-access-qzlc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:53:04.187248 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.187187 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82b46097-10e3-42a0-8135-becb1bf44c20" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:04.187553 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.187526 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82b46097-10e3-42a0-8135-becb1bf44c20" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:53:04.187878 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.187853 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82b46097-10e3-42a0-8135-becb1bf44c20" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:04.192751 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.192727 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b46097-10e3-42a0-8135-becb1bf44c20-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82b46097-10e3-42a0-8135-becb1bf44c20" (UID: "82b46097-10e3-42a0-8135-becb1bf44c20"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:53:04.285261 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.285192 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-registry-tls\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:04.285261 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.285213 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzlc6\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-kube-api-access-qzlc6\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:04.285261 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.285222 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-image-registry-private-configuration\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:04.285261 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.285257 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82b46097-10e3-42a0-8135-becb1bf44c20-bound-sa-token\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:04.285435 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.285271 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82b46097-10e3-42a0-8135-becb1bf44c20-ca-trust-extracted\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:04.285435 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.285283 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82b46097-10e3-42a0-8135-becb1bf44c20-installation-pull-secrets\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:04.285435 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.285293 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82b46097-10e3-42a0-8135-becb1bf44c20-registry-certificates\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:04.763323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.763291 2577 generic.go:356] "Generic (PLEG): container finished" podID="82b46097-10e3-42a0-8135-becb1bf44c20" containerID="6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360" exitCode=0 Jun 06 16:53:04.763467 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.763331 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" Jun 06 16:53:04.763467 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.763373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" event={"ID":"82b46097-10e3-42a0-8135-becb1bf44c20","Type":"ContainerDied","Data":"6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360"} Jun 06 16:53:04.763467 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.763418 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d987fdfd8-42gvx" event={"ID":"82b46097-10e3-42a0-8135-becb1bf44c20","Type":"ContainerDied","Data":"314bf1d776efddc7e146734eb48480599942c9ac5521a9e617bd1119f0490cd8"} Jun 06 16:53:04.763467 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.763438 2577 scope.go:117] "RemoveContainer" containerID="6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360" Jun 06 16:53:04.774553 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.774535 2577 scope.go:117] "RemoveContainer" containerID="6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360" Jun 06 16:53:04.774803 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:53:04.774779 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360\": container with ID starting with 6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360 not found: ID does not exist" containerID="6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360" Jun 06 16:53:04.774885 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.774814 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360"} err="failed to get container status \"6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360\": rpc error: code = NotFound desc = could not find container \"6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360\": container with ID starting with 6ae7c14b9904d90d9667bb85ec87ec14d6f774cd1dc940c2968707a7dea95360 not found: ID does not exist" Jun 06 16:53:04.780320 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.780296 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d987fdfd8-42gvx"] Jun 06 16:53:04.783375 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:04.783356 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d987fdfd8-42gvx"] Jun 06 16:53:05.324963 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:05.324928 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:05.370923 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:05.370897 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:06.507355 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:06.507328 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b46097-10e3-42a0-8135-becb1bf44c20" path="/var/lib/kubelet/pods/82b46097-10e3-42a0-8135-becb1bf44c20/volumes" Jun 06 16:53:06.925247 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:06.925160 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:06.975439 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:06.975407 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:07.844804 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:07.844775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:08.047492 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:08.047463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:08.149683 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:08.149589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:09.644454 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:09.644419 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:09.744523 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:09.744492 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:09.794194 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:09.794166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:11.145206 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.145174 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:53:11.145593 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.145463 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="alertmanager" containerID="cri-o://2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093" gracePeriod=120 Jun 06 16:53:11.145593 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.145532 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy-metric" containerID="cri-o://3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79" gracePeriod=120 Jun 06 16:53:11.145593 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.145562 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy" containerID="cri-o://309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed" gracePeriod=120 Jun 06 16:53:11.145753 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.145588 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="prom-label-proxy" containerID="cri-o://d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d" gracePeriod=120 Jun 06 16:53:11.145753 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.145599 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="config-reloader" containerID="cri-o://ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622" gracePeriod=120 Jun 06 16:53:11.145753 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.145553 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy-web" containerID="cri-o://848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99" gracePeriod=120 Jun 06 16:53:11.799093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.799061 2577 generic.go:356] "Generic (PLEG): container finished" podID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerID="d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d" exitCode=0 Jun 06 16:53:11.799093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.799086 2577 generic.go:356] "Generic (PLEG): container finished" podID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerID="309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed" exitCode=0 Jun 06 16:53:11.799093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.799094 2577 generic.go:356] "Generic (PLEG): container finished" podID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerID="ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622" exitCode=0 Jun 06 16:53:11.799093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.799099 2577 generic.go:356] "Generic (PLEG): container finished" podID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerID="2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093" exitCode=0 Jun 06 16:53:11.799367 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.799133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerDied","Data":"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d"} Jun 06 16:53:11.799367 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.799244 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerDied","Data":"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed"} Jun 06 16:53:11.799367 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.799273 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerDied","Data":"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622"} Jun 06 16:53:11.799367 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:11.799297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerDied","Data":"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093"} Jun 06 16:53:12.403913 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.403891 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.450057 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450033 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-trusted-ca-bundle\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450197 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450088 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450197 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450109 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-web\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450197 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450158 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450197 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450184 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-config-volume\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450477 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450238 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2xxx\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-kube-api-access-p2xxx\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450568 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450516 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:53:12.450688 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450651 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-main-db\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450763 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450700 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-tls-assets\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450763 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450732 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-metrics-client-ca\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450869 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450764 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-web-config\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450869 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450792 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-main-tls\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450869 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450824 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-config-out\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.450869 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.450849 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-cluster-tls-config\") pod \"c659e2f9-72ed-476e-8d3e-3193b9053222\" (UID: \"c659e2f9-72ed-476e-8d3e-3193b9053222\") " Jun 06 16:53:12.451846 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.451116 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.451846 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.451600 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:53:12.451846 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.451810 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:53:12.454669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.454510 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-config-volume" (OuterVolumeSpecName: "config-volume") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:12.454669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.454532 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:53:12.454669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.454593 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-kube-api-access-p2xxx" (OuterVolumeSpecName: "kube-api-access-p2xxx") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "kube-api-access-p2xxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:53:12.454669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.454599 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:12.454669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.454638 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:12.455646 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.455621 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:12.455867 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.455843 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:12.456183 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.456159 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-config-out" (OuterVolumeSpecName: "config-out") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:53:12.460381 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.460347 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:12.465538 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.465493 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-web-config" (OuterVolumeSpecName: "web-config") pod "c659e2f9-72ed-476e-8d3e-3193b9053222" (UID: "c659e2f9-72ed-476e-8d3e-3193b9053222"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:12.552109 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552088 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552109 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552109 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552124 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552136 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-config-volume\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552145 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2xxx\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-kube-api-access-p2xxx\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552152 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-alertmanager-main-db\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552160 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c659e2f9-72ed-476e-8d3e-3193b9053222-tls-assets\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552170 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c659e2f9-72ed-476e-8d3e-3193b9053222-metrics-client-ca\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552178 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-web-config\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552186 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-secret-alertmanager-main-tls\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552196 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c659e2f9-72ed-476e-8d3e-3193b9053222-config-out\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.552222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.552209 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c659e2f9-72ed-476e-8d3e-3193b9053222-cluster-tls-config\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:53:12.806972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.806905 2577 generic.go:356] "Generic (PLEG): container finished" podID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerID="3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79" exitCode=0 Jun 06 16:53:12.806972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.806929 2577 generic.go:356] "Generic (PLEG): container finished" podID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerID="848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99" exitCode=0 Jun 06 16:53:12.806972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.806950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerDied","Data":"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79"} Jun 06 16:53:12.807191 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.807019 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerDied","Data":"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99"} Jun 06 16:53:12.807191 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.807050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c659e2f9-72ed-476e-8d3e-3193b9053222","Type":"ContainerDied","Data":"6355b6ec5a2f120c454de6d9add0ac49fc69b6b17ad148f2f104b8bcc020ada7"} Jun 06 16:53:12.807191 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.807060 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.807191 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.807083 2577 scope.go:117] "RemoveContainer" containerID="d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d" Jun 06 16:53:12.816134 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.816121 2577 scope.go:117] "RemoveContainer" containerID="3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79" Jun 06 16:53:12.822904 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.822881 2577 scope.go:117] "RemoveContainer" containerID="309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed" Jun 06 16:53:12.826599 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.826576 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:53:12.830698 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.830676 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:53:12.830759 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.830729 2577 scope.go:117] "RemoveContainer" containerID="848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99" Jun 06 16:53:12.837569 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.837552 2577 scope.go:117] "RemoveContainer" containerID="ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622" Jun 06 16:53:12.845210 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.845190 2577 scope.go:117] "RemoveContainer" containerID="2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093" Jun 06 16:53:12.854654 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.854637 2577 scope.go:117] "RemoveContainer" containerID="9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf" Jun 06 16:53:12.859689 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.859669 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:53:12.859969 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.859956 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b46097-10e3-42a0-8135-becb1bf44c20" containerName="registry" Jun 06 16:53:12.860024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.859971 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b46097-10e3-42a0-8135-becb1bf44c20" containerName="registry" Jun 06 16:53:12.860024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.859984 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="prom-label-proxy" Jun 06 16:53:12.860024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.859991 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="prom-label-proxy" Jun 06 16:53:12.860024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860000 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy" Jun 06 16:53:12.860024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860005 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy" Jun 06 16:53:12.860024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860015 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="config-reloader" Jun 06 16:53:12.860024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860020 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="config-reloader" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860031 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy-web" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860036 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy-web" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860042 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy-metric" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860047 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy-metric" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860054 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="alertmanager" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860059 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="alertmanager" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860066 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="init-config-reloader" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860071 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="init-config-reloader" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860117 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy-metric" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860124 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="prom-label-proxy" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860129 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy-web" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860135 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="config-reloader" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860139 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b46097-10e3-42a0-8135-becb1bf44c20" containerName="registry" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860145 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="kube-rbac-proxy" Jun 06 16:53:12.860323 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.860153 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" containerName="alertmanager" Jun 06 16:53:12.863093 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.863074 2577 scope.go:117] "RemoveContainer" containerID="d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d" Jun 06 16:53:12.863164 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.863118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.863414 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:53:12.863386 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d\": container with ID starting with d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d not found: ID does not exist" containerID="d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d" Jun 06 16:53:12.863491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.863431 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d"} err="failed to get container status \"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d\": rpc error: code = NotFound desc = could not find container \"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d\": container with ID starting with d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d not found: ID does not exist" Jun 06 16:53:12.863491 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.863452 2577 scope.go:117] "RemoveContainer" containerID="3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79" Jun 06 16:53:12.863814 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:53:12.863771 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79\": container with ID starting with 3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79 not found: ID does not exist" containerID="3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79" Jun 06 16:53:12.863878 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.863807 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79"} err="failed to get container status \"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79\": rpc error: code = NotFound desc = could not find container \"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79\": container with ID starting with 3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79 not found: ID does not exist" Jun 06 16:53:12.863878 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.863829 2577 scope.go:117] "RemoveContainer" containerID="309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed" Jun 06 16:53:12.864078 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:53:12.864048 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed\": container with ID starting with 309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed not found: ID does not exist" containerID="309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed" Jun 06 16:53:12.864132 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.864077 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed"} err="failed to get container status \"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed\": rpc error: code = NotFound desc = could not find container \"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed\": container with ID starting with 309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed not found: ID does not exist" Jun 06 16:53:12.864132 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.864096 2577 scope.go:117] "RemoveContainer" containerID="848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99" Jun 06 16:53:12.864416 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:53:12.864397 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99\": container with ID starting with 848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99 not found: ID does not exist" containerID="848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99" Jun 06 16:53:12.864481 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.864419 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99"} err="failed to get container status \"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99\": rpc error: code = NotFound desc = could not find container \"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99\": container with ID starting with 848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99 not found: ID does not exist" Jun 06 16:53:12.864481 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.864434 2577 scope.go:117] "RemoveContainer" containerID="ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622" Jun 06 16:53:12.864730 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:53:12.864713 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622\": container with ID starting with ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622 not found: ID does not exist" containerID="ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622" Jun 06 16:53:12.864783 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.864732 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622"} err="failed to get container status \"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622\": rpc error: code = NotFound desc = could not find container \"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622\": container with ID starting with ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622 not found: ID does not exist" Jun 06 16:53:12.864783 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.864744 2577 scope.go:117] "RemoveContainer" containerID="2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093" Jun 06 16:53:12.865008 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:53:12.864985 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093\": container with ID starting with 2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093 not found: ID does not exist" containerID="2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093" Jun 06 16:53:12.865062 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865015 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093"} err="failed to get container status \"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093\": rpc error: code = NotFound desc = could not find container \"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093\": container with ID starting with 2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093 not found: ID does not exist" Jun 06 16:53:12.865062 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865035 2577 scope.go:117] "RemoveContainer" containerID="9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf" Jun 06 16:53:12.865390 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 16:53:12.865526 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 16:53:12.865526 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865415 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 16:53:12.865526 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865439 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rs9bz\"" Jun 06 16:53:12.865526 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:53:12.865361 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf\": container with ID starting with 9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf not found: ID does not exist" containerID="9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf" Jun 06 16:53:12.865526 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865519 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf"} err="failed to get container status \"9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf\": rpc error: code = NotFound desc = could not find container \"9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf\": container with ID starting with 9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf not found: ID does not exist" Jun 06 16:53:12.865526 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865538 2577 scope.go:117] "RemoveContainer" containerID="d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d" Jun 06 16:53:12.865951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 16:53:12.865951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 16:53:12.865951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865775 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 16:53:12.865951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 16:53:12.865951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865844 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d"} err="failed to get container status \"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d\": rpc error: code = NotFound desc = could not find container \"d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d\": container with ID starting with d43dc9c471fcc6cff8348dfe695a96900279b7281ca9b5bb318b567ba247d17d not found: ID does not exist" Jun 06 16:53:12.865951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865866 2577 scope.go:117] "RemoveContainer" containerID="3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79" Jun 06 16:53:12.865951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.865848 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 16:53:12.866436 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.866409 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79"} err="failed to get container status \"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79\": rpc error: code = NotFound desc = could not find container \"3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79\": container with ID starting with 3122a98a9a17d083a28d9466f2194b3bb5cd5470749e0f1ce8f36f50fed41e79 not found: ID does not exist" Jun 06 16:53:12.866436 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.866434 2577 scope.go:117] "RemoveContainer" containerID="309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed" Jun 06 16:53:12.866772 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.866689 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed"} err="failed to get container status \"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed\": rpc error: code = NotFound desc = could not find container \"309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed\": container with ID starting with 309aedbed6963a111210177a7b1406979e11597cdf7833bcf233453458be02ed not found: ID does not exist" Jun 06 16:53:12.866772 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.866716 2577 scope.go:117] "RemoveContainer" containerID="848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99" Jun 06 16:53:12.866990 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.866937 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99"} err="failed to get container status \"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99\": rpc error: code = NotFound desc = could not find container \"848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99\": container with ID starting with 848aecd9c3af0cc8f734bf1de717ad4220c94eee7d87a61aeab846fb96456b99 not found: ID does not exist" Jun 06 16:53:12.866990 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.866959 2577 scope.go:117] "RemoveContainer" containerID="ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622" Jun 06 16:53:12.867218 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.867199 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622"} err="failed to get container status \"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622\": rpc error: code = NotFound desc = could not find container \"ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622\": container with ID starting with ef908b40450440a200dfeb839fecc9ce3931ed7a7f26b827f04ea585223bb622 not found: ID does not exist" Jun 06 16:53:12.867382 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.867222 2577 scope.go:117] "RemoveContainer" containerID="2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093" Jun 06 16:53:12.867494 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.867468 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093"} err="failed to get container status \"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093\": rpc error: code = NotFound desc = could not find container \"2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093\": container with ID starting with 2267957ccc7a1efa31c9418e7dd3da89f1ef442b3d5fa0f316cbe9f51962f093 not found: ID does not exist" Jun 06 16:53:12.867494 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.867493 2577 scope.go:117] "RemoveContainer" containerID="9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf" Jun 06 16:53:12.867772 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.867743 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf"} err="failed to get container status \"9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf\": rpc error: code = NotFound desc = could not find container \"9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf\": container with ID starting with 9547c1288b4aaa1ddcadf309d89b92924dbac7427ceaaf66fcae049c98bfabcf not found: ID does not exist" Jun 06 16:53:12.870011 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.869989 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 16:53:12.877922 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.877902 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:53:12.954102 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6184fca6-2c59-4923-8fc0-f1287fa1480a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954102 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6184fca6-2c59-4923-8fc0-f1287fa1480a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954289 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-web-config\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954289 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184fca6-2c59-4923-8fc0-f1287fa1480a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954289 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx826\" (UniqueName: \"kubernetes.io/projected/6184fca6-2c59-4923-8fc0-f1287fa1480a-kube-api-access-cx826\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954289 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954289 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6184fca6-2c59-4923-8fc0-f1287fa1480a-config-out\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:12.954517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:12.954439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6184fca6-2c59-4923-8fc0-f1287fa1480a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055658 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx826\" (UniqueName: \"kubernetes.io/projected/6184fca6-2c59-4923-8fc0-f1287fa1480a-kube-api-access-cx826\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055771 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055771 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055771 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055771 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6184fca6-2c59-4923-8fc0-f1287fa1480a-config-out\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6184fca6-2c59-4923-8fc0-f1287fa1480a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.055972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.055941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6184fca6-2c59-4923-8fc0-f1287fa1480a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.056392 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.056365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6184fca6-2c59-4923-8fc0-f1287fa1480a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058436 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058527 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6184fca6-2c59-4923-8fc0-f1287fa1480a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058527 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-web-config\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058653 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184fca6-2c59-4923-8fc0-f1287fa1480a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058711 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6184fca6-2c59-4923-8fc0-f1287fa1480a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058773 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058871 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058850 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058928 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058892 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.058979 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.058929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.059246 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.059207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6184fca6-2c59-4923-8fc0-f1287fa1480a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.059333 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.059279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.059442 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.059424 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184fca6-2c59-4923-8fc0-f1287fa1480a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.059844 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.059828 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6184fca6-2c59-4923-8fc0-f1287fa1480a-config-out\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.060615 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.060601 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6184fca6-2c59-4923-8fc0-f1287fa1480a-web-config\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.063151 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.063130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx826\" (UniqueName: \"kubernetes.io/projected/6184fca6-2c59-4923-8fc0-f1287fa1480a-kube-api-access-cx826\") pod \"alertmanager-main-0\" (UID: \"6184fca6-2c59-4923-8fc0-f1287fa1480a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.173863 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.173842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 16:53:13.305606 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.305581 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 16:53:13.307882 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:53:13.307855 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6184fca6_2c59_4923_8fc0_f1287fa1480a.slice/crio-b60e78d7e0056a3091e445308840afa2fb1000c6a344017e482a0e4dd5c25f4f WatchSource:0}: Error finding container b60e78d7e0056a3091e445308840afa2fb1000c6a344017e482a0e4dd5c25f4f: Status 404 returned error can't find the container with id b60e78d7e0056a3091e445308840afa2fb1000c6a344017e482a0e4dd5c25f4f Jun 06 16:53:13.812051 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.812016 2577 generic.go:356] "Generic (PLEG): container finished" podID="6184fca6-2c59-4923-8fc0-f1287fa1480a" containerID="40068d6fac2bd41f9542fea46ef5b5f037a71c99789469d28aef62db787649c4" exitCode=0 Jun 06 16:53:13.812478 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.812106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6184fca6-2c59-4923-8fc0-f1287fa1480a","Type":"ContainerDied","Data":"40068d6fac2bd41f9542fea46ef5b5f037a71c99789469d28aef62db787649c4"} Jun 06 16:53:13.812478 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:13.812174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6184fca6-2c59-4923-8fc0-f1287fa1480a","Type":"ContainerStarted","Data":"b60e78d7e0056a3091e445308840afa2fb1000c6a344017e482a0e4dd5c25f4f"} Jun 06 16:53:14.506960 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:14.506927 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c659e2f9-72ed-476e-8d3e-3193b9053222" path="/var/lib/kubelet/pods/c659e2f9-72ed-476e-8d3e-3193b9053222/volumes" Jun 06 16:53:14.820242 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:14.820153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6184fca6-2c59-4923-8fc0-f1287fa1480a","Type":"ContainerStarted","Data":"8b0f607d0e4cf06ea37452c65675a1de1f0e65b5ed98160c7c62275bce409d2d"} Jun 06 16:53:14.820242 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:14.820214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6184fca6-2c59-4923-8fc0-f1287fa1480a","Type":"ContainerStarted","Data":"27b3f4cda4dfe3787949b540ab9b38efa7a80f6a9ca362a63e80adc2b38ef3a6"} Jun 06 16:53:14.820694 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:14.820264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6184fca6-2c59-4923-8fc0-f1287fa1480a","Type":"ContainerStarted","Data":"1fe62561a5c3a23183fa71bed72bf8b1a28cbeb920d932bc4a84048955ed72f0"} Jun 06 16:53:14.820694 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:14.820296 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6184fca6-2c59-4923-8fc0-f1287fa1480a","Type":"ContainerStarted","Data":"00905bbf11a392bd125e18c8840c91c61761f1fe929a924dd705c8342890e666"} Jun 06 16:53:14.820694 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:14.820321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6184fca6-2c59-4923-8fc0-f1287fa1480a","Type":"ContainerStarted","Data":"932c4e535e3cb97d05d4531f95f6e5805c00e12a3dd07c01e6e654311383712d"} Jun 06 16:53:14.820694 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:14.820344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6184fca6-2c59-4923-8fc0-f1287fa1480a","Type":"ContainerStarted","Data":"5197b74b0f0f50d75af5d7055b459e202fc9697135dbfb5891ad5606116b5ef6"} Jun 06 16:53:14.846285 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:14.846219 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.827354498 podStartE2EDuration="2.846205632s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.851134ms" isStatefulPod=false podCreationTimestamp="2026-06-06 16:53:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:53:14.844848083 +0000 UTC m=+356.826322945" watchObservedRunningTime="2026-06-06 16:53:14.846205632 +0000 UTC m=+356.827680457" Jun 06 16:53:16.776681 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:16.776643 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:16.828888 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:16.828855 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:18.336407 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:18.336374 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:18.437692 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:18.437658 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:18.537836 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:18.537807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:23.477276 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:23.477221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:53:23.580527 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:53:23.580498 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:15.591623 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:15.591587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:26.253014 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.252980 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:26.348703 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.348676 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:26.808058 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.808027 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm"] Jun 06 16:54:26.811674 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.811657 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:26.818114 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.817722 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 16:54:26.818114 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.817741 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wnlgj\"" Jun 06 16:54:26.818114 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.817824 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 16:54:26.822529 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.822508 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm"] Jun 06 16:54:26.906748 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.906723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x92fx\" (UniqueName: \"kubernetes.io/projected/d05edeae-7935-4387-a374-1948b94ffc17-kube-api-access-x92fx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:26.906860 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.906758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:26.906860 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:26.906838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:27.007556 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.007533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:27.007648 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.007568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x92fx\" (UniqueName: \"kubernetes.io/projected/d05edeae-7935-4387-a374-1948b94ffc17-kube-api-access-x92fx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:27.007648 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.007592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:27.007938 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.007917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:27.008000 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.007950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:27.015627 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.015602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x92fx\" (UniqueName: \"kubernetes.io/projected/d05edeae-7935-4387-a374-1948b94ffc17-kube-api-access-x92fx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:27.121146 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.121099 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:27.246131 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.246100 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm"] Jun 06 16:54:27.249256 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:54:27.249213 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05edeae_7935_4387_a374_1948b94ffc17.slice/crio-90a8e3d4fe58aeedfe1f0a815f074c9322d87c1c20bf10465152a16058a96bd5 WatchSource:0}: Error finding container 90a8e3d4fe58aeedfe1f0a815f074c9322d87c1c20bf10465152a16058a96bd5: Status 404 returned error can't find the container with id 90a8e3d4fe58aeedfe1f0a815f074c9322d87c1c20bf10465152a16058a96bd5 Jun 06 16:54:27.251133 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:27.251112 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 16:54:28.103453 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:28.103419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" event={"ID":"d05edeae-7935-4387-a374-1948b94ffc17","Type":"ContainerStarted","Data":"90a8e3d4fe58aeedfe1f0a815f074c9322d87c1c20bf10465152a16058a96bd5"} Jun 06 16:54:34.131548 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:34.131511 2577 generic.go:356] "Generic (PLEG): container finished" podID="d05edeae-7935-4387-a374-1948b94ffc17" containerID="faca241bf1818adf0b28d108faa4942af6d963f0e1fea0427459b76730d9dd15" exitCode=0 Jun 06 16:54:34.131988 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:34.131597 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" event={"ID":"d05edeae-7935-4387-a374-1948b94ffc17","Type":"ContainerDied","Data":"faca241bf1818adf0b28d108faa4942af6d963f0e1fea0427459b76730d9dd15"} Jun 06 16:54:37.146461 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:37.146427 2577 generic.go:356] "Generic (PLEG): container finished" podID="d05edeae-7935-4387-a374-1948b94ffc17" containerID="5d2cb5f85f79e1b0b07cd95b379afd10ba4e3fca37e20977d02387efc4a39a03" exitCode=0 Jun 06 16:54:37.146461 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:37.146462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" event={"ID":"d05edeae-7935-4387-a374-1948b94ffc17","Type":"ContainerDied","Data":"5d2cb5f85f79e1b0b07cd95b379afd10ba4e3fca37e20977d02387efc4a39a03"} Jun 06 16:54:44.182421 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:44.182386 2577 generic.go:356] "Generic (PLEG): container finished" podID="d05edeae-7935-4387-a374-1948b94ffc17" containerID="703269cbe8088b8bdfe6fcf373c65b3625518e01d629cd2958b21c79e46fbff7" exitCode=0 Jun 06 16:54:44.182814 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:44.182462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" event={"ID":"d05edeae-7935-4387-a374-1948b94ffc17","Type":"ContainerDied","Data":"703269cbe8088b8bdfe6fcf373c65b3625518e01d629cd2958b21c79e46fbff7"} Jun 06 16:54:45.308828 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.308803 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:45.455113 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.455025 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-bundle\") pod \"d05edeae-7935-4387-a374-1948b94ffc17\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " Jun 06 16:54:45.455300 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.455120 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x92fx\" (UniqueName: \"kubernetes.io/projected/d05edeae-7935-4387-a374-1948b94ffc17-kube-api-access-x92fx\") pod \"d05edeae-7935-4387-a374-1948b94ffc17\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " Jun 06 16:54:45.455300 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.455189 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-util\") pod \"d05edeae-7935-4387-a374-1948b94ffc17\" (UID: \"d05edeae-7935-4387-a374-1948b94ffc17\") " Jun 06 16:54:45.455824 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.455800 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-bundle" (OuterVolumeSpecName: "bundle") pod "d05edeae-7935-4387-a374-1948b94ffc17" (UID: "d05edeae-7935-4387-a374-1948b94ffc17"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:54:45.457443 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.457413 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d05edeae-7935-4387-a374-1948b94ffc17-kube-api-access-x92fx" (OuterVolumeSpecName: "kube-api-access-x92fx") pod "d05edeae-7935-4387-a374-1948b94ffc17" (UID: "d05edeae-7935-4387-a374-1948b94ffc17"). InnerVolumeSpecName "kube-api-access-x92fx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:54:45.459960 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.459936 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-util" (OuterVolumeSpecName: "util") pod "d05edeae-7935-4387-a374-1948b94ffc17" (UID: "d05edeae-7935-4387-a374-1948b94ffc17"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:54:45.556406 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.556374 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x92fx\" (UniqueName: \"kubernetes.io/projected/d05edeae-7935-4387-a374-1948b94ffc17-kube-api-access-x92fx\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:54:45.556406 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.556403 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-util\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:54:45.556406 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:45.556413 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d05edeae-7935-4387-a374-1948b94ffc17-bundle\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:54:46.192098 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:46.192072 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" Jun 06 16:54:46.192282 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:46.192068 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr9crm" event={"ID":"d05edeae-7935-4387-a374-1948b94ffc17","Type":"ContainerDied","Data":"90a8e3d4fe58aeedfe1f0a815f074c9322d87c1c20bf10465152a16058a96bd5"} Jun 06 16:54:46.192282 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:46.192187 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90a8e3d4fe58aeedfe1f0a815f074c9322d87c1c20bf10465152a16058a96bd5" Jun 06 16:54:47.531858 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:47.531821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:48.909965 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:48.909931 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:49.484274 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.484218 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b"] Jun 06 16:54:49.484559 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.484547 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05edeae-7935-4387-a374-1948b94ffc17" containerName="extract" Jun 06 16:54:49.484600 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.484560 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05edeae-7935-4387-a374-1948b94ffc17" containerName="extract" Jun 06 16:54:49.484600 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.484576 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05edeae-7935-4387-a374-1948b94ffc17" containerName="pull" Jun 06 16:54:49.484600 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.484581 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05edeae-7935-4387-a374-1948b94ffc17" containerName="pull" Jun 06 16:54:49.484600 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.484594 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05edeae-7935-4387-a374-1948b94ffc17" containerName="util" Jun 06 16:54:49.484600 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.484599 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05edeae-7935-4387-a374-1948b94ffc17" containerName="util" Jun 06 16:54:49.484746 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.484657 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d05edeae-7935-4387-a374-1948b94ffc17" containerName="extract" Jun 06 16:54:49.486493 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.486474 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" Jun 06 16:54:49.488766 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.488733 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:54:49.488945 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.488780 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-68qx6\"" Jun 06 16:54:49.488945 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.488780 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 06 16:54:49.497474 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.497454 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b"] Jun 06 16:54:49.591497 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.591469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddsm\" (UniqueName: \"kubernetes.io/projected/dbff3c2b-53cf-4356-b52f-544f927ed544-kube-api-access-wddsm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8s7b\" (UID: \"dbff3c2b-53cf-4356-b52f-544f927ed544\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" Jun 06 16:54:49.591612 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.591517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbff3c2b-53cf-4356-b52f-544f927ed544-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8s7b\" (UID: \"dbff3c2b-53cf-4356-b52f-544f927ed544\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" Jun 06 16:54:49.692195 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.692153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbff3c2b-53cf-4356-b52f-544f927ed544-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8s7b\" (UID: \"dbff3c2b-53cf-4356-b52f-544f927ed544\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" Jun 06 16:54:49.692352 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.692260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wddsm\" (UniqueName: \"kubernetes.io/projected/dbff3c2b-53cf-4356-b52f-544f927ed544-kube-api-access-wddsm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8s7b\" (UID: \"dbff3c2b-53cf-4356-b52f-544f927ed544\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" Jun 06 16:54:49.692517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.692496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbff3c2b-53cf-4356-b52f-544f927ed544-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8s7b\" (UID: \"dbff3c2b-53cf-4356-b52f-544f927ed544\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" Jun 06 16:54:49.703259 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.703220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddsm\" (UniqueName: \"kubernetes.io/projected/dbff3c2b-53cf-4356-b52f-544f927ed544-kube-api-access-wddsm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8s7b\" (UID: \"dbff3c2b-53cf-4356-b52f-544f927ed544\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" Jun 06 16:54:49.795910 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.795840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" Jun 06 16:54:49.928300 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:49.928275 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b"] Jun 06 16:54:49.931139 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:54:49.931114 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbff3c2b_53cf_4356_b52f_544f927ed544.slice/crio-b0a5ace3c5c9b00f76030e34ef301a1b16b17265a997965c753e06a69dfca1a3 WatchSource:0}: Error finding container b0a5ace3c5c9b00f76030e34ef301a1b16b17265a997965c753e06a69dfca1a3: Status 404 returned error can't find the container with id b0a5ace3c5c9b00f76030e34ef301a1b16b17265a997965c753e06a69dfca1a3 Jun 06 16:54:50.212347 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:50.212314 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" event={"ID":"dbff3c2b-53cf-4356-b52f-544f927ed544","Type":"ContainerStarted","Data":"b0a5ace3c5c9b00f76030e34ef301a1b16b17265a997965c753e06a69dfca1a3"} Jun 06 16:54:51.146106 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:51.146074 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:51.196034 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:51.195998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:52.224258 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:52.224209 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" event={"ID":"dbff3c2b-53cf-4356-b52f-544f927ed544","Type":"ContainerStarted","Data":"ec6110b9a846d9a8a12085b027aa440e073aa38b5e70e2e11fa277503b0f06e9"} Jun 06 16:54:52.245702 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:52.245660 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8s7b" podStartSLOduration=1.31542245 podStartE2EDuration="3.245647356s" totalImagesPullingTime="1.930224906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:54:52.243130801 +0000 UTC m=+454.224605628" watchObservedRunningTime="2026-06-06 16:54:52.245647356 +0000 UTC m=+454.227122181" Jun 06 16:54:52.452366 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:52.452323 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:52.551005 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:52.550932 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:52.671726 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:52.671697 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:52.773792 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:52.773762 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:55.378656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.378624 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t"] Jun 06 16:54:55.380686 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.380670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:55.383300 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.383277 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 06 16:54:55.383815 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.383798 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bmrhz\"" Jun 06 16:54:55.384257 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.384245 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 06 16:54:55.391606 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.391583 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t"] Jun 06 16:54:55.542780 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.542748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsls5\" (UniqueName: \"kubernetes.io/projected/620c29a2-0eaf-45c5-a17e-b12788f2a59d-kube-api-access-jsls5\") pod \"cert-manager-webhook-7dc76cbb94-kfb4t\" (UID: \"620c29a2-0eaf-45c5-a17e-b12788f2a59d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:55.542924 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.542798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/620c29a2-0eaf-45c5-a17e-b12788f2a59d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-kfb4t\" (UID: \"620c29a2-0eaf-45c5-a17e-b12788f2a59d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:55.643773 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.643698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsls5\" (UniqueName: \"kubernetes.io/projected/620c29a2-0eaf-45c5-a17e-b12788f2a59d-kube-api-access-jsls5\") pod \"cert-manager-webhook-7dc76cbb94-kfb4t\" (UID: \"620c29a2-0eaf-45c5-a17e-b12788f2a59d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:55.643773 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.643764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/620c29a2-0eaf-45c5-a17e-b12788f2a59d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-kfb4t\" (UID: \"620c29a2-0eaf-45c5-a17e-b12788f2a59d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:55.651449 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.651421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/620c29a2-0eaf-45c5-a17e-b12788f2a59d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-kfb4t\" (UID: \"620c29a2-0eaf-45c5-a17e-b12788f2a59d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:55.651630 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.651611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsls5\" (UniqueName: \"kubernetes.io/projected/620c29a2-0eaf-45c5-a17e-b12788f2a59d-kube-api-access-jsls5\") pod \"cert-manager-webhook-7dc76cbb94-kfb4t\" (UID: \"620c29a2-0eaf-45c5-a17e-b12788f2a59d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:55.700439 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.700413 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:55.773514 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.773487 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:55.832194 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:55.832162 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t"] Jun 06 16:54:55.835336 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:54:55.835310 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod620c29a2_0eaf_45c5_a17e_b12788f2a59d.slice/crio-5c1bde89ae8746198875ffe3bca75238996654a464e437a23fe0f79fedaddb2e WatchSource:0}: Error finding container 5c1bde89ae8746198875ffe3bca75238996654a464e437a23fe0f79fedaddb2e: Status 404 returned error can't find the container with id 5c1bde89ae8746198875ffe3bca75238996654a464e437a23fe0f79fedaddb2e Jun 06 16:54:56.241750 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.241718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" event={"ID":"620c29a2-0eaf-45c5-a17e-b12788f2a59d","Type":"ContainerStarted","Data":"5c1bde89ae8746198875ffe3bca75238996654a464e437a23fe0f79fedaddb2e"} Jun 06 16:54:56.334556 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.334526 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq"] Jun 06 16:54:56.337106 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.337087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" Jun 06 16:54:56.339302 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.339283 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8trb5\"" Jun 06 16:54:56.353137 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.353117 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq"] Jun 06 16:54:56.361956 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.361929 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:56.449921 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.449896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeb0675e-35d6-4b5d-88b8-69c2f0840d4f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-tj4gq\" (UID: \"aeb0675e-35d6-4b5d-88b8-69c2f0840d4f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" Jun 06 16:54:56.450176 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.449924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjwk\" (UniqueName: \"kubernetes.io/projected/aeb0675e-35d6-4b5d-88b8-69c2f0840d4f-kube-api-access-jvjwk\") pod \"cert-manager-cainjector-5d99449ffd-tj4gq\" (UID: \"aeb0675e-35d6-4b5d-88b8-69c2f0840d4f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" Jun 06 16:54:56.550488 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.550419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeb0675e-35d6-4b5d-88b8-69c2f0840d4f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-tj4gq\" (UID: \"aeb0675e-35d6-4b5d-88b8-69c2f0840d4f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" Jun 06 16:54:56.550488 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.550458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjwk\" (UniqueName: \"kubernetes.io/projected/aeb0675e-35d6-4b5d-88b8-69c2f0840d4f-kube-api-access-jvjwk\") pod \"cert-manager-cainjector-5d99449ffd-tj4gq\" (UID: \"aeb0675e-35d6-4b5d-88b8-69c2f0840d4f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" Jun 06 16:54:56.558172 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.558146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeb0675e-35d6-4b5d-88b8-69c2f0840d4f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-tj4gq\" (UID: \"aeb0675e-35d6-4b5d-88b8-69c2f0840d4f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" Jun 06 16:54:56.558341 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.558325 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjwk\" (UniqueName: \"kubernetes.io/projected/aeb0675e-35d6-4b5d-88b8-69c2f0840d4f-kube-api-access-jvjwk\") pod \"cert-manager-cainjector-5d99449ffd-tj4gq\" (UID: \"aeb0675e-35d6-4b5d-88b8-69c2f0840d4f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" Jun 06 16:54:56.646274 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.646241 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" Jun 06 16:54:56.792652 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:56.792628 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq"] Jun 06 16:54:56.794987 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:54:56.794947 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeb0675e_35d6_4b5d_88b8_69c2f0840d4f.slice/crio-6a4d649d7c58a8a8ec62f58f5f9d83f1651ca6d73198f97730c3b52d2028d4ad WatchSource:0}: Error finding container 6a4d649d7c58a8a8ec62f58f5f9d83f1651ca6d73198f97730c3b52d2028d4ad: Status 404 returned error can't find the container with id 6a4d649d7c58a8a8ec62f58f5f9d83f1651ca6d73198f97730c3b52d2028d4ad Jun 06 16:54:57.248332 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:57.248291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" event={"ID":"aeb0675e-35d6-4b5d-88b8-69c2f0840d4f","Type":"ContainerStarted","Data":"6a4d649d7c58a8a8ec62f58f5f9d83f1651ca6d73198f97730c3b52d2028d4ad"} Jun 06 16:54:57.943145 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:57.943103 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:57.995013 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:57.994951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:54:59.259565 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:59.259529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" event={"ID":"620c29a2-0eaf-45c5-a17e-b12788f2a59d","Type":"ContainerStarted","Data":"314acb1b36f8730d273d61622316ca0a43986f4fa62d234e6bbae284da4711a7"} Jun 06 16:54:59.260048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:59.259599 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:54:59.261039 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:59.261018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" event={"ID":"aeb0675e-35d6-4b5d-88b8-69c2f0840d4f","Type":"ContainerStarted","Data":"a8290c16e66619368fc7b1eec4bdff2666ac05e352404c501c6058f60010d0f4"} Jun 06 16:54:59.277545 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:59.277494 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" podStartSLOduration=1.585925033 podStartE2EDuration="4.277476656s" totalImagesPullingTime="2.691551623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:54:59.274102611 +0000 UTC m=+461.255577435" watchObservedRunningTime="2026-06-06 16:54:59.277476656 +0000 UTC m=+461.258951482" Jun 06 16:54:59.289109 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:54:59.289053 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-tj4gq" podStartSLOduration=1.5519706389999999 podStartE2EDuration="3.289042478s" totalImagesPullingTime="1.737071839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:54:59.287798152 +0000 UTC m=+461.269272975" watchObservedRunningTime="2026-06-06 16:54:59.289042478 +0000 UTC m=+461.270517303" Jun 06 16:55:04.153471 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:04.153426 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:05.268269 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:05.268220 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kfb4t" Jun 06 16:55:16.431972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:16.431936 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:20.457503 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:20.457470 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:20.557365 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:20.557337 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:25.355157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:25.355117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:25.460105 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:25.460076 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:26.405515 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:26.405482 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:27.287342 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:27.287314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:30.369191 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:30.369157 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:30.470611 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:30.470585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:35.515504 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.515472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:35.554026 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.554000 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch"] Jun 06 16:55:35.556943 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.556929 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.559390 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.559369 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:55:35.559493 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.559394 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 16:55:35.560364 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.560343 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kfzzr\"" Jun 06 16:55:35.560475 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.560415 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 06 16:55:35.560475 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.560418 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 06 16:55:35.560475 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.560450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 06 16:55:35.565728 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.565707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch"] Jun 06 16:55:35.594066 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.594045 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:35.641441 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.641414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0561eab2-f35b-4ce1-bf74-658f577f82e4-manager-config\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.641550 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.641446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0561eab2-f35b-4ce1-bf74-658f577f82e4-metrics-cert\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.641550 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.641481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxh96\" (UniqueName: \"kubernetes.io/projected/0561eab2-f35b-4ce1-bf74-658f577f82e4-kube-api-access-nxh96\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.641550 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.641510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0561eab2-f35b-4ce1-bf74-658f577f82e4-cert\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.742568 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.742541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0561eab2-f35b-4ce1-bf74-658f577f82e4-cert\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.742657 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.742597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0561eab2-f35b-4ce1-bf74-658f577f82e4-manager-config\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.742657 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.742629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0561eab2-f35b-4ce1-bf74-658f577f82e4-metrics-cert\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.742657 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.742653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxh96\" (UniqueName: \"kubernetes.io/projected/0561eab2-f35b-4ce1-bf74-658f577f82e4-kube-api-access-nxh96\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.743327 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.743307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0561eab2-f35b-4ce1-bf74-658f577f82e4-manager-config\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.745081 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.745061 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0561eab2-f35b-4ce1-bf74-658f577f82e4-cert\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.745161 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.745095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0561eab2-f35b-4ce1-bf74-658f577f82e4-metrics-cert\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.750849 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.750831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxh96\" (UniqueName: \"kubernetes.io/projected/0561eab2-f35b-4ce1-bf74-658f577f82e4-kube-api-access-nxh96\") pod \"lws-controller-manager-6cfc947f5-c4wch\" (UID: \"0561eab2-f35b-4ce1-bf74-658f577f82e4\") " pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.867207 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.867133 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:35.992860 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:35.992834 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch"] Jun 06 16:55:35.996559 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:55:35.996532 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0561eab2_f35b_4ce1_bf74_658f577f82e4.slice/crio-9699c605074003fef99185e20dfba2b47f1113af9fe550334fbc747d12e0adae WatchSource:0}: Error finding container 9699c605074003fef99185e20dfba2b47f1113af9fe550334fbc747d12e0adae: Status 404 returned error can't find the container with id 9699c605074003fef99185e20dfba2b47f1113af9fe550334fbc747d12e0adae Jun 06 16:55:36.196100 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:36.196067 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:36.251753 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:36.251722 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:36.419656 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:36.419621 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" event={"ID":"0561eab2-f35b-4ce1-bf74-658f577f82e4","Type":"ContainerStarted","Data":"9699c605074003fef99185e20dfba2b47f1113af9fe550334fbc747d12e0adae"} Jun 06 16:55:39.435166 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:39.435131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" event={"ID":"0561eab2-f35b-4ce1-bf74-658f577f82e4","Type":"ContainerStarted","Data":"f2b41ed14370229bbc70ec603e575be9fa8c87630da3a93b27e9e9e49c384336"} Jun 06 16:55:39.435541 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:39.435271 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:39.449733 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:39.449690 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" podStartSLOduration=2.002612722 podStartE2EDuration="4.449675962s" totalImagesPullingTime="2.44706324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:55:39.448522178 +0000 UTC m=+501.429997041" watchObservedRunningTime="2026-06-06 16:55:39.449675962 +0000 UTC m=+501.431150786" Jun 06 16:55:43.462396 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:43.462363 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:43.563029 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:43.562999 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:44.034879 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.034845 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:44.280242 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.280185 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:44.383641 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.383528 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:44.422699 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.422669 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn"] Jun 06 16:55:44.426136 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.426116 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.429324 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.429301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 16:55:44.429432 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.429328 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 16:55:44.429432 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.429335 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 16:55:44.429647 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.429435 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ld5z5\"" Jun 06 16:55:44.430412 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.430394 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 16:55:44.441466 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.441445 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn"] Jun 06 16:55:44.512072 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.512047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4451a124-f530-471a-a29d-fbea4a451781-manifests\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.512431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.512081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4451a124-f530-471a-a29d-fbea4a451781-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.512431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.512157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4451a124-f530-471a-a29d-fbea4a451781-tmp\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.512431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.512194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29qtm\" (UniqueName: \"kubernetes.io/projected/4451a124-f530-471a-a29d-fbea4a451781-kube-api-access-29qtm\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.512431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.512312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4451a124-f530-471a-a29d-fbea4a451781-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.531571 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.531544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:44.613498 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.613478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29qtm\" (UniqueName: \"kubernetes.io/projected/4451a124-f530-471a-a29d-fbea4a451781-kube-api-access-29qtm\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.613583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.613511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4451a124-f530-471a-a29d-fbea4a451781-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.613583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.613548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4451a124-f530-471a-a29d-fbea4a451781-manifests\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.613677 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.613654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4451a124-f530-471a-a29d-fbea4a451781-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.613736 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.613715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4451a124-f530-471a-a29d-fbea4a451781-tmp\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.613856 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.613840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4451a124-f530-471a-a29d-fbea4a451781-manifests\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.615892 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.615863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4451a124-f530-471a-a29d-fbea4a451781-tmp\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.615988 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.615927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4451a124-f530-471a-a29d-fbea4a451781-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.616033 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.615999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4451a124-f530-471a-a29d-fbea4a451781-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.624031 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.624009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29qtm\" (UniqueName: \"kubernetes.io/projected/4451a124-f530-471a-a29d-fbea4a451781-kube-api-access-29qtm\") pod \"opendatahub-operator-controller-manager-86bd68968c-68rjn\" (UID: \"4451a124-f530-471a-a29d-fbea4a451781\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.628701 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.628683 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:44.729012 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.728990 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:44.737029 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.737006 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:44.832918 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.832892 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:44.872644 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.872614 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn"] Jun 06 16:55:44.875964 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:55:44.875938 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4451a124_f530_471a_a29d_fbea4a451781.slice/crio-6f62e1aa0223f61cf74b152079568b85673764e09ee6cde38014d9245f09498a WatchSource:0}: Error finding container 6f62e1aa0223f61cf74b152079568b85673764e09ee6cde38014d9245f09498a: Status 404 returned error can't find the container with id 6f62e1aa0223f61cf74b152079568b85673764e09ee6cde38014d9245f09498a Jun 06 16:55:44.937726 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:44.937698 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:45.467421 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:45.467188 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" event={"ID":"4451a124-f530-471a-a29d-fbea4a451781","Type":"ContainerStarted","Data":"6f62e1aa0223f61cf74b152079568b85673764e09ee6cde38014d9245f09498a"} Jun 06 16:55:48.484874 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:48.484842 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" event={"ID":"4451a124-f530-471a-a29d-fbea4a451781","Type":"ContainerStarted","Data":"c6ea94ad1ac36e98be028b9794d9bcc3be2432aef3f3dacc304a0060b36cdbbf"} Jun 06 16:55:49.490709 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:49.490672 2577 generic.go:356] "Generic (PLEG): container finished" podID="4451a124-f530-471a-a29d-fbea4a451781" containerID="c6ea94ad1ac36e98be028b9794d9bcc3be2432aef3f3dacc304a0060b36cdbbf" exitCode=0 Jun 06 16:55:49.491073 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:49.490745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" event={"ID":"4451a124-f530-471a-a29d-fbea4a451781","Type":"ContainerDied","Data":"c6ea94ad1ac36e98be028b9794d9bcc3be2432aef3f3dacc304a0060b36cdbbf"} Jun 06 16:55:49.801887 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:49.801860 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:49.854091 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:49.854069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:50.442155 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:50.442124 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6cfc947f5-c4wch" Jun 06 16:55:50.499300 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:50.499264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" event={"ID":"4451a124-f530-471a-a29d-fbea4a451781","Type":"ContainerStarted","Data":"304ca910d453df6e19171ed79af9a23ed57528cf7c7de6209a0a346112eeb094"} Jun 06 16:55:50.499713 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:50.499509 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:55:50.520681 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:50.520632 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" podStartSLOduration=2.5067724890000003 podStartE2EDuration="6.520616475s" totalImagesPullingTime="3.094669251s" totalInitContainerRuntime="919.174735ms" isStatefulPod=false podCreationTimestamp="2026-06-06 16:55:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:55:50.51869529 +0000 UTC m=+512.500170151" watchObservedRunningTime="2026-06-06 16:55:50.520616475 +0000 UTC m=+512.502091299" Jun 06 16:55:51.848996 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:51.848964 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:51.949346 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:51.949313 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:54.965854 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:54.965821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:55:55.068735 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:55:55.068704 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:01.506483 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:01.506450 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-68rjn" Jun 06 16:56:03.331173 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:03.331128 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:03.410930 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:03.410878 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:03.528883 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:03.528851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:03.622103 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:03.622033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:03.717669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:03.717637 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:03.888900 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:03.888826 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:03.984334 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:03.984304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:04.078411 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:04.078380 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:04.178169 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:04.178084 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:04.432266 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:04.432237 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:04.527554 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:04.527525 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:13.027602 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:13.027412 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:13.109965 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:13.109930 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:13.224763 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:13.224696 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:13.317541 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:13.317444 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:14.285835 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:14.285807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:14.383148 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:14.383113 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:14.444212 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:14.444176 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:20.617450 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:20.617416 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:20.718374 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:20.718343 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:21.712659 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:21.712625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:21.828525 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:21.828490 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:22.570855 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:22.570826 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:22.700758 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:22.700721 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:23.183589 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:23.183557 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:33.120185 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:33.120155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:33.223468 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:33.223436 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:33.516063 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:33.516031 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:33.592634 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:33.592598 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:33.751221 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:33.751192 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:38.443825 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.443787 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:38.560333 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.560294 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:38.689404 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.689375 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg"] Jun 06 16:56:38.694553 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.694493 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.696938 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.696917 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 16:56:38.697039 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.696998 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fltj5\"" Jun 06 16:56:38.711645 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.711623 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg"] Jun 06 16:56:38.727641 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.727620 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:38.779412 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.779412 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.779624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cllt\" (UniqueName: \"kubernetes.io/projected/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-kube-api-access-6cllt\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.779624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.779624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.779624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.779791 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.779791 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.779791 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.779709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880443 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880587 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880587 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880587 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880756 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880756 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880756 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cllt\" (UniqueName: \"kubernetes.io/projected/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-kube-api-access-6cllt\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880756 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880952 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.880952 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.881058 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.880955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.881119 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.881097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.881309 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.881286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.881473 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.881455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.882994 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.882973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.883077 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.883017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.902473 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.902436 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cllt\" (UniqueName: \"kubernetes.io/projected/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-kube-api-access-6cllt\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.902576 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.902514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98b09ea-5fdc-4a6a-82ac-873d3aef527f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc66qmg\" (UID: \"d98b09ea-5fdc-4a6a-82ac-873d3aef527f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:38.982157 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:38.982090 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:39.005048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.005023 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:39.148041 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.148012 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg"] Jun 06 16:56:39.149800 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:56:39.149776 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98b09ea_5fdc_4a6a_82ac_873d3aef527f.slice/crio-31c3ad6482a268599c1680d2e64783aa6a2343f21de7de1f3cf9cdc96ce9f02f WatchSource:0}: Error finding container 31c3ad6482a268599c1680d2e64783aa6a2343f21de7de1f3cf9cdc96ce9f02f: Status 404 returned error can't find the container with id 31c3ad6482a268599c1680d2e64783aa6a2343f21de7de1f3cf9cdc96ce9f02f Jun 06 16:56:39.289843 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.289764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:39.561339 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.561268 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5f6689757f-95qmm"] Jun 06 16:56:39.564549 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.564525 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" Jun 06 16:56:39.567362 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.567340 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 16:56:39.567478 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.567344 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jpvwz\"" Jun 06 16:56:39.580026 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.580005 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f6689757f-95qmm"] Jun 06 16:56:39.610499 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.610468 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:56:39.687355 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.687330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/790c61be-bef8-4ed8-ae10-d3b54fb8273e-redirect-config\") pod \"dashboard-redirect-5f6689757f-95qmm\" (UID: \"790c61be-bef8-4ed8-ae10-d3b54fb8273e\") " pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" Jun 06 16:56:39.687490 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.687357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj96p\" (UniqueName: \"kubernetes.io/projected/790c61be-bef8-4ed8-ae10-d3b54fb8273e-kube-api-access-tj96p\") pod \"dashboard-redirect-5f6689757f-95qmm\" (UID: \"790c61be-bef8-4ed8-ae10-d3b54fb8273e\") " pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" Jun 06 16:56:39.731334 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.731311 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" event={"ID":"d98b09ea-5fdc-4a6a-82ac-873d3aef527f","Type":"ContainerStarted","Data":"31c3ad6482a268599c1680d2e64783aa6a2343f21de7de1f3cf9cdc96ce9f02f"} Jun 06 16:56:39.788580 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.788559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/790c61be-bef8-4ed8-ae10-d3b54fb8273e-redirect-config\") pod \"dashboard-redirect-5f6689757f-95qmm\" (UID: \"790c61be-bef8-4ed8-ae10-d3b54fb8273e\") " pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" Jun 06 16:56:39.788684 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.788585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj96p\" (UniqueName: \"kubernetes.io/projected/790c61be-bef8-4ed8-ae10-d3b54fb8273e-kube-api-access-tj96p\") pod \"dashboard-redirect-5f6689757f-95qmm\" (UID: \"790c61be-bef8-4ed8-ae10-d3b54fb8273e\") " pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" Jun 06 16:56:39.789194 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.789176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/790c61be-bef8-4ed8-ae10-d3b54fb8273e-redirect-config\") pod \"dashboard-redirect-5f6689757f-95qmm\" (UID: \"790c61be-bef8-4ed8-ae10-d3b54fb8273e\") " pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" Jun 06 16:56:39.805313 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.805286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj96p\" (UniqueName: \"kubernetes.io/projected/790c61be-bef8-4ed8-ae10-d3b54fb8273e-kube-api-access-tj96p\") pod \"dashboard-redirect-5f6689757f-95qmm\" (UID: \"790c61be-bef8-4ed8-ae10-d3b54fb8273e\") " pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" Jun 06 16:56:39.876110 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:39.876043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" Jun 06 16:56:40.050012 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:40.049976 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f6689757f-95qmm"] Jun 06 16:56:40.255341 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:56:40.255304 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790c61be_bef8_4ed8_ae10_d3b54fb8273e.slice/crio-02520fec561f908f819959079964f53afedc4bb03ccc73c18bf6b1bf56686cb0 WatchSource:0}: Error finding container 02520fec561f908f819959079964f53afedc4bb03ccc73c18bf6b1bf56686cb0: Status 404 returned error can't find the container with id 02520fec561f908f819959079964f53afedc4bb03ccc73c18bf6b1bf56686cb0 Jun 06 16:56:40.738469 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:40.738428 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" event={"ID":"790c61be-bef8-4ed8-ae10-d3b54fb8273e","Type":"ContainerStarted","Data":"02520fec561f908f819959079964f53afedc4bb03ccc73c18bf6b1bf56686cb0"} Jun 06 16:56:41.780940 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:41.780894 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 16:56:41.781244 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:41.780990 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 16:56:41.781244 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:41.781022 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 16:56:42.750359 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:42.750327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" event={"ID":"d98b09ea-5fdc-4a6a-82ac-873d3aef527f","Type":"ContainerStarted","Data":"3723f32c837af11f0557e4c8261331e7c05fbe72abfcf900061ae84359baf40b"} Jun 06 16:56:42.769197 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:42.769129 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" podStartSLOduration=2.141098225 podStartE2EDuration="4.769107994s" totalImagesPullingTime="2.628009769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:42.767849806 +0000 UTC m=+564.749324651" watchObservedRunningTime="2026-06-06 16:56:42.769107994 +0000 UTC m=+564.750582823" Jun 06 16:56:43.005238 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:43.005196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:43.010301 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:43.010280 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:43.756657 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:43.756623 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" event={"ID":"790c61be-bef8-4ed8-ae10-d3b54fb8273e","Type":"ContainerStarted","Data":"06a826b3338e2a20f678775767c7ae69cf894efb732db978b0212502720c76b6"} Jun 06 16:56:43.756872 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:43.756851 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:43.757700 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:43.757676 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc66qmg" Jun 06 16:56:43.772048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:43.772005 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5f6689757f-95qmm" podStartSLOduration=2.05325286 podStartE2EDuration="4.771990692s" totalImagesPullingTime="2.718737832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:43.771321582 +0000 UTC m=+565.752796406" watchObservedRunningTime="2026-06-06 16:56:43.771990692 +0000 UTC m=+565.753465516" Jun 06 16:56:45.796363 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:56:45.796332 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:04.927542 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:04.927506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:05.028972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.028943 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:05.036265 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.036239 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjwsc"] Jun 06 16:57:05.042735 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.042713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" Jun 06 16:57:05.045168 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.045145 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 16:57:05.045293 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.045150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lhv6n\"" Jun 06 16:57:05.045293 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.045198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 16:57:05.054468 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.054444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjwsc"] Jun 06 16:57:05.126067 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.126040 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:05.205928 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.205903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d54jt\" (UniqueName: \"kubernetes.io/projected/b9d6a649-558d-4fe4-846f-a71841561a9e-kube-api-access-d54jt\") pod \"kuadrant-operator-catalog-pjwsc\" (UID: \"b9d6a649-558d-4fe4-846f-a71841561a9e\") " pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" Jun 06 16:57:05.307178 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.307154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d54jt\" (UniqueName: \"kubernetes.io/projected/b9d6a649-558d-4fe4-846f-a71841561a9e-kube-api-access-d54jt\") pod \"kuadrant-operator-catalog-pjwsc\" (UID: \"b9d6a649-558d-4fe4-846f-a71841561a9e\") " pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" Jun 06 16:57:05.317831 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.317807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d54jt\" (UniqueName: \"kubernetes.io/projected/b9d6a649-558d-4fe4-846f-a71841561a9e-kube-api-access-d54jt\") pod \"kuadrant-operator-catalog-pjwsc\" (UID: \"b9d6a649-558d-4fe4-846f-a71841561a9e\") " pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" Jun 06 16:57:05.353859 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.353838 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" Jun 06 16:57:05.413559 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.413529 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjwsc"] Jun 06 16:57:05.482318 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.482295 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjwsc"] Jun 06 16:57:05.484889 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:05.484860 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d6a649_558d_4fe4_846f_a71841561a9e.slice/crio-91d3ffa8846efa59a0b7593d472a16a346523639f4faf43c3327e9d799729a5e WatchSource:0}: Error finding container 91d3ffa8846efa59a0b7593d472a16a346523639f4faf43c3327e9d799729a5e: Status 404 returned error can't find the container with id 91d3ffa8846efa59a0b7593d472a16a346523639f4faf43c3327e9d799729a5e Jun 06 16:57:05.617847 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.617820 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q7rnk"] Jun 06 16:57:05.622629 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.622614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:05.629206 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.629186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q7rnk"] Jun 06 16:57:05.812550 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.812488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5cc8\" (UniqueName: \"kubernetes.io/projected/212ac249-46c8-40f6-aec8-1768af5adbfd-kube-api-access-s5cc8\") pod \"kuadrant-operator-catalog-q7rnk\" (UID: \"212ac249-46c8-40f6-aec8-1768af5adbfd\") " pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:05.854724 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.854695 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" event={"ID":"b9d6a649-558d-4fe4-846f-a71841561a9e","Type":"ContainerStarted","Data":"91d3ffa8846efa59a0b7593d472a16a346523639f4faf43c3327e9d799729a5e"} Jun 06 16:57:05.913838 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.913811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5cc8\" (UniqueName: \"kubernetes.io/projected/212ac249-46c8-40f6-aec8-1768af5adbfd-kube-api-access-s5cc8\") pod \"kuadrant-operator-catalog-q7rnk\" (UID: \"212ac249-46c8-40f6-aec8-1768af5adbfd\") " pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:05.921277 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.921255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5cc8\" (UniqueName: \"kubernetes.io/projected/212ac249-46c8-40f6-aec8-1768af5adbfd-kube-api-access-s5cc8\") pod \"kuadrant-operator-catalog-q7rnk\" (UID: \"212ac249-46c8-40f6-aec8-1768af5adbfd\") " pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:05.933510 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:05.933479 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:06.059461 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:06.059435 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q7rnk"] Jun 06 16:57:06.062042 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:06.062017 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212ac249_46c8_40f6_aec8_1768af5adbfd.slice/crio-fa445b45747b60455c9d8c0f7307c537a5305f5ffbab19936c2e34e490248e5f WatchSource:0}: Error finding container fa445b45747b60455c9d8c0f7307c537a5305f5ffbab19936c2e34e490248e5f: Status 404 returned error can't find the container with id fa445b45747b60455c9d8c0f7307c537a5305f5ffbab19936c2e34e490248e5f Jun 06 16:57:06.861747 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:06.861713 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" event={"ID":"212ac249-46c8-40f6-aec8-1768af5adbfd","Type":"ContainerStarted","Data":"fa445b45747b60455c9d8c0f7307c537a5305f5ffbab19936c2e34e490248e5f"} Jun 06 16:57:07.869414 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:07.869221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" event={"ID":"212ac249-46c8-40f6-aec8-1768af5adbfd","Type":"ContainerStarted","Data":"3b32a0e7bac580a4c30de09f4add2418e3a93a33dab781899896e7f7cb53a7a1"} Jun 06 16:57:07.871500 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:07.871464 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" event={"ID":"b9d6a649-558d-4fe4-846f-a71841561a9e","Type":"ContainerStarted","Data":"e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a"} Jun 06 16:57:07.872015 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:07.871645 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" podUID="b9d6a649-558d-4fe4-846f-a71841561a9e" containerName="registry-server" containerID="cri-o://e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a" gracePeriod=2 Jun 06 16:57:07.885599 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:07.885277 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" podStartSLOduration=1.264338951 podStartE2EDuration="2.88525832s" totalImagesPullingTime="1.620919369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:57:07.882916597 +0000 UTC m=+589.864391423" watchObservedRunningTime="2026-06-06 16:57:07.88525832 +0000 UTC m=+589.866733138" Jun 06 16:57:07.897993 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:07.897948 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" podStartSLOduration=0.702548472 podStartE2EDuration="2.897932723s" totalImagesPullingTime="2.195384251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:57:07.895901641 +0000 UTC m=+589.877376466" watchObservedRunningTime="2026-06-06 16:57:07.897932723 +0000 UTC m=+589.879407551" Jun 06 16:57:08.110830 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.110810 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pjwsc_b9d6a649-558d-4fe4-846f-a71841561a9e/registry-server/0.log" Jun 06 16:57:08.112096 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.112079 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" Jun 06 16:57:08.136385 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.136362 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d54jt\" (UniqueName: \"kubernetes.io/projected/b9d6a649-558d-4fe4-846f-a71841561a9e-kube-api-access-d54jt\") pod \"b9d6a649-558d-4fe4-846f-a71841561a9e\" (UID: \"b9d6a649-558d-4fe4-846f-a71841561a9e\") " Jun 06 16:57:08.138462 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.138429 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9d6a649-558d-4fe4-846f-a71841561a9e-kube-api-access-d54jt" (OuterVolumeSpecName: "kube-api-access-d54jt") pod "b9d6a649-558d-4fe4-846f-a71841561a9e" (UID: "b9d6a649-558d-4fe4-846f-a71841561a9e"). InnerVolumeSpecName "kube-api-access-d54jt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:57:08.237189 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.237133 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d54jt\" (UniqueName: \"kubernetes.io/projected/b9d6a649-558d-4fe4-846f-a71841561a9e-kube-api-access-d54jt\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:08.879931 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.879866 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pjwsc_b9d6a649-558d-4fe4-846f-a71841561a9e/registry-server/0.log" Jun 06 16:57:08.879931 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.879905 2577 generic.go:356] "Generic (PLEG): container finished" podID="b9d6a649-558d-4fe4-846f-a71841561a9e" containerID="e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a" exitCode=1 Jun 06 16:57:08.880402 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.879953 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" Jun 06 16:57:08.880402 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.879991 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" event={"ID":"b9d6a649-558d-4fe4-846f-a71841561a9e","Type":"ContainerDied","Data":"e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a"} Jun 06 16:57:08.880402 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.880043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pjwsc" event={"ID":"b9d6a649-558d-4fe4-846f-a71841561a9e","Type":"ContainerDied","Data":"91d3ffa8846efa59a0b7593d472a16a346523639f4faf43c3327e9d799729a5e"} Jun 06 16:57:08.880402 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.880063 2577 scope.go:117] "RemoveContainer" containerID="e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a" Jun 06 16:57:08.888444 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.888428 2577 scope.go:117] "RemoveContainer" containerID="e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a" Jun 06 16:57:08.888667 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:57:08.888650 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a\": container with ID starting with e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a not found: ID does not exist" containerID="e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a" Jun 06 16:57:08.888720 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.888674 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a"} err="failed to get container status \"e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a\": rpc error: code = NotFound desc = could not find container \"e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a\": container with ID starting with e317cd1f1f4aae6dfb2ff4dbf5c8cfd21d9914c70c7ce84ae97e19e34fdd730a not found: ID does not exist" Jun 06 16:57:08.896613 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.896592 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjwsc"] Jun 06 16:57:08.900702 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:08.900685 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjwsc"] Jun 06 16:57:09.812174 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:09.812136 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:09.957285 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:09.957255 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:10.508046 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:10.508017 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9d6a649-558d-4fe4-846f-a71841561a9e" path="/var/lib/kubelet/pods/b9d6a649-558d-4fe4-846f-a71841561a9e/volumes" Jun 06 16:57:10.555940 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:10.555913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:10.656904 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:10.656877 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:15.934372 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:15.934340 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:15.934770 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:15.934398 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:15.956287 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:15.956263 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:16.945693 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:16.945660 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-q7rnk" Jun 06 16:57:18.503167 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:18.503140 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 16:57:18.504401 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:18.504378 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 16:57:20.443515 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.443483 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:20.544958 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.544921 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:20.581461 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.581437 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp"] Jun 06 16:57:20.581796 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.581784 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9d6a649-558d-4fe4-846f-a71841561a9e" containerName="registry-server" Jun 06 16:57:20.581838 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.581797 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9d6a649-558d-4fe4-846f-a71841561a9e" containerName="registry-server" Jun 06 16:57:20.581877 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.581854 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9d6a649-558d-4fe4-846f-a71841561a9e" containerName="registry-server" Jun 06 16:57:20.591679 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.591656 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.592078 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.592057 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp"] Jun 06 16:57:20.594143 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.594121 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tdj9d\"" Jun 06 16:57:20.598132 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.598109 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:20.645163 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.645137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-992mw\" (UniqueName: \"kubernetes.io/projected/999a7f3c-0137-4070-903a-53c3f5edf202-kube-api-access-992mw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.645271 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.645186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.645271 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.645247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.746061 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.746005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-992mw\" (UniqueName: \"kubernetes.io/projected/999a7f3c-0137-4070-903a-53c3f5edf202-kube-api-access-992mw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.746061 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.746053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.746197 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.746073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.746426 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.746410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.746472 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.746436 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.754318 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.754295 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-992mw\" (UniqueName: \"kubernetes.io/projected/999a7f3c-0137-4070-903a-53c3f5edf202-kube-api-access-992mw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:20.901566 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:20.901542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:21.027206 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.027179 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp"] Jun 06 16:57:21.029587 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:21.029558 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999a7f3c_0137_4070_903a_53c3f5edf202.slice/crio-6b5fe2393a9899f0193548c673f1904a640116592a06b929f638443a12e2b8bc WatchSource:0}: Error finding container 6b5fe2393a9899f0193548c673f1904a640116592a06b929f638443a12e2b8bc: Status 404 returned error can't find the container with id 6b5fe2393a9899f0193548c673f1904a640116592a06b929f638443a12e2b8bc Jun 06 16:57:21.182027 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.181997 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt"] Jun 06 16:57:21.185483 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.185468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.193767 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.193738 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt"] Jun 06 16:57:21.250998 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.250972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.251092 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.251003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-787t6\" (UniqueName: \"kubernetes.io/projected/1a803155-6070-4528-b4fc-ed151b38b4a0-kube-api-access-787t6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.251092 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.251027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.351886 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.351834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.351886 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.351868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-787t6\" (UniqueName: \"kubernetes.io/projected/1a803155-6070-4528-b4fc-ed151b38b4a0-kube-api-access-787t6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.352036 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.351899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.352200 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.352182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.352290 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.352265 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.359224 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.359198 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-787t6\" (UniqueName: \"kubernetes.io/projected/1a803155-6070-4528-b4fc-ed151b38b4a0-kube-api-access-787t6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.521180 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.521154 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:21.645336 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.645312 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt"] Jun 06 16:57:21.647180 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:21.647153 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a803155_6070_4528_b4fc_ed151b38b4a0.slice/crio-8916e375662396ae3c9cb06df308e233c8d77ba31adcb4e4d216fe602c2cb77f WatchSource:0}: Error finding container 8916e375662396ae3c9cb06df308e233c8d77ba31adcb4e4d216fe602c2cb77f: Status 404 returned error can't find the container with id 8916e375662396ae3c9cb06df308e233c8d77ba31adcb4e4d216fe602c2cb77f Jun 06 16:57:21.777240 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.777207 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl"] Jun 06 16:57:21.780961 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.780945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.787594 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.787569 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl"] Jun 06 16:57:21.856028 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.856004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.856131 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.856033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cctcx\" (UniqueName: \"kubernetes.io/projected/726dfc32-6afe-481d-9a44-93262f2335ec-kube-api-access-cctcx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.856131 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.856101 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.951335 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.951306 2577 generic.go:356] "Generic (PLEG): container finished" podID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerID="134c602cdfcfc5f062dbb51da66d5b2ded7912b3110d82d7b3dc3f891b1a28ea" exitCode=0 Jun 06 16:57:21.951452 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.951397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" event={"ID":"1a803155-6070-4528-b4fc-ed151b38b4a0","Type":"ContainerDied","Data":"134c602cdfcfc5f062dbb51da66d5b2ded7912b3110d82d7b3dc3f891b1a28ea"} Jun 06 16:57:21.951524 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.951449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" event={"ID":"1a803155-6070-4528-b4fc-ed151b38b4a0","Type":"ContainerStarted","Data":"8916e375662396ae3c9cb06df308e233c8d77ba31adcb4e4d216fe602c2cb77f"} Jun 06 16:57:21.953172 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.953147 2577 generic.go:356] "Generic (PLEG): container finished" podID="999a7f3c-0137-4070-903a-53c3f5edf202" containerID="9c02c08213400467b6bc33ae91e6317641f7ec17f847142579661c36576f4f9a" exitCode=0 Jun 06 16:57:21.953275 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.953254 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" event={"ID":"999a7f3c-0137-4070-903a-53c3f5edf202","Type":"ContainerDied","Data":"9c02c08213400467b6bc33ae91e6317641f7ec17f847142579661c36576f4f9a"} Jun 06 16:57:21.953330 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.953297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" event={"ID":"999a7f3c-0137-4070-903a-53c3f5edf202","Type":"ContainerStarted","Data":"6b5fe2393a9899f0193548c673f1904a640116592a06b929f638443a12e2b8bc"} Jun 06 16:57:21.957201 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.957183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.957306 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.957269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.957306 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.957290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cctcx\" (UniqueName: \"kubernetes.io/projected/726dfc32-6afe-481d-9a44-93262f2335ec-kube-api-access-cctcx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.957515 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.957497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.957631 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.957596 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:21.963901 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:21.963875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cctcx\" (UniqueName: \"kubernetes.io/projected/726dfc32-6afe-481d-9a44-93262f2335ec-kube-api-access-cctcx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:22.109361 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.109338 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:22.180979 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.180947 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2"] Jun 06 16:57:22.185749 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.185725 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.191723 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.191697 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2"] Jun 06 16:57:22.245661 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.245636 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl"] Jun 06 16:57:22.247964 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:22.247934 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726dfc32_6afe_481d_9a44_93262f2335ec.slice/crio-3f409092faf89ce4aeb926a93c6c67e1f53ae96044fb168721baeb4bd58c4da5 WatchSource:0}: Error finding container 3f409092faf89ce4aeb926a93c6c67e1f53ae96044fb168721baeb4bd58c4da5: Status 404 returned error can't find the container with id 3f409092faf89ce4aeb926a93c6c67e1f53ae96044fb168721baeb4bd58c4da5 Jun 06 16:57:22.260189 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.260164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.260308 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.260282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.260356 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.260326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d89r5\" (UniqueName: \"kubernetes.io/projected/dfde10e2-3aaa-4a45-9241-faca060a696e-kube-api-access-d89r5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.361346 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.361320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.361459 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.361397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.361459 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.361438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d89r5\" (UniqueName: \"kubernetes.io/projected/dfde10e2-3aaa-4a45-9241-faca060a696e-kube-api-access-d89r5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.361763 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.361740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.361846 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.361728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.369405 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.369386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d89r5\" (UniqueName: \"kubernetes.io/projected/dfde10e2-3aaa-4a45-9241-faca060a696e-kube-api-access-d89r5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.498110 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.498036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:22.751558 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.751536 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2"] Jun 06 16:57:22.766093 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:22.766064 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfde10e2_3aaa_4a45_9241_faca060a696e.slice/crio-e4823d4e83afe7bb5e71faa1b66f5da65b0bc3c2324ca9be4b8a6521778d95a9 WatchSource:0}: Error finding container e4823d4e83afe7bb5e71faa1b66f5da65b0bc3c2324ca9be4b8a6521778d95a9: Status 404 returned error can't find the container with id e4823d4e83afe7bb5e71faa1b66f5da65b0bc3c2324ca9be4b8a6521778d95a9 Jun 06 16:57:22.959396 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.959368 2577 generic.go:356] "Generic (PLEG): container finished" podID="726dfc32-6afe-481d-9a44-93262f2335ec" containerID="45e24603351d1a87f6c80c7c0c5d65fb727afeec9d1e2ab97e537d1190aeb2af" exitCode=0 Jun 06 16:57:22.959514 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.959453 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" event={"ID":"726dfc32-6afe-481d-9a44-93262f2335ec","Type":"ContainerDied","Data":"45e24603351d1a87f6c80c7c0c5d65fb727afeec9d1e2ab97e537d1190aeb2af"} Jun 06 16:57:22.959573 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.959522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" event={"ID":"726dfc32-6afe-481d-9a44-93262f2335ec","Type":"ContainerStarted","Data":"3f409092faf89ce4aeb926a93c6c67e1f53ae96044fb168721baeb4bd58c4da5"} Jun 06 16:57:22.961316 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.961292 2577 generic.go:356] "Generic (PLEG): container finished" podID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerID="acd0c835071ba6ec746e82da48e06c542ba408a8cb357a2fbb41c31ed5c01c12" exitCode=0 Jun 06 16:57:22.961418 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.961365 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" event={"ID":"1a803155-6070-4528-b4fc-ed151b38b4a0","Type":"ContainerDied","Data":"acd0c835071ba6ec746e82da48e06c542ba408a8cb357a2fbb41c31ed5c01c12"} Jun 06 16:57:22.963222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.963198 2577 generic.go:356] "Generic (PLEG): container finished" podID="999a7f3c-0137-4070-903a-53c3f5edf202" containerID="8578ef76fc1d018513db08e0941ed1a37705500fde8c5c2c084f3810584ca768" exitCode=0 Jun 06 16:57:22.963362 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.963224 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" event={"ID":"999a7f3c-0137-4070-903a-53c3f5edf202","Type":"ContainerDied","Data":"8578ef76fc1d018513db08e0941ed1a37705500fde8c5c2c084f3810584ca768"} Jun 06 16:57:22.964832 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.964812 2577 generic.go:356] "Generic (PLEG): container finished" podID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerID="58827b1f269ea653cf079056d852acf24a0850a468e5d854e445e8942b6707fc" exitCode=0 Jun 06 16:57:22.964883 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.964869 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" event={"ID":"dfde10e2-3aaa-4a45-9241-faca060a696e","Type":"ContainerDied","Data":"58827b1f269ea653cf079056d852acf24a0850a468e5d854e445e8942b6707fc"} Jun 06 16:57:22.964919 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:22.964908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" event={"ID":"dfde10e2-3aaa-4a45-9241-faca060a696e","Type":"ContainerStarted","Data":"e4823d4e83afe7bb5e71faa1b66f5da65b0bc3c2324ca9be4b8a6521778d95a9"} Jun 06 16:57:23.975527 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:23.975505 2577 generic.go:356] "Generic (PLEG): container finished" podID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerID="a09be836dab3261634b95d6c64a39201d8fdc642c5a3279ce6b35fee007c2a39" exitCode=0 Jun 06 16:57:23.975878 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:23.975587 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" event={"ID":"dfde10e2-3aaa-4a45-9241-faca060a696e","Type":"ContainerDied","Data":"a09be836dab3261634b95d6c64a39201d8fdc642c5a3279ce6b35fee007c2a39"} Jun 06 16:57:23.977492 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:23.977467 2577 generic.go:356] "Generic (PLEG): container finished" podID="726dfc32-6afe-481d-9a44-93262f2335ec" containerID="8a6e5105b81723490a8783b6fbac9a61ec2da473ced673a785ee49d341c1166a" exitCode=0 Jun 06 16:57:23.977580 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:23.977505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" event={"ID":"726dfc32-6afe-481d-9a44-93262f2335ec","Type":"ContainerDied","Data":"8a6e5105b81723490a8783b6fbac9a61ec2da473ced673a785ee49d341c1166a"} Jun 06 16:57:23.979742 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:23.979715 2577 generic.go:356] "Generic (PLEG): container finished" podID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerID="a2adb8a63b57f9ce65f7cb6abab93d18cf870d04b4c8e7f9809ecef7f671b057" exitCode=0 Jun 06 16:57:23.979846 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:23.979756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" event={"ID":"1a803155-6070-4528-b4fc-ed151b38b4a0","Type":"ContainerDied","Data":"a2adb8a63b57f9ce65f7cb6abab93d18cf870d04b4c8e7f9809ecef7f671b057"} Jun 06 16:57:23.982016 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:23.981997 2577 generic.go:356] "Generic (PLEG): container finished" podID="999a7f3c-0137-4070-903a-53c3f5edf202" containerID="65cb40534b06d30382c7bab9ef1d7afc9fb33a95bd37325b2c98d386dc1ed6e3" exitCode=0 Jun 06 16:57:23.982117 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:23.982021 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" event={"ID":"999a7f3c-0137-4070-903a-53c3f5edf202","Type":"ContainerDied","Data":"65cb40534b06d30382c7bab9ef1d7afc9fb33a95bd37325b2c98d386dc1ed6e3"} Jun 06 16:57:24.989297 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:24.989265 2577 generic.go:356] "Generic (PLEG): container finished" podID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerID="a7a1685b94b2c6cc9576102d80dfc5665f98ce115b18942684e410663398c11d" exitCode=0 Jun 06 16:57:24.989678 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:24.989319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" event={"ID":"dfde10e2-3aaa-4a45-9241-faca060a696e","Type":"ContainerDied","Data":"a7a1685b94b2c6cc9576102d80dfc5665f98ce115b18942684e410663398c11d"} Jun 06 16:57:24.991423 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:24.991398 2577 generic.go:356] "Generic (PLEG): container finished" podID="726dfc32-6afe-481d-9a44-93262f2335ec" containerID="69035131bf0bd227fe0f01d2a03950a54510dae9fb8da5982df48e24358ced87" exitCode=0 Jun 06 16:57:24.991530 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:24.991425 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" event={"ID":"726dfc32-6afe-481d-9a44-93262f2335ec","Type":"ContainerDied","Data":"69035131bf0bd227fe0f01d2a03950a54510dae9fb8da5982df48e24358ced87"} Jun 06 16:57:25.130467 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.130443 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:25.159076 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.159048 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:25.183098 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.183074 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-util\") pod \"1a803155-6070-4528-b4fc-ed151b38b4a0\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " Jun 06 16:57:25.183221 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.183121 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-bundle\") pod \"1a803155-6070-4528-b4fc-ed151b38b4a0\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " Jun 06 16:57:25.183221 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.183193 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-787t6\" (UniqueName: \"kubernetes.io/projected/1a803155-6070-4528-b4fc-ed151b38b4a0-kube-api-access-787t6\") pod \"1a803155-6070-4528-b4fc-ed151b38b4a0\" (UID: \"1a803155-6070-4528-b4fc-ed151b38b4a0\") " Jun 06 16:57:25.183652 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.183622 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-bundle" (OuterVolumeSpecName: "bundle") pod "1a803155-6070-4528-b4fc-ed151b38b4a0" (UID: "1a803155-6070-4528-b4fc-ed151b38b4a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:57:25.185350 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.185320 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a803155-6070-4528-b4fc-ed151b38b4a0-kube-api-access-787t6" (OuterVolumeSpecName: "kube-api-access-787t6") pod "1a803155-6070-4528-b4fc-ed151b38b4a0" (UID: "1a803155-6070-4528-b4fc-ed151b38b4a0"). InnerVolumeSpecName "kube-api-access-787t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:57:25.188578 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.188560 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-util" (OuterVolumeSpecName: "util") pod "1a803155-6070-4528-b4fc-ed151b38b4a0" (UID: "1a803155-6070-4528-b4fc-ed151b38b4a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:57:25.283879 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.283843 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-util\") pod \"999a7f3c-0137-4070-903a-53c3f5edf202\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " Jun 06 16:57:25.283974 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.283893 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-992mw\" (UniqueName: \"kubernetes.io/projected/999a7f3c-0137-4070-903a-53c3f5edf202-kube-api-access-992mw\") pod \"999a7f3c-0137-4070-903a-53c3f5edf202\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " Jun 06 16:57:25.283974 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.283942 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-bundle\") pod \"999a7f3c-0137-4070-903a-53c3f5edf202\" (UID: \"999a7f3c-0137-4070-903a-53c3f5edf202\") " Jun 06 16:57:25.284095 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.284080 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-787t6\" (UniqueName: \"kubernetes.io/projected/1a803155-6070-4528-b4fc-ed151b38b4a0-kube-api-access-787t6\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:25.284136 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.284100 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-util\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:25.284136 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.284117 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a803155-6070-4528-b4fc-ed151b38b4a0-bundle\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:25.284453 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.284423 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-bundle" (OuterVolumeSpecName: "bundle") pod "999a7f3c-0137-4070-903a-53c3f5edf202" (UID: "999a7f3c-0137-4070-903a-53c3f5edf202"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:57:25.285831 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.285810 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999a7f3c-0137-4070-903a-53c3f5edf202-kube-api-access-992mw" (OuterVolumeSpecName: "kube-api-access-992mw") pod "999a7f3c-0137-4070-903a-53c3f5edf202" (UID: "999a7f3c-0137-4070-903a-53c3f5edf202"). InnerVolumeSpecName "kube-api-access-992mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:57:25.288545 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.288525 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-util" (OuterVolumeSpecName: "util") pod "999a7f3c-0137-4070-903a-53c3f5edf202" (UID: "999a7f3c-0137-4070-903a-53c3f5edf202"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:57:25.385565 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.385492 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-bundle\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:25.385565 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.385527 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/999a7f3c-0137-4070-903a-53c3f5edf202-util\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:25.385565 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.385537 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-992mw\" (UniqueName: \"kubernetes.io/projected/999a7f3c-0137-4070-903a-53c3f5edf202-kube-api-access-992mw\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:25.997893 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.997865 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" Jun 06 16:57:25.998283 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.997894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp" event={"ID":"999a7f3c-0137-4070-903a-53c3f5edf202","Type":"ContainerDied","Data":"6b5fe2393a9899f0193548c673f1904a640116592a06b929f638443a12e2b8bc"} Jun 06 16:57:25.998283 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.997940 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b5fe2393a9899f0193548c673f1904a640116592a06b929f638443a12e2b8bc" Jun 06 16:57:25.999806 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.999779 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" Jun 06 16:57:25.999908 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.999811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt" event={"ID":"1a803155-6070-4528-b4fc-ed151b38b4a0","Type":"ContainerDied","Data":"8916e375662396ae3c9cb06df308e233c8d77ba31adcb4e4d216fe602c2cb77f"} Jun 06 16:57:25.999908 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:25.999850 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8916e375662396ae3c9cb06df308e233c8d77ba31adcb4e4d216fe602c2cb77f" Jun 06 16:57:26.142097 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.141919 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:26.151680 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.151660 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:26.192375 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.192337 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-util\") pod \"dfde10e2-3aaa-4a45-9241-faca060a696e\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " Jun 06 16:57:26.192547 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.192394 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-bundle\") pod \"726dfc32-6afe-481d-9a44-93262f2335ec\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " Jun 06 16:57:26.192547 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.192458 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-util\") pod \"726dfc32-6afe-481d-9a44-93262f2335ec\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " Jun 06 16:57:26.192547 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.192519 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cctcx\" (UniqueName: \"kubernetes.io/projected/726dfc32-6afe-481d-9a44-93262f2335ec-kube-api-access-cctcx\") pod \"726dfc32-6afe-481d-9a44-93262f2335ec\" (UID: \"726dfc32-6afe-481d-9a44-93262f2335ec\") " Jun 06 16:57:26.192734 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.192549 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d89r5\" (UniqueName: \"kubernetes.io/projected/dfde10e2-3aaa-4a45-9241-faca060a696e-kube-api-access-d89r5\") pod \"dfde10e2-3aaa-4a45-9241-faca060a696e\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " Jun 06 16:57:26.192734 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.192577 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-bundle\") pod \"dfde10e2-3aaa-4a45-9241-faca060a696e\" (UID: \"dfde10e2-3aaa-4a45-9241-faca060a696e\") " Jun 06 16:57:26.193380 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.193350 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-bundle" (OuterVolumeSpecName: "bundle") pod "dfde10e2-3aaa-4a45-9241-faca060a696e" (UID: "dfde10e2-3aaa-4a45-9241-faca060a696e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:57:26.193587 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.193561 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-bundle" (OuterVolumeSpecName: "bundle") pod "726dfc32-6afe-481d-9a44-93262f2335ec" (UID: "726dfc32-6afe-481d-9a44-93262f2335ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:57:26.195527 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.195501 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726dfc32-6afe-481d-9a44-93262f2335ec-kube-api-access-cctcx" (OuterVolumeSpecName: "kube-api-access-cctcx") pod "726dfc32-6afe-481d-9a44-93262f2335ec" (UID: "726dfc32-6afe-481d-9a44-93262f2335ec"). InnerVolumeSpecName "kube-api-access-cctcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:57:26.195665 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.195649 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfde10e2-3aaa-4a45-9241-faca060a696e-kube-api-access-d89r5" (OuterVolumeSpecName: "kube-api-access-d89r5") pod "dfde10e2-3aaa-4a45-9241-faca060a696e" (UID: "dfde10e2-3aaa-4a45-9241-faca060a696e"). InnerVolumeSpecName "kube-api-access-d89r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:57:26.198894 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.198869 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-util" (OuterVolumeSpecName: "util") pod "726dfc32-6afe-481d-9a44-93262f2335ec" (UID: "726dfc32-6afe-481d-9a44-93262f2335ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:57:26.200181 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.200153 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-util" (OuterVolumeSpecName: "util") pod "dfde10e2-3aaa-4a45-9241-faca060a696e" (UID: "dfde10e2-3aaa-4a45-9241-faca060a696e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:57:26.294149 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.294116 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-bundle\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:26.294149 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.294142 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726dfc32-6afe-481d-9a44-93262f2335ec-util\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:26.294149 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.294152 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cctcx\" (UniqueName: \"kubernetes.io/projected/726dfc32-6afe-481d-9a44-93262f2335ec-kube-api-access-cctcx\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:26.294405 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.294162 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d89r5\" (UniqueName: \"kubernetes.io/projected/dfde10e2-3aaa-4a45-9241-faca060a696e-kube-api-access-d89r5\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:26.294405 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.294172 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-bundle\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:26.294405 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:26.294180 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfde10e2-3aaa-4a45-9241-faca060a696e-util\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:57:27.006422 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:27.006393 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" Jun 06 16:57:27.006422 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:27.006410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2" event={"ID":"dfde10e2-3aaa-4a45-9241-faca060a696e","Type":"ContainerDied","Data":"e4823d4e83afe7bb5e71faa1b66f5da65b0bc3c2324ca9be4b8a6521778d95a9"} Jun 06 16:57:27.006942 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:27.006465 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4823d4e83afe7bb5e71faa1b66f5da65b0bc3c2324ca9be4b8a6521778d95a9" Jun 06 16:57:27.008400 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:27.008379 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" event={"ID":"726dfc32-6afe-481d-9a44-93262f2335ec","Type":"ContainerDied","Data":"3f409092faf89ce4aeb926a93c6c67e1f53ae96044fb168721baeb4bd58c4da5"} Jun 06 16:57:27.008510 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:27.008411 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f409092faf89ce4aeb926a93c6c67e1f53ae96044fb168721baeb4bd58c4da5" Jun 06 16:57:27.008510 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:27.008430 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl" Jun 06 16:57:28.841092 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:28.841059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:31.056612 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056571 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f"] Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056918 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerName="extract" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056930 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerName="extract" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056941 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="999a7f3c-0137-4070-903a-53c3f5edf202" containerName="extract" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056946 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="999a7f3c-0137-4070-903a-53c3f5edf202" containerName="extract" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056956 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726dfc32-6afe-481d-9a44-93262f2335ec" containerName="util" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056961 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="726dfc32-6afe-481d-9a44-93262f2335ec" containerName="util" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056971 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="999a7f3c-0137-4070-903a-53c3f5edf202" containerName="util" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056977 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="999a7f3c-0137-4070-903a-53c3f5edf202" containerName="util" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056985 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerName="pull" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056990 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerName="pull" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.056997 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerName="util" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057004 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerName="util" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057010 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726dfc32-6afe-481d-9a44-93262f2335ec" containerName="pull" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057014 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="726dfc32-6afe-481d-9a44-93262f2335ec" containerName="pull" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057019 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerName="extract" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057024 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerName="extract" Jun 06 16:57:31.057024 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057032 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726dfc32-6afe-481d-9a44-93262f2335ec" containerName="extract" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057037 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="726dfc32-6afe-481d-9a44-93262f2335ec" containerName="extract" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057044 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerName="util" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057048 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerName="util" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057054 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerName="pull" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057058 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerName="pull" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057065 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="999a7f3c-0137-4070-903a-53c3f5edf202" containerName="pull" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057069 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="999a7f3c-0137-4070-903a-53c3f5edf202" containerName="pull" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057121 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a803155-6070-4528-b4fc-ed151b38b4a0" containerName="extract" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057131 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="999a7f3c-0137-4070-903a-53c3f5edf202" containerName="extract" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057139 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfde10e2-3aaa-4a45-9241-faca060a696e" containerName="extract" Jun 06 16:57:31.057592 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.057145 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="726dfc32-6afe-481d-9a44-93262f2335ec" containerName="extract" Jun 06 16:57:31.061329 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.061312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" Jun 06 16:57:31.063430 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.063408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 06 16:57:31.063552 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.063456 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-h8sgh\"" Jun 06 16:57:31.070419 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.070400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f"] Jun 06 16:57:31.133583 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.133552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vjzh\" (UniqueName: \"kubernetes.io/projected/5dd6271f-de03-4ed3-944a-731ca9cca99d-kube-api-access-9vjzh\") pod \"dns-operator-controller-manager-864dd78c4c-6w78f\" (UID: \"5dd6271f-de03-4ed3-944a-731ca9cca99d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" Jun 06 16:57:31.234026 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.233993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vjzh\" (UniqueName: \"kubernetes.io/projected/5dd6271f-de03-4ed3-944a-731ca9cca99d-kube-api-access-9vjzh\") pod \"dns-operator-controller-manager-864dd78c4c-6w78f\" (UID: \"5dd6271f-de03-4ed3-944a-731ca9cca99d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" Jun 06 16:57:31.242887 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.242860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vjzh\" (UniqueName: \"kubernetes.io/projected/5dd6271f-de03-4ed3-944a-731ca9cca99d-kube-api-access-9vjzh\") pod \"dns-operator-controller-manager-864dd78c4c-6w78f\" (UID: \"5dd6271f-de03-4ed3-944a-731ca9cca99d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" Jun 06 16:57:31.372016 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.371933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" Jun 06 16:57:31.505278 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:31.505245 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f"] Jun 06 16:57:31.506594 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:31.506567 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd6271f_de03_4ed3_944a_731ca9cca99d.slice/crio-478ec39bfd143a9c480cdaa27864759b85ab90215319297efba260ddb8045047 WatchSource:0}: Error finding container 478ec39bfd143a9c480cdaa27864759b85ab90215319297efba260ddb8045047: Status 404 returned error can't find the container with id 478ec39bfd143a9c480cdaa27864759b85ab90215319297efba260ddb8045047 Jun 06 16:57:32.034793 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:32.034763 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" event={"ID":"5dd6271f-de03-4ed3-944a-731ca9cca99d","Type":"ContainerStarted","Data":"478ec39bfd143a9c480cdaa27864759b85ab90215319297efba260ddb8045047"} Jun 06 16:57:32.245598 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:32.245566 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:34.046044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:34.046003 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" event={"ID":"5dd6271f-de03-4ed3-944a-731ca9cca99d","Type":"ContainerStarted","Data":"e31cba63415f9c003c03e1d8682053b0f3f0a6c1f67afbe39c763df152631545"} Jun 06 16:57:34.046408 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:34.046158 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" Jun 06 16:57:34.066115 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:34.066070 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" podStartSLOduration=0.998918315 podStartE2EDuration="3.066056482s" totalImagesPullingTime="2.067138167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:57:34.063950117 +0000 UTC m=+616.045424966" watchObservedRunningTime="2026-06-06 16:57:34.066056482 +0000 UTC m=+616.047531307" Jun 06 16:57:37.940034 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:37.940004 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4"] Jun 06 16:57:37.946916 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:37.946896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:37.950007 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:37.949987 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w554p\"" Jun 06 16:57:37.957101 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:37.957080 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4"] Jun 06 16:57:38.093079 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.093054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30005401-0b60-43fd-b242-2069081b350d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" (UID: \"30005401-0b60-43fd-b242-2069081b350d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:38.093203 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.093183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jhsn\" (UniqueName: \"kubernetes.io/projected/30005401-0b60-43fd-b242-2069081b350d-kube-api-access-2jhsn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" (UID: \"30005401-0b60-43fd-b242-2069081b350d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:38.194472 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.194391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jhsn\" (UniqueName: \"kubernetes.io/projected/30005401-0b60-43fd-b242-2069081b350d-kube-api-access-2jhsn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" (UID: \"30005401-0b60-43fd-b242-2069081b350d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:38.194472 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.194425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30005401-0b60-43fd-b242-2069081b350d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" (UID: \"30005401-0b60-43fd-b242-2069081b350d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:38.194804 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.194787 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30005401-0b60-43fd-b242-2069081b350d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" (UID: \"30005401-0b60-43fd-b242-2069081b350d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:38.206803 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.206778 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jhsn\" (UniqueName: \"kubernetes.io/projected/30005401-0b60-43fd-b242-2069081b350d-kube-api-access-2jhsn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" (UID: \"30005401-0b60-43fd-b242-2069081b350d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:38.258759 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.258736 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:38.389450 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.389423 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4"] Jun 06 16:57:38.391338 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:38.391309 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30005401_0b60_43fd_b242_2069081b350d.slice/crio-f21ca5da8ba652f06952720c3c7fbfd90668329c89ce12e2a842d253af54d1cf WatchSource:0}: Error finding container f21ca5da8ba652f06952720c3c7fbfd90668329c89ce12e2a842d253af54d1cf: Status 404 returned error can't find the container with id f21ca5da8ba652f06952720c3c7fbfd90668329c89ce12e2a842d253af54d1cf Jun 06 16:57:38.628287 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:38.628195 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:39.073769 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:39.073727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" event={"ID":"30005401-0b60-43fd-b242-2069081b350d","Type":"ContainerStarted","Data":"f21ca5da8ba652f06952720c3c7fbfd90668329c89ce12e2a842d253af54d1cf"} Jun 06 16:57:39.444068 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:39.444030 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:42.455712 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.455675 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb"] Jun 06 16:57:42.462523 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.462492 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" Jun 06 16:57:42.466304 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.466094 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xjcgw\"" Jun 06 16:57:42.468358 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.468299 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb"] Jun 06 16:57:42.534138 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.534113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84895\" (UniqueName: \"kubernetes.io/projected/f675d2bc-9499-46b8-8b1c-3d6a20ae2588-kube-api-access-84895\") pod \"authorino-operator-75cc8d5cb7-cdlwb\" (UID: \"f675d2bc-9499-46b8-8b1c-3d6a20ae2588\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" Jun 06 16:57:42.635207 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.635172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84895\" (UniqueName: \"kubernetes.io/projected/f675d2bc-9499-46b8-8b1c-3d6a20ae2588-kube-api-access-84895\") pod \"authorino-operator-75cc8d5cb7-cdlwb\" (UID: \"f675d2bc-9499-46b8-8b1c-3d6a20ae2588\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" Jun 06 16:57:42.646198 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.646173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84895\" (UniqueName: \"kubernetes.io/projected/f675d2bc-9499-46b8-8b1c-3d6a20ae2588-kube-api-access-84895\") pod \"authorino-operator-75cc8d5cb7-cdlwb\" (UID: \"f675d2bc-9499-46b8-8b1c-3d6a20ae2588\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" Jun 06 16:57:42.776869 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.776780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" Jun 06 16:57:42.937079 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:42.937055 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb"] Jun 06 16:57:42.938734 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:42.938709 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf675d2bc_9499_46b8_8b1c_3d6a20ae2588.slice/crio-601d38d4d4917c922eaa029f4a01f2f822850e7f4ac0efbf61c1153a0459f366 WatchSource:0}: Error finding container 601d38d4d4917c922eaa029f4a01f2f822850e7f4ac0efbf61c1153a0459f366: Status 404 returned error can't find the container with id 601d38d4d4917c922eaa029f4a01f2f822850e7f4ac0efbf61c1153a0459f366 Jun 06 16:57:43.097539 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:43.097456 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" event={"ID":"30005401-0b60-43fd-b242-2069081b350d","Type":"ContainerStarted","Data":"c4e21eb6a50ebac61269c346a049224d88dc4a4c7cca7b61e5f9e635cbf1a938"} Jun 06 16:57:43.097739 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:43.097644 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:43.098873 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:43.098849 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" event={"ID":"f675d2bc-9499-46b8-8b1c-3d6a20ae2588","Type":"ContainerStarted","Data":"601d38d4d4917c922eaa029f4a01f2f822850e7f4ac0efbf61c1153a0459f366"} Jun 06 16:57:43.116573 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:43.116533 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" podStartSLOduration=1.634842902 podStartE2EDuration="6.116520484s" totalImagesPullingTime="4.481677582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:57:43.114291452 +0000 UTC m=+625.095766278" watchObservedRunningTime="2026-06-06 16:57:43.116520484 +0000 UTC m=+625.097995308" Jun 06 16:57:43.830483 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:43.830449 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:45.053721 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.053685 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6w78f" Jun 06 16:57:45.065499 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.065445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:45.791220 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.791181 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx"] Jun 06 16:57:45.800389 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.800361 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:45.801148 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.801077 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:45.802658 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.802631 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx"] Jun 06 16:57:45.803329 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.803300 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 06 16:57:45.803329 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.803313 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 06 16:57:45.803485 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.803406 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tdj9d\"" Jun 06 16:57:45.956956 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.956917 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:45.966076 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.966046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b94f911-6c09-4656-8d77-b99efafd036a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:45.966264 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.966126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgnnp\" (UniqueName: \"kubernetes.io/projected/9b94f911-6c09-4656-8d77-b99efafd036a-kube-api-access-pgnnp\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:45.966264 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:45.966160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b94f911-6c09-4656-8d77-b99efafd036a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:46.067078 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:46.066983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b94f911-6c09-4656-8d77-b99efafd036a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:46.067535 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:46.067074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgnnp\" (UniqueName: \"kubernetes.io/projected/9b94f911-6c09-4656-8d77-b99efafd036a-kube-api-access-pgnnp\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:46.067535 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:46.067118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b94f911-6c09-4656-8d77-b99efafd036a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:46.067860 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:46.067836 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b94f911-6c09-4656-8d77-b99efafd036a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:46.069750 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:46.069731 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b94f911-6c09-4656-8d77-b99efafd036a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:46.074655 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:46.074631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgnnp\" (UniqueName: \"kubernetes.io/projected/9b94f911-6c09-4656-8d77-b99efafd036a-kube-api-access-pgnnp\") pod \"kuadrant-console-plugin-66b5774985-mdrwx\" (UID: \"9b94f911-6c09-4656-8d77-b99efafd036a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:46.113901 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:46.113870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" Jun 06 16:57:46.614844 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:46.614821 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx"] Jun 06 16:57:46.616408 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:57:46.616382 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b94f911_6c09_4656_8d77_b99efafd036a.slice/crio-453c4b8664565c4493c6ea31f0a2d6d6cabc90d2ee6fb70dd9c471360a168dcc WatchSource:0}: Error finding container 453c4b8664565c4493c6ea31f0a2d6d6cabc90d2ee6fb70dd9c471360a168dcc: Status 404 returned error can't find the container with id 453c4b8664565c4493c6ea31f0a2d6d6cabc90d2ee6fb70dd9c471360a168dcc Jun 06 16:57:47.125273 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:47.125218 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" event={"ID":"9b94f911-6c09-4656-8d77-b99efafd036a","Type":"ContainerStarted","Data":"453c4b8664565c4493c6ea31f0a2d6d6cabc90d2ee6fb70dd9c471360a168dcc"} Jun 06 16:57:47.126665 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:47.126643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" event={"ID":"f675d2bc-9499-46b8-8b1c-3d6a20ae2588","Type":"ContainerStarted","Data":"16ef3d99e0bb96fcd690f376ef06185abf211bbacd752452111e9a2e5f39783b"} Jun 06 16:57:47.126787 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:47.126768 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" Jun 06 16:57:47.144526 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:47.144485 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" podStartSLOduration=1.5485592320000001 podStartE2EDuration="5.144472551s" totalImagesPullingTime="3.595913319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:57:47.141628189 +0000 UTC m=+629.123103014" watchObservedRunningTime="2026-06-06 16:57:47.144472551 +0000 UTC m=+629.125947376" Jun 06 16:57:47.276466 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:47.276437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:49.081066 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:49.081029 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:49.326171 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:49.326114 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:49.407968 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:49.407878 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:51.272091 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:51.272028 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:53.434457 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:53.434422 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:53.537972 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:53.537937 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:54.108512 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:54.108470 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:54.266696 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:54.266661 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:54.366794 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:54.366706 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:57:55.399780 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.399744 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq"] Jun 06 16:57:55.411325 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.411291 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:57:55.418624 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.418588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq"] Jun 06 16:57:55.556166 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.556125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbtd9\" (UniqueName: \"kubernetes.io/projected/2fdfc517-459f-4145-868e-fb00d3569254-kube-api-access-cbtd9\") pod \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" (UID: \"2fdfc517-459f-4145-868e-fb00d3569254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:57:55.556381 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.556204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fdfc517-459f-4145-868e-fb00d3569254-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" (UID: \"2fdfc517-459f-4145-868e-fb00d3569254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:57:55.657352 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.657256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fdfc517-459f-4145-868e-fb00d3569254-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" (UID: \"2fdfc517-459f-4145-868e-fb00d3569254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:57:55.657534 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.657413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbtd9\" (UniqueName: \"kubernetes.io/projected/2fdfc517-459f-4145-868e-fb00d3569254-kube-api-access-cbtd9\") pod \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" (UID: \"2fdfc517-459f-4145-868e-fb00d3569254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:57:55.657741 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.657683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fdfc517-459f-4145-868e-fb00d3569254-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" (UID: \"2fdfc517-459f-4145-868e-fb00d3569254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:57:55.665940 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.665913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbtd9\" (UniqueName: \"kubernetes.io/projected/2fdfc517-459f-4145-868e-fb00d3569254-kube-api-access-cbtd9\") pod \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" (UID: \"2fdfc517-459f-4145-868e-fb00d3569254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:57:55.725123 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.725087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:57:55.805641 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.805606 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq"] Jun 06 16:57:55.820414 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.820376 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq"] Jun 06 16:57:55.831431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.831393 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t"] Jun 06 16:57:55.836968 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.836938 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4"] Jun 06 16:57:55.837128 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.837099 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:57:55.837462 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.837207 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" podUID="30005401-0b60-43fd-b242-2069081b350d" containerName="manager" containerID="cri-o://c4e21eb6a50ebac61269c346a049224d88dc4a4c7cca7b61e5f9e635cbf1a938" gracePeriod=2 Jun 06 16:57:55.848075 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.848032 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4"] Jun 06 16:57:55.849942 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.849763 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t"] Jun 06 16:57:55.859340 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.859316 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp"] Jun 06 16:57:55.860048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.859909 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30005401-0b60-43fd-b242-2069081b350d" containerName="manager" Jun 06 16:57:55.860048 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.859947 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="30005401-0b60-43fd-b242-2069081b350d" containerName="manager" Jun 06 16:57:55.860214 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.860073 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="30005401-0b60-43fd-b242-2069081b350d" containerName="manager" Jun 06 16:57:55.865034 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.865014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:57:55.873764 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.873698 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp"] Jun 06 16:57:55.902468 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:57:55.902425 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="30005401-0b60-43fd-b242-2069081b350d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:57:55.961141 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.960785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb718a5-6469-45e8-8634-80f502a3334a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9bwjp\" (UID: \"4eb718a5-6469-45e8-8634-80f502a3334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:57:55.961141 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.960902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ad00f4-6558-41f0-9d98-50f671625ff4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xhk7t\" (UID: \"05ad00f4-6558-41f0-9d98-50f671625ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:57:55.961141 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.960943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2lj2\" (UniqueName: \"kubernetes.io/projected/05ad00f4-6558-41f0-9d98-50f671625ff4-kube-api-access-q2lj2\") pod \"kuadrant-operator-controller-manager-55467d9f7-xhk7t\" (UID: \"05ad00f4-6558-41f0-9d98-50f671625ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:57:55.961141 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:55.960997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrc7\" (UniqueName: \"kubernetes.io/projected/4eb718a5-6469-45e8-8634-80f502a3334a-kube-api-access-8zrc7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9bwjp\" (UID: \"4eb718a5-6469-45e8-8634-80f502a3334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:57:56.061520 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.061486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ad00f4-6558-41f0-9d98-50f671625ff4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xhk7t\" (UID: \"05ad00f4-6558-41f0-9d98-50f671625ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:57:56.061722 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.061541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2lj2\" (UniqueName: \"kubernetes.io/projected/05ad00f4-6558-41f0-9d98-50f671625ff4-kube-api-access-q2lj2\") pod \"kuadrant-operator-controller-manager-55467d9f7-xhk7t\" (UID: \"05ad00f4-6558-41f0-9d98-50f671625ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:57:56.061722 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.061597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrc7\" (UniqueName: \"kubernetes.io/projected/4eb718a5-6469-45e8-8634-80f502a3334a-kube-api-access-8zrc7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9bwjp\" (UID: \"4eb718a5-6469-45e8-8634-80f502a3334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:57:56.061722 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.061634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb718a5-6469-45e8-8634-80f502a3334a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9bwjp\" (UID: \"4eb718a5-6469-45e8-8634-80f502a3334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:57:56.062107 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.062083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ad00f4-6558-41f0-9d98-50f671625ff4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xhk7t\" (UID: \"05ad00f4-6558-41f0-9d98-50f671625ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:57:56.062257 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.062083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb718a5-6469-45e8-8634-80f502a3334a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9bwjp\" (UID: \"4eb718a5-6469-45e8-8634-80f502a3334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:57:56.075799 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.075764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrc7\" (UniqueName: \"kubernetes.io/projected/4eb718a5-6469-45e8-8634-80f502a3334a-kube-api-access-8zrc7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9bwjp\" (UID: \"4eb718a5-6469-45e8-8634-80f502a3334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:57:56.076463 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.076442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2lj2\" (UniqueName: \"kubernetes.io/projected/05ad00f4-6558-41f0-9d98-50f671625ff4-kube-api-access-q2lj2\") pod \"kuadrant-operator-controller-manager-55467d9f7-xhk7t\" (UID: \"05ad00f4-6558-41f0-9d98-50f671625ff4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:57:56.157864 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.157821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:57:56.212843 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:56.212755 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:57:58.135762 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:57:58.135690 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdlwb" Jun 06 16:58:03.247834 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:03.247778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:03.343002 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:03.342963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:03.442008 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:03.441971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:06.245050 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:06.245007 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:06.346419 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:06.346373 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:08.819995 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:08.819961 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:08.921996 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:08.921966 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:09.269930 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.269822 2577 generic.go:356] "Generic (PLEG): container finished" podID="30005401-0b60-43fd-b242-2069081b350d" containerID="c4e21eb6a50ebac61269c346a049224d88dc4a4c7cca7b61e5f9e635cbf1a938" exitCode=0 Jun 06 16:58:09.299769 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.299748 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:58:09.302544 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.302199 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t"] Jun 06 16:58:09.302788 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:09.302601 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="30005401-0b60-43fd-b242-2069081b350d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:58:09.303509 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:58:09.303488 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ad00f4_6558_41f0_9d98_50f671625ff4.slice/crio-2571b1ff0634612ecc6ff790887a6268e596f9ad02eae0346446f229f81bc41b WatchSource:0}: Error finding container 2571b1ff0634612ecc6ff790887a6268e596f9ad02eae0346446f229f81bc41b: Status 404 returned error can't find the container with id 2571b1ff0634612ecc6ff790887a6268e596f9ad02eae0346446f229f81bc41b Jun 06 16:58:09.321038 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.321014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp"] Jun 06 16:58:09.324364 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:58:09.324339 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb718a5_6469_45e8_8634_80f502a3334a.slice/crio-e8887347e64be3cdc149515fba98919657dab43952a313fe3a8706dc38b89c0f WatchSource:0}: Error finding container e8887347e64be3cdc149515fba98919657dab43952a313fe3a8706dc38b89c0f: Status 404 returned error can't find the container with id e8887347e64be3cdc149515fba98919657dab43952a313fe3a8706dc38b89c0f Jun 06 16:58:09.390248 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.390211 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jhsn\" (UniqueName: \"kubernetes.io/projected/30005401-0b60-43fd-b242-2069081b350d-kube-api-access-2jhsn\") pod \"30005401-0b60-43fd-b242-2069081b350d\" (UID: \"30005401-0b60-43fd-b242-2069081b350d\") " Jun 06 16:58:09.390344 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.390333 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30005401-0b60-43fd-b242-2069081b350d-extensions-socket-volume\") pod \"30005401-0b60-43fd-b242-2069081b350d\" (UID: \"30005401-0b60-43fd-b242-2069081b350d\") " Jun 06 16:58:09.390755 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.390733 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30005401-0b60-43fd-b242-2069081b350d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "30005401-0b60-43fd-b242-2069081b350d" (UID: "30005401-0b60-43fd-b242-2069081b350d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:58:09.391893 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.391868 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30005401-0b60-43fd-b242-2069081b350d-kube-api-access-2jhsn" (OuterVolumeSpecName: "kube-api-access-2jhsn") pod "30005401-0b60-43fd-b242-2069081b350d" (UID: "30005401-0b60-43fd-b242-2069081b350d"). InnerVolumeSpecName "kube-api-access-2jhsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:58:09.491823 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.491783 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jhsn\" (UniqueName: \"kubernetes.io/projected/30005401-0b60-43fd-b242-2069081b350d-kube-api-access-2jhsn\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:58:09.491823 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:09.491820 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30005401-0b60-43fd-b242-2069081b350d-extensions-socket-volume\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:58:10.276637 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.276607 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:58:10.277039 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.276622 2577 scope.go:117] "RemoveContainer" containerID="c4e21eb6a50ebac61269c346a049224d88dc4a4c7cca7b61e5f9e635cbf1a938" Jun 06 16:58:10.278575 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.278541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" event={"ID":"4eb718a5-6469-45e8-8634-80f502a3334a","Type":"ContainerStarted","Data":"7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4"} Jun 06 16:58:10.278669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.278645 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:58:10.278720 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.278670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" event={"ID":"4eb718a5-6469-45e8-8634-80f502a3334a","Type":"ContainerStarted","Data":"e8887347e64be3cdc149515fba98919657dab43952a313fe3a8706dc38b89c0f"} Jun 06 16:58:10.278963 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:10.278934 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="30005401-0b60-43fd-b242-2069081b350d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:58:10.280362 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.280338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" event={"ID":"05ad00f4-6558-41f0-9d98-50f671625ff4","Type":"ContainerStarted","Data":"45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264"} Jun 06 16:58:10.280461 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.280383 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" event={"ID":"05ad00f4-6558-41f0-9d98-50f671625ff4","Type":"ContainerStarted","Data":"2571b1ff0634612ecc6ff790887a6268e596f9ad02eae0346446f229f81bc41b"} Jun 06 16:58:10.280461 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.280447 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:58:10.281957 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.281931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" event={"ID":"9b94f911-6c09-4656-8d77-b99efafd036a","Type":"ContainerStarted","Data":"5e011fd0aff8584d6f74b6ffb77c70382b9bfec6a6af40ba2e80bd5f9a694f1a"} Jun 06 16:58:10.296792 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:10.296761 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="30005401-0b60-43fd-b242-2069081b350d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:58:10.297080 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.297039 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" podStartSLOduration=15.297022717 podStartE2EDuration="15.297022717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:58:10.294722691 +0000 UTC m=+652.276197516" watchObservedRunningTime="2026-06-06 16:58:10.297022717 +0000 UTC m=+652.278497542" Jun 06 16:58:10.298454 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:10.298429 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-78ww4\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="30005401-0b60-43fd-b242-2069081b350d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78ww4" Jun 06 16:58:10.313660 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.313621 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdrwx" podStartSLOduration=2.7030336310000003 podStartE2EDuration="25.313608448s" totalImagesPullingTime="22.610574817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:58:10.312365365 +0000 UTC m=+652.293840195" watchObservedRunningTime="2026-06-06 16:58:10.313608448 +0000 UTC m=+652.295083272" Jun 06 16:58:10.333689 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.333647 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" podStartSLOduration=15.333638623 podStartE2EDuration="15.333638623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:58:10.33201983 +0000 UTC m=+652.313494658" watchObservedRunningTime="2026-06-06 16:58:10.333638623 +0000 UTC m=+652.315113448" Jun 06 16:58:10.508623 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:10.508582 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30005401-0b60-43fd-b242-2069081b350d" path="/var/lib/kubelet/pods/30005401-0b60-43fd-b242-2069081b350d/volumes" Jun 06 16:58:11.660125 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:11.660089 2577 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-swpgq_kuadrant-system_2fdfc517-459f-4145-868e-fb00d3569254_0(95b5e1b30a604d9a877e5f5271d5e11f3f0f94943451be0c65e03bc7b6f0853b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-swpgq to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 06 16:58:11.660414 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:11.660162 2577 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-swpgq_kuadrant-system_2fdfc517-459f-4145-868e-fb00d3569254_0(95b5e1b30a604d9a877e5f5271d5e11f3f0f94943451be0c65e03bc7b6f0853b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-swpgq to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:58:12.171961 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.171926 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:12.270353 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.270323 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:12.293702 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.293678 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:58:12.295645 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:12.295621 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="2fdfc517-459f-4145-868e-fb00d3569254" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:58:12.300038 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.300021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:58:12.302009 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:12.301984 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="2fdfc517-459f-4145-868e-fb00d3569254" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:58:12.419451 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.419423 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fdfc517-459f-4145-868e-fb00d3569254-extensions-socket-volume\") pod \"2fdfc517-459f-4145-868e-fb00d3569254\" (UID: \"2fdfc517-459f-4145-868e-fb00d3569254\") " Jun 06 16:58:12.419561 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.419472 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbtd9\" (UniqueName: \"kubernetes.io/projected/2fdfc517-459f-4145-868e-fb00d3569254-kube-api-access-cbtd9\") pod \"2fdfc517-459f-4145-868e-fb00d3569254\" (UID: \"2fdfc517-459f-4145-868e-fb00d3569254\") " Jun 06 16:58:12.419664 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.419643 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fdfc517-459f-4145-868e-fb00d3569254-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2fdfc517-459f-4145-868e-fb00d3569254" (UID: "2fdfc517-459f-4145-868e-fb00d3569254"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:58:12.419739 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.419727 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fdfc517-459f-4145-868e-fb00d3569254-extensions-socket-volume\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:58:12.421465 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.421442 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fdfc517-459f-4145-868e-fb00d3569254-kube-api-access-cbtd9" (OuterVolumeSpecName: "kube-api-access-cbtd9") pod "2fdfc517-459f-4145-868e-fb00d3569254" (UID: "2fdfc517-459f-4145-868e-fb00d3569254"). InnerVolumeSpecName "kube-api-access-cbtd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:58:12.508202 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.508172 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fdfc517-459f-4145-868e-fb00d3569254" path="/var/lib/kubelet/pods/2fdfc517-459f-4145-868e-fb00d3569254/volumes" Jun 06 16:58:12.520183 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:12.520161 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbtd9\" (UniqueName: \"kubernetes.io/projected/2fdfc517-459f-4145-868e-fb00d3569254-kube-api-access-cbtd9\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:58:13.299458 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:13.299425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:58:13.301658 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:13.301619 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="2fdfc517-459f-4145-868e-fb00d3569254" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:58:13.303428 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:13.303403 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-swpgq\" is forbidden: User \"system:node:ip-10-0-131-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-127.ec2.internal' and this object" podUID="2fdfc517-459f-4145-868e-fb00d3569254" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-swpgq" Jun 06 16:58:20.993760 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:20.993729 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:21.094204 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.094175 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:21.147822 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.147781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:21.291009 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.290942 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:58:21.291142 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.291121 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:58:21.369729 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.369701 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp"] Jun 06 16:58:21.369881 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.369859 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" podUID="4eb718a5-6469-45e8-8634-80f502a3334a" containerName="manager" containerID="cri-o://7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4" gracePeriod=10 Jun 06 16:58:21.560325 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.560255 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n"] Jun 06 16:58:21.566115 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.566090 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:21.579271 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.579203 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n"] Jun 06 16:58:21.634575 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.634554 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:58:21.695681 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.695651 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zrc7\" (UniqueName: \"kubernetes.io/projected/4eb718a5-6469-45e8-8634-80f502a3334a-kube-api-access-8zrc7\") pod \"4eb718a5-6469-45e8-8634-80f502a3334a\" (UID: \"4eb718a5-6469-45e8-8634-80f502a3334a\") " Jun 06 16:58:21.695836 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.695749 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb718a5-6469-45e8-8634-80f502a3334a-extensions-socket-volume\") pod \"4eb718a5-6469-45e8-8634-80f502a3334a\" (UID: \"4eb718a5-6469-45e8-8634-80f502a3334a\") " Jun 06 16:58:21.695920 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.695898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdgt\" (UniqueName: \"kubernetes.io/projected/1abfe9f3-a08f-4e63-9a03-4f5f558c908c-kube-api-access-qjdgt\") pod \"kuadrant-operator-controller-manager-86878c769f-7gz7n\" (UID: \"1abfe9f3-a08f-4e63-9a03-4f5f558c908c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:21.696091 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.696071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1abfe9f3-a08f-4e63-9a03-4f5f558c908c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7gz7n\" (UID: \"1abfe9f3-a08f-4e63-9a03-4f5f558c908c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:21.696197 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.696121 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb718a5-6469-45e8-8634-80f502a3334a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4eb718a5-6469-45e8-8634-80f502a3334a" (UID: "4eb718a5-6469-45e8-8634-80f502a3334a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:58:21.697636 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.697613 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb718a5-6469-45e8-8634-80f502a3334a-kube-api-access-8zrc7" (OuterVolumeSpecName: "kube-api-access-8zrc7") pod "4eb718a5-6469-45e8-8634-80f502a3334a" (UID: "4eb718a5-6469-45e8-8634-80f502a3334a"). InnerVolumeSpecName "kube-api-access-8zrc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:58:21.797243 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.797193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1abfe9f3-a08f-4e63-9a03-4f5f558c908c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7gz7n\" (UID: \"1abfe9f3-a08f-4e63-9a03-4f5f558c908c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:21.797362 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.797343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdgt\" (UniqueName: \"kubernetes.io/projected/1abfe9f3-a08f-4e63-9a03-4f5f558c908c-kube-api-access-qjdgt\") pod \"kuadrant-operator-controller-manager-86878c769f-7gz7n\" (UID: \"1abfe9f3-a08f-4e63-9a03-4f5f558c908c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:21.797439 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.797425 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eb718a5-6469-45e8-8634-80f502a3334a-extensions-socket-volume\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:58:21.797483 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.797446 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zrc7\" (UniqueName: \"kubernetes.io/projected/4eb718a5-6469-45e8-8634-80f502a3334a-kube-api-access-8zrc7\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:58:21.797559 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.797541 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1abfe9f3-a08f-4e63-9a03-4f5f558c908c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7gz7n\" (UID: \"1abfe9f3-a08f-4e63-9a03-4f5f558c908c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:21.805044 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.805017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdgt\" (UniqueName: \"kubernetes.io/projected/1abfe9f3-a08f-4e63-9a03-4f5f558c908c-kube-api-access-qjdgt\") pod \"kuadrant-operator-controller-manager-86878c769f-7gz7n\" (UID: \"1abfe9f3-a08f-4e63-9a03-4f5f558c908c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:21.879153 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:21.879096 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:22.009411 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.009389 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n"] Jun 06 16:58:22.011263 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:58:22.011211 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abfe9f3_a08f_4e63_9a03_4f5f558c908c.slice/crio-ba690443cace516496f09d54bf0e8d98eb7b9aed3c1dd611df188c3928179257 WatchSource:0}: Error finding container ba690443cace516496f09d54bf0e8d98eb7b9aed3c1dd611df188c3928179257: Status 404 returned error can't find the container with id ba690443cace516496f09d54bf0e8d98eb7b9aed3c1dd611df188c3928179257 Jun 06 16:58:22.353951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.353914 2577 generic.go:356] "Generic (PLEG): container finished" podID="4eb718a5-6469-45e8-8634-80f502a3334a" containerID="7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4" exitCode=0 Jun 06 16:58:22.353951 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.353959 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" Jun 06 16:58:22.354257 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.354011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" event={"ID":"4eb718a5-6469-45e8-8634-80f502a3334a","Type":"ContainerDied","Data":"7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4"} Jun 06 16:58:22.354257 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.354084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp" event={"ID":"4eb718a5-6469-45e8-8634-80f502a3334a","Type":"ContainerDied","Data":"e8887347e64be3cdc149515fba98919657dab43952a313fe3a8706dc38b89c0f"} Jun 06 16:58:22.354257 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.354119 2577 scope.go:117] "RemoveContainer" containerID="7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4" Jun 06 16:58:22.356611 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.356585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" event={"ID":"1abfe9f3-a08f-4e63-9a03-4f5f558c908c","Type":"ContainerStarted","Data":"c299c756f84ee74d1e9e9c500025177fdc19a2b473566399d86c1038eca699b9"} Jun 06 16:58:22.356773 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.356633 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" event={"ID":"1abfe9f3-a08f-4e63-9a03-4f5f558c908c","Type":"ContainerStarted","Data":"ba690443cace516496f09d54bf0e8d98eb7b9aed3c1dd611df188c3928179257"} Jun 06 16:58:22.356773 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.356755 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:22.365245 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.365211 2577 scope.go:117] "RemoveContainer" containerID="7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4" Jun 06 16:58:22.365485 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:22.365467 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4\": container with ID starting with 7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4 not found: ID does not exist" containerID="7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4" Jun 06 16:58:22.365561 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.365497 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4"} err="failed to get container status \"7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4\": rpc error: code = NotFound desc = could not find container \"7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4\": container with ID starting with 7082f65b1f1af18c759cca43dec362082b602f49341a0d4b8da318a3bc5105a4 not found: ID does not exist" Jun 06 16:58:22.378513 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.378473 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" podStartSLOduration=1.378460996 podStartE2EDuration="1.378460996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:58:22.376618171 +0000 UTC m=+664.358092997" watchObservedRunningTime="2026-06-06 16:58:22.378460996 +0000 UTC m=+664.359935820" Jun 06 16:58:22.390946 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.390925 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp"] Jun 06 16:58:22.392895 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.392877 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9bwjp"] Jun 06 16:58:22.508822 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:22.508793 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb718a5-6469-45e8-8634-80f502a3334a" path="/var/lib/kubelet/pods/4eb718a5-6469-45e8-8634-80f502a3334a/volumes" Jun 06 16:58:23.661011 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:23.660964 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:24.006340 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:24.006304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:24.110029 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:24.109998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:26.601054 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:26.601000 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:26.704445 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:26.704411 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:30.217025 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:30.216973 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:30.316807 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:30.316761 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:33.365304 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:33.365269 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gz7n" Jun 06 16:58:33.415039 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:33.415005 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t"] Jun 06 16:58:33.415222 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:33.415189 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" podUID="05ad00f4-6558-41f0-9d98-50f671625ff4" containerName="manager" containerID="cri-o://45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264" gracePeriod=10 Jun 06 16:58:34.181677 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.181649 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:58:34.307501 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.307471 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ad00f4-6558-41f0-9d98-50f671625ff4-extensions-socket-volume\") pod \"05ad00f4-6558-41f0-9d98-50f671625ff4\" (UID: \"05ad00f4-6558-41f0-9d98-50f671625ff4\") " Jun 06 16:58:34.307672 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.307556 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2lj2\" (UniqueName: \"kubernetes.io/projected/05ad00f4-6558-41f0-9d98-50f671625ff4-kube-api-access-q2lj2\") pod \"05ad00f4-6558-41f0-9d98-50f671625ff4\" (UID: \"05ad00f4-6558-41f0-9d98-50f671625ff4\") " Jun 06 16:58:34.307795 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.307765 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ad00f4-6558-41f0-9d98-50f671625ff4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05ad00f4-6558-41f0-9d98-50f671625ff4" (UID: "05ad00f4-6558-41f0-9d98-50f671625ff4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:58:34.309692 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.309666 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ad00f4-6558-41f0-9d98-50f671625ff4-kube-api-access-q2lj2" (OuterVolumeSpecName: "kube-api-access-q2lj2") pod "05ad00f4-6558-41f0-9d98-50f671625ff4" (UID: "05ad00f4-6558-41f0-9d98-50f671625ff4"). InnerVolumeSpecName "kube-api-access-q2lj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:58:34.408959 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.408878 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ad00f4-6558-41f0-9d98-50f671625ff4-extensions-socket-volume\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:58:34.408959 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.408903 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2lj2\" (UniqueName: \"kubernetes.io/projected/05ad00f4-6558-41f0-9d98-50f671625ff4-kube-api-access-q2lj2\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 16:58:34.435179 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.435145 2577 generic.go:356] "Generic (PLEG): container finished" podID="05ad00f4-6558-41f0-9d98-50f671625ff4" containerID="45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264" exitCode=0 Jun 06 16:58:34.435362 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.435189 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" Jun 06 16:58:34.435362 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.435216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" event={"ID":"05ad00f4-6558-41f0-9d98-50f671625ff4","Type":"ContainerDied","Data":"45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264"} Jun 06 16:58:34.435362 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.435281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t" event={"ID":"05ad00f4-6558-41f0-9d98-50f671625ff4","Type":"ContainerDied","Data":"2571b1ff0634612ecc6ff790887a6268e596f9ad02eae0346446f229f81bc41b"} Jun 06 16:58:34.435362 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.435311 2577 scope.go:117] "RemoveContainer" containerID="45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264" Jun 06 16:58:34.445352 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.445334 2577 scope.go:117] "RemoveContainer" containerID="45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264" Jun 06 16:58:34.445611 ip-10-0-131-127 kubenswrapper[2577]: E0606 16:58:34.445594 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264\": container with ID starting with 45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264 not found: ID does not exist" containerID="45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264" Jun 06 16:58:34.445668 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.445619 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264"} err="failed to get container status \"45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264\": rpc error: code = NotFound desc = could not find container \"45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264\": container with ID starting with 45e617eadf6469b07ce7041d11c77d8ef66aa71bc37685be594c79cb4cf03264 not found: ID does not exist" Jun 06 16:58:34.459776 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.459755 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t"] Jun 06 16:58:34.461800 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.461780 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xhk7t"] Jun 06 16:58:34.508589 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:34.508560 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ad00f4-6558-41f0-9d98-50f671625ff4" path="/var/lib/kubelet/pods/05ad00f4-6558-41f0-9d98-50f671625ff4/volumes" Jun 06 16:58:37.636223 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:37.636149 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:37.686864 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:37.686833 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:39.036431 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:39.036388 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:39.137190 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:39.137136 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:39.192776 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:39.192729 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:41.228623 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:41.228585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:42.025379 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:42.025342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:42.129661 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:42.129626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:51.632682 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:51.632651 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:51.749991 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:51.749949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:51.845950 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:51.845913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:52.466397 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.466335 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:52.547883 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.547845 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:58:52.549274 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.549252 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-766gx"] Jun 06 16:58:52.549615 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.549603 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb718a5-6469-45e8-8634-80f502a3334a" containerName="manager" Jun 06 16:58:52.549657 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.549616 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb718a5-6469-45e8-8634-80f502a3334a" containerName="manager" Jun 06 16:58:52.549657 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.549633 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ad00f4-6558-41f0-9d98-50f671625ff4" containerName="manager" Jun 06 16:58:52.549657 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.549638 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ad00f4-6558-41f0-9d98-50f671625ff4" containerName="manager" Jun 06 16:58:52.549759 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.549697 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ad00f4-6558-41f0-9d98-50f671625ff4" containerName="manager" Jun 06 16:58:52.549759 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.549707 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb718a5-6469-45e8-8634-80f502a3334a" containerName="manager" Jun 06 16:58:52.616885 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.616858 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-766gx"] Jun 06 16:58:52.617063 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.616971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-766gx" Jun 06 16:58:52.619080 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.619063 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ncsgl\"" Jun 06 16:58:52.663244 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.663195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd6mg\" (UniqueName: \"kubernetes.io/projected/e2f095d8-67e2-4935-ac8b-29baa07e4a76-kube-api-access-fd6mg\") pod \"authorino-75d556bd77-766gx\" (UID: \"e2f095d8-67e2-4935-ac8b-29baa07e4a76\") " pod="kuadrant-system/authorino-75d556bd77-766gx" Jun 06 16:58:52.764159 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.764100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd6mg\" (UniqueName: \"kubernetes.io/projected/e2f095d8-67e2-4935-ac8b-29baa07e4a76-kube-api-access-fd6mg\") pod \"authorino-75d556bd77-766gx\" (UID: \"e2f095d8-67e2-4935-ac8b-29baa07e4a76\") " pod="kuadrant-system/authorino-75d556bd77-766gx" Jun 06 16:58:52.771454 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.771433 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd6mg\" (UniqueName: \"kubernetes.io/projected/e2f095d8-67e2-4935-ac8b-29baa07e4a76-kube-api-access-fd6mg\") pod \"authorino-75d556bd77-766gx\" (UID: \"e2f095d8-67e2-4935-ac8b-29baa07e4a76\") " pod="kuadrant-system/authorino-75d556bd77-766gx" Jun 06 16:58:52.926748 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:52.926721 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-766gx" Jun 06 16:58:53.054300 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:53.054273 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-766gx"] Jun 06 16:58:53.056409 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:58:53.056371 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2f095d8_67e2_4935_ac8b_29baa07e4a76.slice/crio-b1635a0ba6b611e0401306a4067bb113b794b3fb3646566d62d58c6539d4888f WatchSource:0}: Error finding container b1635a0ba6b611e0401306a4067bb113b794b3fb3646566d62d58c6539d4888f: Status 404 returned error can't find the container with id b1635a0ba6b611e0401306a4067bb113b794b3fb3646566d62d58c6539d4888f Jun 06 16:58:53.542857 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:53.542793 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-766gx" event={"ID":"e2f095d8-67e2-4935-ac8b-29baa07e4a76","Type":"ContainerStarted","Data":"b1635a0ba6b611e0401306a4067bb113b794b3fb3646566d62d58c6539d4888f"} Jun 06 16:58:56.562809 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:56.562778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-766gx" event={"ID":"e2f095d8-67e2-4935-ac8b-29baa07e4a76","Type":"ContainerStarted","Data":"1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d"} Jun 06 16:58:56.576449 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:58:56.576406 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-766gx" podStartSLOduration=1.6793191159999998 podStartE2EDuration="4.576392522s" totalImagesPullingTime="2.897073406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:58:56.57545405 +0000 UTC m=+698.556928876" watchObservedRunningTime="2026-06-06 16:58:56.576392522 +0000 UTC m=+698.557867346" Jun 06 16:59:13.099165 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:13.099084 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:13.198330 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:13.198300 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:13.567669 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:13.567631 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:23.294797 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:23.294764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:23.414171 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:23.414138 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:23.524276 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:23.524219 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:34.922957 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:34.922922 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:34.981468 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:34.981445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:51.570947 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.570916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:51.671595 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.671558 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 16:59:51.980776 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.980737 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 16:59:51.984262 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.984221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 16:59:51.986475 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.986450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 06 16:59:51.986579 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.986564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-hsh6l\"" Jun 06 16:59:51.987218 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.987194 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 16:59:51.987218 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.987215 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 16:59:51.991198 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:51.991179 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 16:59:52.072939 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:52.072902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88h2g\" (UniqueName: \"kubernetes.io/projected/943d8bad-5f2d-4fb7-a8ef-245524a1c4d6-kube-api-access-88h2g\") pod \"maas-keycloak-0\" (UID: \"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6\") " pod="keycloak-system/maas-keycloak-0" Jun 06 16:59:52.173724 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:52.173688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88h2g\" (UniqueName: \"kubernetes.io/projected/943d8bad-5f2d-4fb7-a8ef-245524a1c4d6-kube-api-access-88h2g\") pod \"maas-keycloak-0\" (UID: \"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6\") " pod="keycloak-system/maas-keycloak-0" Jun 06 16:59:52.181349 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:52.181323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88h2g\" (UniqueName: \"kubernetes.io/projected/943d8bad-5f2d-4fb7-a8ef-245524a1c4d6-kube-api-access-88h2g\") pod \"maas-keycloak-0\" (UID: \"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6\") " pod="keycloak-system/maas-keycloak-0" Jun 06 16:59:52.295327 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:52.295248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 16:59:52.427375 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:52.427346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 16:59:52.428414 ip-10-0-131-127 kubenswrapper[2577]: W0606 16:59:52.428385 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943d8bad_5f2d_4fb7_a8ef_245524a1c4d6.slice/crio-36f5206c3a5da5e42a093aebf8e31d24c793e88a98ce3e1b06a7ad4fd0c0cb2a WatchSource:0}: Error finding container 36f5206c3a5da5e42a093aebf8e31d24c793e88a98ce3e1b06a7ad4fd0c0cb2a: Status 404 returned error can't find the container with id 36f5206c3a5da5e42a093aebf8e31d24c793e88a98ce3e1b06a7ad4fd0c0cb2a Jun 06 16:59:52.429779 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:52.429764 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 16:59:52.879651 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:52.879608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6","Type":"ContainerStarted","Data":"36f5206c3a5da5e42a093aebf8e31d24c793e88a98ce3e1b06a7ad4fd0c0cb2a"} Jun 06 16:59:56.911517 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:56.911484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6","Type":"ContainerStarted","Data":"dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee"} Jun 06 16:59:56.927250 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:56.927170 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6150431379999999 podStartE2EDuration="5.927150693s" totalImagesPullingTime="4.312107555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:59:56.92592132 +0000 UTC m=+758.907396171" watchObservedRunningTime="2026-06-06 16:59:56.927150693 +0000 UTC m=+758.908625519" Jun 06 16:59:57.295948 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:57.295904 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 06 16:59:57.297426 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:57.297394 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 16:59:58.296014 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:58.295962 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 16:59:59.296559 ip-10-0-131-127 kubenswrapper[2577]: I0606 16:59:59.296504 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:00.296033 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:00.295981 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:01.295727 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:01.295684 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:02.297649 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:02.296916 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 06 17:00:02.298659 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:02.298621 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:03.296735 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:03.296276 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:04.296254 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:04.296188 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:05.295781 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:05.295724 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:06.296588 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:06.296528 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:07.296578 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:07.296524 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:08.242182 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:08.242140 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:08.293018 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:08.292960 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:08.295933 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:08.295898 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:09.296478 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:09.296426 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 06 17:00:10.417178 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:10.417139 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 06 17:00:10.437263 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:10.435525 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 17:00:20.423903 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:20.423867 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 06 17:00:21.084061 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:21.084027 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:21.467403 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:21.467369 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:22.736815 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:22.736779 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-766gx"] Jun 06 17:00:22.737319 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:22.736950 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-766gx" podUID="e2f095d8-67e2-4935-ac8b-29baa07e4a76" containerName="authorino" containerID="cri-o://1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d" gracePeriod=30 Jun 06 17:00:22.987944 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:22.987879 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-766gx" Jun 06 17:00:23.082661 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.082624 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd6mg\" (UniqueName: \"kubernetes.io/projected/e2f095d8-67e2-4935-ac8b-29baa07e4a76-kube-api-access-fd6mg\") pod \"e2f095d8-67e2-4935-ac8b-29baa07e4a76\" (UID: \"e2f095d8-67e2-4935-ac8b-29baa07e4a76\") " Jun 06 17:00:23.084640 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.084606 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2f095d8-67e2-4935-ac8b-29baa07e4a76-kube-api-access-fd6mg" (OuterVolumeSpecName: "kube-api-access-fd6mg") pod "e2f095d8-67e2-4935-ac8b-29baa07e4a76" (UID: "e2f095d8-67e2-4935-ac8b-29baa07e4a76"). InnerVolumeSpecName "kube-api-access-fd6mg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 17:00:23.100503 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.100478 2577 generic.go:356] "Generic (PLEG): container finished" podID="e2f095d8-67e2-4935-ac8b-29baa07e4a76" containerID="1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d" exitCode=0 Jun 06 17:00:23.100616 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.100518 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-766gx" Jun 06 17:00:23.100616 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.100563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-766gx" event={"ID":"e2f095d8-67e2-4935-ac8b-29baa07e4a76","Type":"ContainerDied","Data":"1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d"} Jun 06 17:00:23.100616 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.100599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-766gx" event={"ID":"e2f095d8-67e2-4935-ac8b-29baa07e4a76","Type":"ContainerDied","Data":"b1635a0ba6b611e0401306a4067bb113b794b3fb3646566d62d58c6539d4888f"} Jun 06 17:00:23.100616 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.100616 2577 scope.go:117] "RemoveContainer" containerID="1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d" Jun 06 17:00:23.109456 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.109438 2577 scope.go:117] "RemoveContainer" containerID="1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d" Jun 06 17:00:23.109723 ip-10-0-131-127 kubenswrapper[2577]: E0606 17:00:23.109704 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d\": container with ID starting with 1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d not found: ID does not exist" containerID="1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d" Jun 06 17:00:23.109788 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.109736 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d"} err="failed to get container status \"1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d\": rpc error: code = NotFound desc = could not find container \"1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d\": container with ID starting with 1ae0e7f075e344af3a8fe601c66aa4ddba1be9c2ddbdb10e17625ad49102087d not found: ID does not exist" Jun 06 17:00:23.135411 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.135389 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-766gx"] Jun 06 17:00:23.138901 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.138881 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-766gx"] Jun 06 17:00:23.183620 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:23.183596 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd6mg\" (UniqueName: \"kubernetes.io/projected/e2f095d8-67e2-4935-ac8b-29baa07e4a76-kube-api-access-fd6mg\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 17:00:24.508015 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:24.507985 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2f095d8-67e2-4935-ac8b-29baa07e4a76" path="/var/lib/kubelet/pods/e2f095d8-67e2-4935-ac8b-29baa07e4a76/volumes" Jun 06 17:00:26.176774 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.176740 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:26.185312 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.185287 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6468f89b4c-r4rhp"] Jun 06 17:00:26.185950 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.185929 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f095d8-67e2-4935-ac8b-29baa07e4a76" containerName="authorino" Jun 06 17:00:26.186040 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.185953 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f095d8-67e2-4935-ac8b-29baa07e4a76" containerName="authorino" Jun 06 17:00:26.186082 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.186041 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f095d8-67e2-4935-ac8b-29baa07e4a76" containerName="authorino" Jun 06 17:00:26.190827 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.190809 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:26.197468 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.197448 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 06 17:00:26.197637 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.197494 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kk4wr\"" Jun 06 17:00:26.197751 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.197561 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 06 17:00:26.199521 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.199500 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6468f89b4c-r4rhp"] Jun 06 17:00:26.212791 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.212755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp49p\" (UniqueName: \"kubernetes.io/projected/d1234be5-28d9-4466-9b53-507eabb72ab1-kube-api-access-mp49p\") pod \"maas-controller-6468f89b4c-r4rhp\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:26.212937 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.212859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert\") pod \"maas-controller-6468f89b4c-r4rhp\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:26.274452 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.274418 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:26.313902 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.313875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp49p\" (UniqueName: \"kubernetes.io/projected/d1234be5-28d9-4466-9b53-507eabb72ab1-kube-api-access-mp49p\") pod \"maas-controller-6468f89b4c-r4rhp\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:26.314044 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.313929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert\") pod \"maas-controller-6468f89b4c-r4rhp\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:26.314086 ip-10-0-131-127 kubenswrapper[2577]: E0606 17:00:26.314042 2577 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 06 17:00:26.314123 ip-10-0-131-127 kubenswrapper[2577]: E0606 17:00:26.314091 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert podName:d1234be5-28d9-4466-9b53-507eabb72ab1 nodeName:}" failed. No retries permitted until 2026-06-06 17:00:26.814076217 +0000 UTC m=+788.795551020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert") pod "maas-controller-6468f89b4c-r4rhp" (UID: "d1234be5-28d9-4466-9b53-507eabb72ab1") : secret "maas-controller-webhook-cert" not found Jun 06 17:00:26.322125 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.322101 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp49p\" (UniqueName: \"kubernetes.io/projected/d1234be5-28d9-4466-9b53-507eabb72ab1-kube-api-access-mp49p\") pod \"maas-controller-6468f89b4c-r4rhp\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:26.348131 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.348104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:26.353261 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.353221 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86b9f786fd-fg6d6"] Jun 06 17:00:26.356747 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.356730 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:26.363115 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.363091 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86b9f786fd-fg6d6"] Jun 06 17:00:26.415339 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.415300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tvk6\" (UniqueName: \"kubernetes.io/projected/0016108d-c0eb-4d81-a9f5-0c40a3c22334-kube-api-access-9tvk6\") pod \"maas-controller-86b9f786fd-fg6d6\" (UID: \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\") " pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:26.415510 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.415363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0016108d-c0eb-4d81-a9f5-0c40a3c22334-webhook-cert\") pod \"maas-controller-86b9f786fd-fg6d6\" (UID: \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\") " pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:26.464297 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.464262 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:26.516858 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.516831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tvk6\" (UniqueName: \"kubernetes.io/projected/0016108d-c0eb-4d81-a9f5-0c40a3c22334-kube-api-access-9tvk6\") pod \"maas-controller-86b9f786fd-fg6d6\" (UID: \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\") " pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:26.517023 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.516887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0016108d-c0eb-4d81-a9f5-0c40a3c22334-webhook-cert\") pod \"maas-controller-86b9f786fd-fg6d6\" (UID: \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\") " pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:26.519344 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.519326 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0016108d-c0eb-4d81-a9f5-0c40a3c22334-webhook-cert\") pod \"maas-controller-86b9f786fd-fg6d6\" (UID: \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\") " pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:26.524446 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.524418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tvk6\" (UniqueName: \"kubernetes.io/projected/0016108d-c0eb-4d81-a9f5-0c40a3c22334-kube-api-access-9tvk6\") pod \"maas-controller-86b9f786fd-fg6d6\" (UID: \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\") " pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:26.668899 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.668855 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:26.804693 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.804670 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86b9f786fd-fg6d6"] Jun 06 17:00:26.808099 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:00:26.808075 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0016108d_c0eb_4d81_a9f5_0c40a3c22334.slice/crio-438fe239b07fe339d6c3563a316c78230e49a59a03edfec79175fdd552cf071d WatchSource:0}: Error finding container 438fe239b07fe339d6c3563a316c78230e49a59a03edfec79175fdd552cf071d: Status 404 returned error can't find the container with id 438fe239b07fe339d6c3563a316c78230e49a59a03edfec79175fdd552cf071d Jun 06 17:00:26.819691 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.819661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert\") pod \"maas-controller-6468f89b4c-r4rhp\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:26.822007 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:26.821985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert\") pod \"maas-controller-6468f89b4c-r4rhp\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:27.102569 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:27.102476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:27.124304 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:27.124270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" event={"ID":"0016108d-c0eb-4d81-a9f5-0c40a3c22334","Type":"ContainerStarted","Data":"438fe239b07fe339d6c3563a316c78230e49a59a03edfec79175fdd552cf071d"} Jun 06 17:00:27.234952 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:27.234929 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6468f89b4c-r4rhp"] Jun 06 17:00:27.236628 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:00:27.236600 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1234be5_28d9_4466_9b53_507eabb72ab1.slice/crio-ba42a95914f8a26a8322b4cf57c23b6efd143b10788361d11deafaa4e7e68f79 WatchSource:0}: Error finding container ba42a95914f8a26a8322b4cf57c23b6efd143b10788361d11deafaa4e7e68f79: Status 404 returned error can't find the container with id ba42a95914f8a26a8322b4cf57c23b6efd143b10788361d11deafaa4e7e68f79 Jun 06 17:00:28.134595 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:28.134552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" event={"ID":"d1234be5-28d9-4466-9b53-507eabb72ab1","Type":"ContainerStarted","Data":"ba42a95914f8a26a8322b4cf57c23b6efd143b10788361d11deafaa4e7e68f79"} Jun 06 17:00:29.629000 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:29.628962 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:29.724450 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:29.724417 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:30.149389 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:30.149277 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" event={"ID":"0016108d-c0eb-4d81-a9f5-0c40a3c22334","Type":"ContainerStarted","Data":"cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222"} Jun 06 17:00:30.149389 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:30.149345 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:30.150952 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:30.150924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" event={"ID":"d1234be5-28d9-4466-9b53-507eabb72ab1","Type":"ContainerStarted","Data":"e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288"} Jun 06 17:00:30.151082 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:30.151065 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:30.172119 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:30.172050 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" podStartSLOduration=1.5387402909999999 podStartE2EDuration="4.172030197s" totalImagesPullingTime="2.633289906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:00:30.168208495 +0000 UTC m=+792.149683320" watchObservedRunningTime="2026-06-06 17:00:30.172030197 +0000 UTC m=+792.153505023" Jun 06 17:00:30.185688 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:30.185639 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" podStartSLOduration=1.9738562050000001 podStartE2EDuration="4.185625889s" totalImagesPullingTime="2.211769684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:00:30.183741178 +0000 UTC m=+792.165216003" watchObservedRunningTime="2026-06-06 17:00:30.185625889 +0000 UTC m=+792.167100714" Jun 06 17:00:41.161726 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.161649 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:00:41.162282 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.161971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:41.219133 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.219099 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6468f89b4c-r4rhp"] Jun 06 17:00:41.219387 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.219352 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" podUID="d1234be5-28d9-4466-9b53-507eabb72ab1" containerName="manager" containerID="cri-o://e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288" gracePeriod=30 Jun 06 17:00:41.464517 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.464495 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:41.560345 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.560322 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp49p\" (UniqueName: \"kubernetes.io/projected/d1234be5-28d9-4466-9b53-507eabb72ab1-kube-api-access-mp49p\") pod \"d1234be5-28d9-4466-9b53-507eabb72ab1\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " Jun 06 17:00:41.560498 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.560398 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert\") pod \"d1234be5-28d9-4466-9b53-507eabb72ab1\" (UID: \"d1234be5-28d9-4466-9b53-507eabb72ab1\") " Jun 06 17:00:41.562530 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.562499 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d1234be5-28d9-4466-9b53-507eabb72ab1" (UID: "d1234be5-28d9-4466-9b53-507eabb72ab1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 17:00:41.562641 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.562576 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1234be5-28d9-4466-9b53-507eabb72ab1-kube-api-access-mp49p" (OuterVolumeSpecName: "kube-api-access-mp49p") pod "d1234be5-28d9-4466-9b53-507eabb72ab1" (UID: "d1234be5-28d9-4466-9b53-507eabb72ab1"). InnerVolumeSpecName "kube-api-access-mp49p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 17:00:41.661136 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.661111 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp49p\" (UniqueName: \"kubernetes.io/projected/d1234be5-28d9-4466-9b53-507eabb72ab1-kube-api-access-mp49p\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 17:00:41.661136 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:41.661134 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1234be5-28d9-4466-9b53-507eabb72ab1-webhook-cert\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 17:00:42.218476 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.218442 2577 generic.go:356] "Generic (PLEG): container finished" podID="d1234be5-28d9-4466-9b53-507eabb72ab1" containerID="e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288" exitCode=0 Jun 06 17:00:42.218853 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.218487 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" Jun 06 17:00:42.218853 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.218529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" event={"ID":"d1234be5-28d9-4466-9b53-507eabb72ab1","Type":"ContainerDied","Data":"e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288"} Jun 06 17:00:42.218853 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.218582 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6468f89b4c-r4rhp" event={"ID":"d1234be5-28d9-4466-9b53-507eabb72ab1","Type":"ContainerDied","Data":"ba42a95914f8a26a8322b4cf57c23b6efd143b10788361d11deafaa4e7e68f79"} Jun 06 17:00:42.218853 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.218607 2577 scope.go:117] "RemoveContainer" containerID="e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288" Jun 06 17:00:42.228187 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.228047 2577 scope.go:117] "RemoveContainer" containerID="e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288" Jun 06 17:00:42.228343 ip-10-0-131-127 kubenswrapper[2577]: E0606 17:00:42.228327 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288\": container with ID starting with e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288 not found: ID does not exist" containerID="e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288" Jun 06 17:00:42.228400 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.228351 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288"} err="failed to get container status \"e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288\": rpc error: code = NotFound desc = could not find container \"e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288\": container with ID starting with e8c87655dd3cb45885141e48ba59d1d048ee24611bfba91258e070210eef3288 not found: ID does not exist" Jun 06 17:00:42.238268 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.238246 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6468f89b4c-r4rhp"] Jun 06 17:00:42.244047 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.244028 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6468f89b4c-r4rhp"] Jun 06 17:00:42.515511 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:42.515435 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1234be5-28d9-4466-9b53-507eabb72ab1" path="/var/lib/kubelet/pods/d1234be5-28d9-4466-9b53-507eabb72ab1/volumes" Jun 06 17:00:50.311360 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:50.311328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:00:50.358514 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:00:50.358486 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:00.647530 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.647466 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:00.692248 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.692208 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j"] Jun 06 17:01:00.692681 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.692662 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1234be5-28d9-4466-9b53-507eabb72ab1" containerName="manager" Jun 06 17:01:00.692765 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.692684 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1234be5-28d9-4466-9b53-507eabb72ab1" containerName="manager" Jun 06 17:01:00.692829 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.692819 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1234be5-28d9-4466-9b53-507eabb72ab1" containerName="manager" Jun 06 17:01:00.698729 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.698701 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:00.701113 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.701092 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 06 17:01:00.701212 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.701113 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 06 17:01:00.701283 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.701251 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 06 17:01:00.702061 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.702046 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-h526j\"" Jun 06 17:01:00.707483 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.707078 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j"] Jun 06 17:01:00.724150 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.724019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3472162c-865e-493c-9bb9-3f7e7c0522d7-maas-api-tls\") pod \"maas-api-77bf95c99d-xf74j\" (UID: \"3472162c-865e-493c-9bb9-3f7e7c0522d7\") " pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:00.724150 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.724142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2flx\" (UniqueName: \"kubernetes.io/projected/3472162c-865e-493c-9bb9-3f7e7c0522d7-kube-api-access-n2flx\") pod \"maas-api-77bf95c99d-xf74j\" (UID: \"3472162c-865e-493c-9bb9-3f7e7c0522d7\") " pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:00.824953 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.824924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2flx\" (UniqueName: \"kubernetes.io/projected/3472162c-865e-493c-9bb9-3f7e7c0522d7-kube-api-access-n2flx\") pod \"maas-api-77bf95c99d-xf74j\" (UID: \"3472162c-865e-493c-9bb9-3f7e7c0522d7\") " pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:00.825072 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.824981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3472162c-865e-493c-9bb9-3f7e7c0522d7-maas-api-tls\") pod \"maas-api-77bf95c99d-xf74j\" (UID: \"3472162c-865e-493c-9bb9-3f7e7c0522d7\") " pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:00.825118 ip-10-0-131-127 kubenswrapper[2577]: E0606 17:01:00.825074 2577 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 06 17:01:00.825154 ip-10-0-131-127 kubenswrapper[2577]: E0606 17:01:00.825135 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3472162c-865e-493c-9bb9-3f7e7c0522d7-maas-api-tls podName:3472162c-865e-493c-9bb9-3f7e7c0522d7 nodeName:}" failed. No retries permitted until 2026-06-06 17:01:01.325116148 +0000 UTC m=+823.306590968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3472162c-865e-493c-9bb9-3f7e7c0522d7-maas-api-tls") pod "maas-api-77bf95c99d-xf74j" (UID: "3472162c-865e-493c-9bb9-3f7e7c0522d7") : secret "maas-api-serving-cert" not found Jun 06 17:01:00.833964 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.833937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2flx\" (UniqueName: \"kubernetes.io/projected/3472162c-865e-493c-9bb9-3f7e7c0522d7-kube-api-access-n2flx\") pod \"maas-api-77bf95c99d-xf74j\" (UID: \"3472162c-865e-493c-9bb9-3f7e7c0522d7\") " pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:00.890836 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:00.890809 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:01.068071 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.068033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:01.152223 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.152192 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:01.152849 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.152829 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gtlkp"] Jun 06 17:01:01.156432 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.156412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" Jun 06 17:01:01.158714 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.158682 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 06 17:01:01.158825 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.158734 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hm6jv\"" Jun 06 17:01:01.163377 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.163355 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gtlkp"] Jun 06 17:01:01.193806 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.193778 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-rlgpn"] Jun 06 17:01:01.196956 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.196940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" Jun 06 17:01:01.206593 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.206569 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-rlgpn"] Jun 06 17:01:01.227999 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.227972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h598\" (UniqueName: \"kubernetes.io/projected/57f2853c-6e41-4ec6-8751-3acffaf2cd41-kube-api-access-8h598\") pod \"payload-pre-processing-67d7689b65-gtlkp\" (UID: \"57f2853c-6e41-4ec6-8751-3acffaf2cd41\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" Jun 06 17:01:01.228113 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.228090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxc9f\" (UniqueName: \"kubernetes.io/projected/34a88d31-1dd7-4a20-b8d1-fe1e2124aa28-kube-api-access-gxc9f\") pod \"payload-processing-7c6c859784-rlgpn\" (UID: \"34a88d31-1dd7-4a20-b8d1-fe1e2124aa28\") " pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" Jun 06 17:01:01.328803 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.328726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h598\" (UniqueName: \"kubernetes.io/projected/57f2853c-6e41-4ec6-8751-3acffaf2cd41-kube-api-access-8h598\") pod \"payload-pre-processing-67d7689b65-gtlkp\" (UID: \"57f2853c-6e41-4ec6-8751-3acffaf2cd41\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" Jun 06 17:01:01.328803 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.328768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3472162c-865e-493c-9bb9-3f7e7c0522d7-maas-api-tls\") pod \"maas-api-77bf95c99d-xf74j\" (UID: \"3472162c-865e-493c-9bb9-3f7e7c0522d7\") " pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:01.328981 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.328806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxc9f\" (UniqueName: \"kubernetes.io/projected/34a88d31-1dd7-4a20-b8d1-fe1e2124aa28-kube-api-access-gxc9f\") pod \"payload-processing-7c6c859784-rlgpn\" (UID: \"34a88d31-1dd7-4a20-b8d1-fe1e2124aa28\") " pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" Jun 06 17:01:01.331188 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.331160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3472162c-865e-493c-9bb9-3f7e7c0522d7-maas-api-tls\") pod \"maas-api-77bf95c99d-xf74j\" (UID: \"3472162c-865e-493c-9bb9-3f7e7c0522d7\") " pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:01.336167 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.336138 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h598\" (UniqueName: \"kubernetes.io/projected/57f2853c-6e41-4ec6-8751-3acffaf2cd41-kube-api-access-8h598\") pod \"payload-pre-processing-67d7689b65-gtlkp\" (UID: \"57f2853c-6e41-4ec6-8751-3acffaf2cd41\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" Jun 06 17:01:01.336519 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.336498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxc9f\" (UniqueName: \"kubernetes.io/projected/34a88d31-1dd7-4a20-b8d1-fe1e2124aa28-kube-api-access-gxc9f\") pod \"payload-processing-7c6c859784-rlgpn\" (UID: \"34a88d31-1dd7-4a20-b8d1-fe1e2124aa28\") " pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" Jun 06 17:01:01.468831 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.468787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" Jun 06 17:01:01.508379 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.508343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" Jun 06 17:01:01.611643 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.611599 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:01.621540 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.621514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gtlkp"] Jun 06 17:01:01.658279 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.658251 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-rlgpn"] Jun 06 17:01:01.659650 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:01:01.659621 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a88d31_1dd7_4a20_b8d1_fe1e2124aa28.slice/crio-9825bfe709925bab58c1c1c1083648da8bcfffde9e4e78344d3a26c963ff8882 WatchSource:0}: Error finding container 9825bfe709925bab58c1c1c1083648da8bcfffde9e4e78344d3a26c963ff8882: Status 404 returned error can't find the container with id 9825bfe709925bab58c1c1c1083648da8bcfffde9e4e78344d3a26c963ff8882 Jun 06 17:01:01.762639 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.762596 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j"] Jun 06 17:01:01.763799 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:01:01.763774 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3472162c_865e_493c_9bb9_3f7e7c0522d7.slice/crio-5849be6804c7ff70a9a54b65a68ce7c9f8752d3107a485cd38468ff084f41f2b WatchSource:0}: Error finding container 5849be6804c7ff70a9a54b65a68ce7c9f8752d3107a485cd38468ff084f41f2b: Status 404 returned error can't find the container with id 5849be6804c7ff70a9a54b65a68ce7c9f8752d3107a485cd38468ff084f41f2b Jun 06 17:01:01.993540 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:01.993500 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:02.330354 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:02.330258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" event={"ID":"34a88d31-1dd7-4a20-b8d1-fe1e2124aa28","Type":"ContainerStarted","Data":"9825bfe709925bab58c1c1c1083648da8bcfffde9e4e78344d3a26c963ff8882"} Jun 06 17:01:02.331722 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:02.331692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" event={"ID":"57f2853c-6e41-4ec6-8751-3acffaf2cd41","Type":"ContainerStarted","Data":"8b8ffb6294453c8fc19fbcb4ed64db1f17dfd7fb54ca5a3b638114d53970b2d4"} Jun 06 17:01:02.333335 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:02.333308 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" event={"ID":"3472162c-865e-493c-9bb9-3f7e7c0522d7","Type":"ContainerStarted","Data":"5849be6804c7ff70a9a54b65a68ce7c9f8752d3107a485cd38468ff084f41f2b"} Jun 06 17:01:03.341958 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:03.341864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" event={"ID":"34a88d31-1dd7-4a20-b8d1-fe1e2124aa28","Type":"ContainerStarted","Data":"2b932ac6e49169c07593c4f9d14acc6c57f9a45a159f9f6e26087dfa7b107f1c"} Jun 06 17:01:03.341958 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:03.341948 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" Jun 06 17:01:03.343822 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:03.343781 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" event={"ID":"57f2853c-6e41-4ec6-8751-3acffaf2cd41","Type":"ContainerStarted","Data":"3e3f1bd5e60e4bcedcb47406e2ae5fac0fdfe0aff5d4e5525fc50ef4e3d48025"} Jun 06 17:01:03.343965 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:03.343863 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" Jun 06 17:01:03.360328 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:03.360128 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" podStartSLOduration=1.041209623 podStartE2EDuration="2.360110125s" totalImagesPullingTime="1.318900502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:01:03.358567419 +0000 UTC m=+825.340042267" watchObservedRunningTime="2026-06-06 17:01:03.360110125 +0000 UTC m=+825.341584954" Jun 06 17:01:03.374715 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:03.374657 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" podStartSLOduration=1.029785944 podStartE2EDuration="2.374644169s" totalImagesPullingTime="1.344858225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:01:03.373371527 +0000 UTC m=+825.354846353" watchObservedRunningTime="2026-06-06 17:01:03.374644169 +0000 UTC m=+825.356118993" Jun 06 17:01:04.350203 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:04.350165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" event={"ID":"3472162c-865e-493c-9bb9-3f7e7c0522d7","Type":"ContainerStarted","Data":"da09cf5b7cc1cf7f0f036d11f0e03e17052b4692db9f07ea8a40ee2259dcce6b"} Jun 06 17:01:04.350666 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:04.350467 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:04.367368 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:04.367330 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" podStartSLOduration=2.628239739 podStartE2EDuration="4.367317491s" totalImagesPullingTime="1.739077752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:01:04.365602577 +0000 UTC m=+826.347077403" watchObservedRunningTime="2026-06-06 17:01:04.367317491 +0000 UTC m=+826.348792314" Jun 06 17:01:05.447697 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:05.447663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:10.360571 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:10.360544 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-77bf95c99d-xf74j" Jun 06 17:01:12.156052 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:12.156021 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 17:01:12.156433 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:12.156238 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" containerID="cri-o://dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee" gracePeriod=30 Jun 06 17:01:14.199405 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.199381 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.239886 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.239856 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88h2g\" (UniqueName: \"kubernetes.io/projected/943d8bad-5f2d-4fb7-a8ef-245524a1c4d6-kube-api-access-88h2g\") pod \"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6\" (UID: \"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6\") " Jun 06 17:01:14.242152 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.242121 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943d8bad-5f2d-4fb7-a8ef-245524a1c4d6-kube-api-access-88h2g" (OuterVolumeSpecName: "kube-api-access-88h2g") pod "943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" (UID: "943d8bad-5f2d-4fb7-a8ef-245524a1c4d6"). InnerVolumeSpecName "kube-api-access-88h2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 17:01:14.341623 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.341549 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88h2g\" (UniqueName: \"kubernetes.io/projected/943d8bad-5f2d-4fb7-a8ef-245524a1c4d6-kube-api-access-88h2g\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 17:01:14.352627 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.352601 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-rlgpn" Jun 06 17:01:14.352742 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.352669 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-gtlkp" Jun 06 17:01:14.417053 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.417019 2577 generic.go:356] "Generic (PLEG): container finished" podID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerID="dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee" exitCode=143 Jun 06 17:01:14.417053 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.417056 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.417285 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.417100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6","Type":"ContainerDied","Data":"dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee"} Jun 06 17:01:14.417285 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.417144 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"943d8bad-5f2d-4fb7-a8ef-245524a1c4d6","Type":"ContainerDied","Data":"36f5206c3a5da5e42a093aebf8e31d24c793e88a98ce3e1b06a7ad4fd0c0cb2a"} Jun 06 17:01:14.417285 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.417163 2577 scope.go:117] "RemoveContainer" containerID="dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee" Jun 06 17:01:14.427427 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.427412 2577 scope.go:117] "RemoveContainer" containerID="dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee" Jun 06 17:01:14.427665 ip-10-0-131-127 kubenswrapper[2577]: E0606 17:01:14.427650 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee\": container with ID starting with dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee not found: ID does not exist" containerID="dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee" Jun 06 17:01:14.427707 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.427672 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee"} err="failed to get container status \"dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee\": rpc error: code = NotFound desc = could not find container \"dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee\": container with ID starting with dec5a3ff2902c3752ee9553f24239200e78c4b807749b8e6b7d5f064d73ce8ee not found: ID does not exist" Jun 06 17:01:14.440757 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.440734 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 17:01:14.442905 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.442885 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 17:01:14.460985 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.460962 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 17:01:14.461369 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.461356 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" Jun 06 17:01:14.461420 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.461371 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" Jun 06 17:01:14.461454 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.461448 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" containerName="keycloak" Jun 06 17:01:14.465953 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.465937 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.468006 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.467988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 17:01:14.468079 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.468032 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 06 17:01:14.468349 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.468329 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 06 17:01:14.468437 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.468394 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 17:01:14.468507 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.468437 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-hsh6l\"" Jun 06 17:01:14.474395 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.474378 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 17:01:14.508615 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.508591 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="943d8bad-5f2d-4fb7-a8ef-245524a1c4d6" path="/var/lib/kubelet/pods/943d8bad-5f2d-4fb7-a8ef-245524a1c4d6/volumes" Jun 06 17:01:14.543054 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.543025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8c7m\" (UniqueName: \"kubernetes.io/projected/601f5c5b-f607-4740-ae28-a1a12800efae-kube-api-access-w8c7m\") pod \"maas-keycloak-0\" (UID: \"601f5c5b-f607-4740-ae28-a1a12800efae\") " pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.543213 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.543065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/601f5c5b-f607-4740-ae28-a1a12800efae-test-realms\") pod \"maas-keycloak-0\" (UID: \"601f5c5b-f607-4740-ae28-a1a12800efae\") " pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.644155 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.644098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8c7m\" (UniqueName: \"kubernetes.io/projected/601f5c5b-f607-4740-ae28-a1a12800efae-kube-api-access-w8c7m\") pod \"maas-keycloak-0\" (UID: \"601f5c5b-f607-4740-ae28-a1a12800efae\") " pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.644155 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.644130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/601f5c5b-f607-4740-ae28-a1a12800efae-test-realms\") pod \"maas-keycloak-0\" (UID: \"601f5c5b-f607-4740-ae28-a1a12800efae\") " pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.644886 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.644869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/601f5c5b-f607-4740-ae28-a1a12800efae-test-realms\") pod \"maas-keycloak-0\" (UID: \"601f5c5b-f607-4740-ae28-a1a12800efae\") " pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.652032 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.652010 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8c7m\" (UniqueName: \"kubernetes.io/projected/601f5c5b-f607-4740-ae28-a1a12800efae-kube-api-access-w8c7m\") pod \"maas-keycloak-0\" (UID: \"601f5c5b-f607-4740-ae28-a1a12800efae\") " pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.776594 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.776570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:14.909734 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:14.909705 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 17:01:14.911140 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:01:14.911114 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601f5c5b_f607_4740_ae28_a1a12800efae.slice/crio-c37a8f17f6ad5c96fcf7bb2f8eee6d61131e1fdc50740a9985f573a0f8503b0d WatchSource:0}: Error finding container c37a8f17f6ad5c96fcf7bb2f8eee6d61131e1fdc50740a9985f573a0f8503b0d: Status 404 returned error can't find the container with id c37a8f17f6ad5c96fcf7bb2f8eee6d61131e1fdc50740a9985f573a0f8503b0d Jun 06 17:01:15.429874 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:15.429838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"601f5c5b-f607-4740-ae28-a1a12800efae","Type":"ContainerStarted","Data":"5dfa84caacdc45d0fa585ba0585dc5d53d21442507f9d4f3a039916e08c01ef3"} Jun 06 17:01:15.430266 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:15.429889 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"601f5c5b-f607-4740-ae28-a1a12800efae","Type":"ContainerStarted","Data":"c37a8f17f6ad5c96fcf7bb2f8eee6d61131e1fdc50740a9985f573a0f8503b0d"} Jun 06 17:01:15.446872 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:15.446818 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.048354075 podStartE2EDuration="1.446803866s" totalImagesPullingTime="398.449791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:01:15.445576215 +0000 UTC m=+837.427051033" watchObservedRunningTime="2026-06-06 17:01:15.446803866 +0000 UTC m=+837.428278691" Jun 06 17:01:15.777003 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:15.776970 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:15.778524 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:15.778494 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:16.777619 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:16.777567 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:17.777508 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:17.777455 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:18.777665 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:18.777615 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:19.777355 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:19.777302 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:20.777508 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:20.777457 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:21.777984 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:21.777927 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:22.777916 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:22.777867 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:23.777769 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:23.777721 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:24.777394 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:24.777359 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:24.777722 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:24.777688 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:25.777266 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:25.777193 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:26.777324 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:26.777283 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:27.777259 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:27.777189 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 06 17:01:28.891686 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:28.891647 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:28.921077 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:28.921025 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="601f5c5b-f607-4740-ae28-a1a12800efae" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 17:01:38.897787 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:38.897754 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 06 17:01:51.493592 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:51.493556 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:51.593222 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:51.593188 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:56.284289 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.284254 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4"] Jun 06 17:01:56.287326 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.287302 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.289669 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.289647 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 06 17:01:56.290522 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.290505 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 06 17:01:56.290608 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.290532 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pq4lc\"" Jun 06 17:01:56.290664 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.290629 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 06 17:01:56.297700 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.297676 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4"] Jun 06 17:01:56.352619 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.352590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp5vl\" (UniqueName: \"kubernetes.io/projected/0eb1cbe5-3163-4803-bc21-bc98080b637f-kube-api-access-zp5vl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.352776 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.352634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb1cbe5-3163-4803-bc21-bc98080b637f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.352776 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.352704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.352776 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.352737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.352776 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.352751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.352776 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.352765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.361824 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.361793 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:01:56.453973 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.453940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.453973 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.453971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.454217 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.453992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.454217 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.454049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp5vl\" (UniqueName: \"kubernetes.io/projected/0eb1cbe5-3163-4803-bc21-bc98080b637f-kube-api-access-zp5vl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.454217 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.454078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb1cbe5-3163-4803-bc21-bc98080b637f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.454417 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.454223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.454474 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.454437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.454598 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.454575 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.454724 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.454704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.456369 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.456352 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0eb1cbe5-3163-4803-bc21-bc98080b637f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.456538 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.456523 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eb1cbe5-3163-4803-bc21-bc98080b637f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.461157 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.461131 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp5vl\" (UniqueName: \"kubernetes.io/projected/0eb1cbe5-3163-4803-bc21-bc98080b637f-kube-api-access-zp5vl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4\" (UID: \"0eb1cbe5-3163-4803-bc21-bc98080b637f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.599311 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.599208 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:01:56.736360 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:56.736335 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4"] Jun 06 17:01:56.738347 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:01:56.738320 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb1cbe5_3163_4803_bc21_bc98080b637f.slice/crio-8076772f2c0c5925b3912678005f2e0da87b2615f7be390a8fa363d2aeb1c1ff WatchSource:0}: Error finding container 8076772f2c0c5925b3912678005f2e0da87b2615f7be390a8fa363d2aeb1c1ff: Status 404 returned error can't find the container with id 8076772f2c0c5925b3912678005f2e0da87b2615f7be390a8fa363d2aeb1c1ff Jun 06 17:01:57.722042 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:01:57.722009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" event={"ID":"0eb1cbe5-3163-4803-bc21-bc98080b637f","Type":"ContainerStarted","Data":"8076772f2c0c5925b3912678005f2e0da87b2615f7be390a8fa363d2aeb1c1ff"} Jun 06 17:02:00.741446 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:00.741399 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" event={"ID":"0eb1cbe5-3163-4803-bc21-bc98080b637f","Type":"ContainerStarted","Data":"6833c82609b43ebc83b9a7f703759294197075c37b1aef1c60b842587bf4fca0"} Jun 06 17:02:01.749181 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:01.749149 2577 generic.go:356] "Generic (PLEG): container finished" podID="0eb1cbe5-3163-4803-bc21-bc98080b637f" containerID="6833c82609b43ebc83b9a7f703759294197075c37b1aef1c60b842587bf4fca0" exitCode=0 Jun 06 17:02:01.749628 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:01.749211 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" event={"ID":"0eb1cbe5-3163-4803-bc21-bc98080b637f","Type":"ContainerDied","Data":"6833c82609b43ebc83b9a7f703759294197075c37b1aef1c60b842587bf4fca0"} Jun 06 17:02:03.762840 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:03.762803 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" event={"ID":"0eb1cbe5-3163-4803-bc21-bc98080b637f","Type":"ContainerStarted","Data":"547346d77bf16ad751923532cd1fa48be223e3bc382d2ea5bfeb9c9c97726793"} Jun 06 17:02:03.781205 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:03.781154 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" podStartSLOduration=1.9205013100000001 podStartE2EDuration="7.781138585s" totalImagesPullingTime="4.533064407s" totalInitContainerRuntime="1.327572868s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:01:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:02:03.78057812 +0000 UTC m=+885.762052945" watchObservedRunningTime="2026-06-06 17:02:03.781138585 +0000 UTC m=+885.762613410" Jun 06 17:02:04.291108 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:04.291076 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:02:06.599449 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:06.599399 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:02:06.599891 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:06.599473 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:02:06.612158 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:06.612132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:02:06.798411 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:06.798385 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4" Jun 06 17:02:12.103513 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:12.103437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:02:18.541629 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:18.541602 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 17:02:18.542096 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:18.542007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 17:02:22.258711 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.258674 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9"] Jun 06 17:02:22.279766 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.279735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9"] Jun 06 17:02:22.279941 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.279860 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.282195 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.282172 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 06 17:02:22.287838 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.287812 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:02:22.403698 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.403659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f979d7c4-9977-4ef5-89f8-273444110432-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.403882 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.403748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.403882 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.403783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.403882 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.403819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.403993 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.403899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.403993 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.403944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg57p\" (UniqueName: \"kubernetes.io/projected/f979d7c4-9977-4ef5-89f8-273444110432-kube-api-access-pg57p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.504574 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.504517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.504746 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.504613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.504746 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.504669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.504746 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.504724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.504905 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.504757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg57p\" (UniqueName: \"kubernetes.io/projected/f979d7c4-9977-4ef5-89f8-273444110432-kube-api-access-pg57p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.504905 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.504800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f979d7c4-9977-4ef5-89f8-273444110432-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.505011 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.504964 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.505067 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.505005 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.505119 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.505087 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.507293 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.507272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f979d7c4-9977-4ef5-89f8-273444110432-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.507442 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.507422 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f979d7c4-9977-4ef5-89f8-273444110432-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.512304 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.512254 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg57p\" (UniqueName: \"kubernetes.io/projected/f979d7c4-9977-4ef5-89f8-273444110432-kube-api-access-pg57p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9\" (UID: \"f979d7c4-9977-4ef5-89f8-273444110432\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.590954 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.590861 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:02:22.725309 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.725284 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9"] Jun 06 17:02:22.726743 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:02:22.726713 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf979d7c4_9977_4ef5_89f8_273444110432.slice/crio-68b4a38a6eea27062efa970f61b78e5b35dae9beb63674750cde07885e468953 WatchSource:0}: Error finding container 68b4a38a6eea27062efa970f61b78e5b35dae9beb63674750cde07885e468953: Status 404 returned error can't find the container with id 68b4a38a6eea27062efa970f61b78e5b35dae9beb63674750cde07885e468953 Jun 06 17:02:22.880869 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.880820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" event={"ID":"f979d7c4-9977-4ef5-89f8-273444110432","Type":"ContainerStarted","Data":"cf878b9770930af84a706db7d356dc8a60d24d72629e410e46b6e774f7b2cec8"} Jun 06 17:02:22.881027 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:22.880897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" event={"ID":"f979d7c4-9977-4ef5-89f8-273444110432","Type":"ContainerStarted","Data":"68b4a38a6eea27062efa970f61b78e5b35dae9beb63674750cde07885e468953"} Jun 06 17:02:34.377254 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.377209 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5"] Jun 06 17:02:34.382312 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.382290 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.384529 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.384511 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 06 17:02:34.390538 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.390492 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5"] Jun 06 17:02:34.400963 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.400920 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:02:34.413100 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.413076 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.413180 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.413129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.413219 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.413196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.413290 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.413273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.413326 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.413305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwgv7\" (UniqueName: \"kubernetes.io/projected/34b64183-58c0-459d-b8d7-09302c9257a2-kube-api-access-nwgv7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.413372 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.413335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b64183-58c0-459d-b8d7-09302c9257a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514344 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514510 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwgv7\" (UniqueName: \"kubernetes.io/projected/34b64183-58c0-459d-b8d7-09302c9257a2-kube-api-access-nwgv7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514510 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b64183-58c0-459d-b8d7-09302c9257a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514510 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514510 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514727 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514787 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514787 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514769 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.514949 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.514879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.516769 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.516747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b64183-58c0-459d-b8d7-09302c9257a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.516935 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.516917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b64183-58c0-459d-b8d7-09302c9257a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.521983 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.521962 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwgv7\" (UniqueName: \"kubernetes.io/projected/34b64183-58c0-459d-b8d7-09302c9257a2-kube-api-access-nwgv7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5\" (UID: \"34b64183-58c0-459d-b8d7-09302c9257a2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.694307 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.694275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:34.835543 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.835518 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5"] Jun 06 17:02:34.837377 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:02:34.837347 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b64183_58c0_459d_b8d7_09302c9257a2.slice/crio-b3664a9ea3ac497b26afb0801f78a424a95280e0515a9907e693e640d868500c WatchSource:0}: Error finding container b3664a9ea3ac497b26afb0801f78a424a95280e0515a9907e693e640d868500c: Status 404 returned error can't find the container with id b3664a9ea3ac497b26afb0801f78a424a95280e0515a9907e693e640d868500c Jun 06 17:02:34.954663 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.954586 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" event={"ID":"34b64183-58c0-459d-b8d7-09302c9257a2","Type":"ContainerStarted","Data":"ca6f7c7b1d0d16de9465541e1f07151a70522245b082f78c5b832761a2bd60da"} Jun 06 17:02:34.954663 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:34.954644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" event={"ID":"34b64183-58c0-459d-b8d7-09302c9257a2","Type":"ContainerStarted","Data":"b3664a9ea3ac497b26afb0801f78a424a95280e0515a9907e693e640d868500c"} Jun 06 17:02:36.967481 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:36.967445 2577 generic.go:356] "Generic (PLEG): container finished" podID="34b64183-58c0-459d-b8d7-09302c9257a2" containerID="ca6f7c7b1d0d16de9465541e1f07151a70522245b082f78c5b832761a2bd60da" exitCode=0 Jun 06 17:02:36.967846 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:36.967515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" event={"ID":"34b64183-58c0-459d-b8d7-09302c9257a2","Type":"ContainerDied","Data":"ca6f7c7b1d0d16de9465541e1f07151a70522245b082f78c5b832761a2bd60da"} Jun 06 17:02:37.373292 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.373253 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq"] Jun 06 17:02:37.377062 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.377039 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.380382 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.380364 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 06 17:02:37.386835 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.386816 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq"] Jun 06 17:02:37.446541 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.446513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.446706 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.446554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.446706 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.446588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.446706 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.446675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.446850 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.446720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dkg7\" (UniqueName: \"kubernetes.io/projected/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-kube-api-access-4dkg7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.446850 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.446790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.474650 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.474572 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:02:37.548326 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.548293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dkg7\" (UniqueName: \"kubernetes.io/projected/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-kube-api-access-4dkg7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.548493 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.548346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.548493 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.548437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.548493 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.548471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.548702 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.548519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.548702 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.548585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.548969 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.548950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.549027 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.548983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.549064 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.549037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.550927 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.550886 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.551183 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.551161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.555868 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.555844 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dkg7\" (UniqueName: \"kubernetes.io/projected/88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa-kube-api-access-4dkg7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-k76dq\" (UID: \"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.688877 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.688843 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:37.829477 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.829449 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq"] Jun 06 17:02:37.830192 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:02:37.830165 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c894e3_6a0c_4288_a6d4_45b3bf8cd6aa.slice/crio-4609620ddd2fc1f528d18a1241b0cf39a042f1891364653a81054abdc0292191 WatchSource:0}: Error finding container 4609620ddd2fc1f528d18a1241b0cf39a042f1891364653a81054abdc0292191: Status 404 returned error can't find the container with id 4609620ddd2fc1f528d18a1241b0cf39a042f1891364653a81054abdc0292191 Jun 06 17:02:37.975496 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.975447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" event={"ID":"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa","Type":"ContainerStarted","Data":"9c3c30238da18b72700a1ef4db58ee46fed0612b00d892d6b69375492c903dc8"} Jun 06 17:02:37.975945 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.975505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" event={"ID":"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa","Type":"ContainerStarted","Data":"4609620ddd2fc1f528d18a1241b0cf39a042f1891364653a81054abdc0292191"} Jun 06 17:02:37.977375 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:37.977353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" event={"ID":"34b64183-58c0-459d-b8d7-09302c9257a2","Type":"ContainerStarted","Data":"0a254490138d7b376859412347e845940a32c7b111153ec61a3d995d7737c95c"} Jun 06 17:02:38.006445 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:38.006362 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" podStartSLOduration=2.548621481 podStartE2EDuration="4.006345973s" totalImagesPullingTime="202.977991ms" totalInitContainerRuntime="1.254746501s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:02:38.005710756 +0000 UTC m=+919.987185582" watchObservedRunningTime="2026-06-06 17:02:38.006345973 +0000 UTC m=+919.987820802" Jun 06 17:02:40.996422 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:40.996389 2577 generic.go:356] "Generic (PLEG): container finished" podID="88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa" containerID="9c3c30238da18b72700a1ef4db58ee46fed0612b00d892d6b69375492c903dc8" exitCode=0 Jun 06 17:02:40.996841 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:40.996470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" event={"ID":"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa","Type":"ContainerDied","Data":"9c3c30238da18b72700a1ef4db58ee46fed0612b00d892d6b69375492c903dc8"} Jun 06 17:02:42.004179 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:42.004142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" event={"ID":"88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa","Type":"ContainerStarted","Data":"4a2c9e08547afa854f7315d1292156eb1ccb7a02d23bc4eff4727592731f0d0f"} Jun 06 17:02:42.021261 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:42.021197 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" podStartSLOduration=2.112541725 podStartE2EDuration="5.021181821s" totalImagesPullingTime="166.461393ms" totalInitContainerRuntime="2.742178703s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:02:42.020207279 +0000 UTC m=+924.001682105" watchObservedRunningTime="2026-06-06 17:02:42.021181821 +0000 UTC m=+924.002656648" Jun 06 17:02:44.694747 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:44.694706 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:44.695178 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:44.694773 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:44.707635 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:44.707613 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:45.031434 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:45.031350 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5" Jun 06 17:02:47.689812 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:47.689763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:47.690268 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:47.689831 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:47.702825 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:47.702801 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:48.047780 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:48.047699 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-k76dq" Jun 06 17:02:49.398699 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:02:49.398665 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:03:40.281592 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:03:40.281511 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:03:40.379709 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:03:40.379670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:03:41.348355 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:03:41.348312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:03:41.448520 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:03:41.448484 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:04:06.480399 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:04:06.480361 2577 generic.go:356] "Generic (PLEG): container finished" podID="f979d7c4-9977-4ef5-89f8-273444110432" containerID="cf878b9770930af84a706db7d356dc8a60d24d72629e410e46b6e774f7b2cec8" exitCode=0 Jun 06 17:04:06.480849 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:04:06.480434 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" event={"ID":"f979d7c4-9977-4ef5-89f8-273444110432","Type":"ContainerDied","Data":"cf878b9770930af84a706db7d356dc8a60d24d72629e410e46b6e774f7b2cec8"} Jun 06 17:04:07.488169 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:04:07.488136 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" event={"ID":"f979d7c4-9977-4ef5-89f8-273444110432","Type":"ContainerStarted","Data":"6a8896fa108c24365b826a7faed7c8c3a0d7c185fa7392869f8dd2f1217f198e"} Jun 06 17:04:07.506392 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:04:07.506339 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" podStartSLOduration=2.257918258 podStartE2EDuration="1m45.506325146s" totalImagesPullingTime="180.691271ms" totalInitContainerRuntime="1m43.067715617s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:04:07.504577449 +0000 UTC m=+1009.486052295" watchObservedRunningTime="2026-06-06 17:04:07.506325146 +0000 UTC m=+1009.487799970" Jun 06 17:04:12.591418 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:04:12.591374 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:04:12.591861 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:04:12.591667 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:04:12.604156 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:04:12.604127 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:04:13.543296 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:04:13.543263 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9" Jun 06 17:05:06.019623 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.019582 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:05:06.128793 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.128761 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86b9f786fd-fg6d6"] Jun 06 17:05:06.128964 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.128943 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" podUID="0016108d-c0eb-4d81-a9f5-0c40a3c22334" containerName="manager" containerID="cri-o://cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222" gracePeriod=30 Jun 06 17:05:06.389693 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.389664 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:05:06.582628 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.582545 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0016108d-c0eb-4d81-a9f5-0c40a3c22334-webhook-cert\") pod \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\" (UID: \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\") " Jun 06 17:05:06.582785 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.582660 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tvk6\" (UniqueName: \"kubernetes.io/projected/0016108d-c0eb-4d81-a9f5-0c40a3c22334-kube-api-access-9tvk6\") pod \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\" (UID: \"0016108d-c0eb-4d81-a9f5-0c40a3c22334\") " Jun 06 17:05:06.584745 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.584714 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0016108d-c0eb-4d81-a9f5-0c40a3c22334-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0016108d-c0eb-4d81-a9f5-0c40a3c22334" (UID: "0016108d-c0eb-4d81-a9f5-0c40a3c22334"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 17:05:06.584745 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.584730 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0016108d-c0eb-4d81-a9f5-0c40a3c22334-kube-api-access-9tvk6" (OuterVolumeSpecName: "kube-api-access-9tvk6") pod "0016108d-c0eb-4d81-a9f5-0c40a3c22334" (UID: "0016108d-c0eb-4d81-a9f5-0c40a3c22334"). InnerVolumeSpecName "kube-api-access-9tvk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 17:05:06.684376 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.684349 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0016108d-c0eb-4d81-a9f5-0c40a3c22334-webhook-cert\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 17:05:06.684376 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.684372 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tvk6\" (UniqueName: \"kubernetes.io/projected/0016108d-c0eb-4d81-a9f5-0c40a3c22334-kube-api-access-9tvk6\") on node \"ip-10-0-131-127.ec2.internal\" DevicePath \"\"" Jun 06 17:05:06.848550 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.848462 2577 generic.go:356] "Generic (PLEG): container finished" podID="0016108d-c0eb-4d81-a9f5-0c40a3c22334" containerID="cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222" exitCode=0 Jun 06 17:05:06.848550 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.848507 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" Jun 06 17:05:06.848550 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.848539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" event={"ID":"0016108d-c0eb-4d81-a9f5-0c40a3c22334","Type":"ContainerDied","Data":"cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222"} Jun 06 17:05:06.848783 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.848590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86b9f786fd-fg6d6" event={"ID":"0016108d-c0eb-4d81-a9f5-0c40a3c22334","Type":"ContainerDied","Data":"438fe239b07fe339d6c3563a316c78230e49a59a03edfec79175fdd552cf071d"} Jun 06 17:05:06.848783 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.848612 2577 scope.go:117] "RemoveContainer" containerID="cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222" Jun 06 17:05:06.858726 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.858709 2577 scope.go:117] "RemoveContainer" containerID="cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222" Jun 06 17:05:06.859021 ip-10-0-131-127 kubenswrapper[2577]: E0606 17:05:06.859003 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222\": container with ID starting with cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222 not found: ID does not exist" containerID="cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222" Jun 06 17:05:06.859062 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.859033 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222"} err="failed to get container status \"cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222\": rpc error: code = NotFound desc = could not find container \"cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222\": container with ID starting with cb0a4521f29696c6f23b8b3010cd8e1b0e3b0fa534308cfb790016878eaaf222 not found: ID does not exist" Jun 06 17:05:06.868350 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.868325 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86b9f786fd-fg6d6"] Jun 06 17:05:06.879543 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:06.879521 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86b9f786fd-fg6d6"] Jun 06 17:05:07.529194 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:07.529153 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:05:08.516249 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:08.516148 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0016108d-c0eb-4d81-a9f5-0c40a3c22334" path="/var/lib/kubelet/pods/0016108d-c0eb-4d81-a9f5-0c40a3c22334/volumes" Jun 06 17:05:49.272100 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:49.272069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:05:49.368099 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:49.368066 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:05:49.569826 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:49.569742 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:05:50.004661 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:50.004629 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:05:50.105136 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:50.105105 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:05:57.827386 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:05:57.827359 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:06:03.537554 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:06:03.537513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:06:03.590993 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:06:03.590963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:06:35.648814 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:06:35.648782 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:06:35.748698 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:06:35.748668 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:06:35.979712 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:06:35.979682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:06:36.408037 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:06:36.407950 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:06:36.510605 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:06:36.510579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:06:59.590153 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:06:59.590119 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:05.218680 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:05.218642 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:05.321664 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:05.321630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:05.421581 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:05.421551 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:05.565122 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:05.565032 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:05.665037 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:05.664996 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:12.514534 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:12.514502 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:18.578352 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:18.578319 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 17:07:18.582373 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:18.582347 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 17:07:22.079472 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:22.079436 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:22.190500 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:22.190429 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:22.292971 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:22.292935 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:27.829003 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:27.828962 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:27.929060 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:27.929023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:35.957186 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:35.957152 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:36.995444 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:36.995409 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:52.684481 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:52.684442 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:52.799569 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:52.799529 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:52.902922 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:52.902889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:55.387377 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:55.387344 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:55.432405 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:55.432368 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:57.381288 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:57.381221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:58.578582 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:58.578553 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:07:58.679086 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:07:58.679054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:08:11.758043 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:11.757967 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f6689757f-95qmm_790c61be-bef8-4ed8-ae10-d3b54fb8273e/nginx/0.log" Jun 06 17:08:12.550552 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:12.550523 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bd68968c-68rjn_4451a124-f530-471a-a29d-fbea4a451781/copy-manifests/0.log" Jun 06 17:08:12.562601 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:12.562574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bd68968c-68rjn_4451a124-f530-471a-a29d-fbea4a451781/manager/0.log" Jun 06 17:08:13.558118 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.558090 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp_999a7f3c-0137-4070-903a-53c3f5edf202/util/0.log" Jun 06 17:08:13.564347 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.564326 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp_999a7f3c-0137-4070-903a-53c3f5edf202/pull/0.log" Jun 06 17:08:13.570566 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.570549 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp_999a7f3c-0137-4070-903a-53c3f5edf202/extract/0.log" Jun 06 17:08:13.677951 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.677930 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt_1a803155-6070-4528-b4fc-ed151b38b4a0/util/0.log" Jun 06 17:08:13.683159 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.683142 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt_1a803155-6070-4528-b4fc-ed151b38b4a0/pull/0.log" Jun 06 17:08:13.688368 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.688350 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt_1a803155-6070-4528-b4fc-ed151b38b4a0/extract/0.log" Jun 06 17:08:13.797055 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.797027 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl_726dfc32-6afe-481d-9a44-93262f2335ec/extract/0.log" Jun 06 17:08:13.802424 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.802405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl_726dfc32-6afe-481d-9a44-93262f2335ec/util/0.log" Jun 06 17:08:13.817760 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.817704 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl_726dfc32-6afe-481d-9a44-93262f2335ec/pull/0.log" Jun 06 17:08:13.923371 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.923347 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2_dfde10e2-3aaa-4a45-9241-faca060a696e/util/0.log" Jun 06 17:08:13.928527 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.928504 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2_dfde10e2-3aaa-4a45-9241-faca060a696e/pull/0.log" Jun 06 17:08:13.933321 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:13.933301 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2_dfde10e2-3aaa-4a45-9241-faca060a696e/extract/0.log" Jun 06 17:08:14.163952 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:14.163877 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cdlwb_f675d2bc-9499-46b8-8b1c-3d6a20ae2588/manager/0.log" Jun 06 17:08:14.270370 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:14.270342 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6w78f_5dd6271f-de03-4ed3-944a-731ca9cca99d/manager/0.log" Jun 06 17:08:14.371566 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:14.371543 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mdrwx_9b94f911-6c09-4656-8d77-b99efafd036a/kuadrant-console-plugin/0.log" Jun 06 17:08:14.479145 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:14.479120 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-q7rnk_212ac249-46c8-40f6-aec8-1768af5adbfd/registry-server/0.log" Jun 06 17:08:14.601438 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:14.601406 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7gz7n_1abfe9f3-a08f-4e63-9a03-4f5f558c908c/manager/0.log" Jun 06 17:08:15.195955 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:15.195926 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc66qmg_d98b09ea-5fdc-4a6a-82ac-873d3aef527f/istio-proxy/0.log" Jun 06 17:08:15.765699 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:15.765674 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gtlkp_57f2853c-6e41-4ec6-8751-3acffaf2cd41/payload-pre-processing/0.log" Jun 06 17:08:15.883578 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:15.883551 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rlgpn_34a88d31-1dd7-4a20-b8d1-fe1e2124aa28/payload-processing/0.log" Jun 06 17:08:16.000281 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.000253 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-554b47b59-bkb9r_5e8c01c0-4fcd-4de9-af24-9b33f1ed9238/router/0.log" Jun 06 17:08:16.343674 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.343643 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4_0eb1cbe5-3163-4803-bc21-bc98080b637f/storage-initializer/0.log" Jun 06 17:08:16.350467 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.350447 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-brnk4_0eb1cbe5-3163-4803-bc21-bc98080b637f/main/0.log" Jun 06 17:08:16.691067 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.691044 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9_f979d7c4-9977-4ef5-89f8-273444110432/storage-initializer/0.log" Jun 06 17:08:16.697609 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.697592 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c26hs9_f979d7c4-9977-4ef5-89f8-273444110432/main/0.log" Jun 06 17:08:16.802730 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.802707 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5_34b64183-58c0-459d-b8d7-09302c9257a2/storage-initializer/0.log" Jun 06 17:08:16.809394 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.809375 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-tcdh5_34b64183-58c0-459d-b8d7-09302c9257a2/main/0.log" Jun 06 17:08:16.918972 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.918949 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-k76dq_88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa/storage-initializer/0.log" Jun 06 17:08:16.925212 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:16.925192 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-k76dq_88c894e3-6a0c-4288-a6d4-45b3bf8cd6aa/main/0.log" Jun 06 17:08:21.100767 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:21.100733 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:08:21.156418 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:21.156381 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" limit=1024 Jun 06 17:08:24.091421 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:24.091389 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cqnr6_e95cec1e-d673-4db1-b626-d983df240fed/global-pull-secret-syncer/0.log" Jun 06 17:08:24.169538 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:24.169509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7tmll_afb5018c-8c36-49a0-be9c-f6b4afb1b47c/konnectivity-agent/0.log" Jun 06 17:08:24.240844 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:24.240818 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-127.ec2.internal_b23e8a4da2bc68dc238258b631d7995b/haproxy/0.log" Jun 06 17:08:29.027964 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.027915 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp_999a7f3c-0137-4070-903a-53c3f5edf202/extract/0.log" Jun 06 17:08:29.085594 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.085566 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp_999a7f3c-0137-4070-903a-53c3f5edf202/util/0.log" Jun 06 17:08:29.111615 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.111590 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5rrp_999a7f3c-0137-4070-903a-53c3f5edf202/pull/0.log" Jun 06 17:08:29.138151 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.138128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt_1a803155-6070-4528-b4fc-ed151b38b4a0/extract/0.log" Jun 06 17:08:29.161123 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.161099 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt_1a803155-6070-4528-b4fc-ed151b38b4a0/util/0.log" Jun 06 17:08:29.181425 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.181402 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rcjkt_1a803155-6070-4528-b4fc-ed151b38b4a0/pull/0.log" Jun 06 17:08:29.208575 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.208555 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl_726dfc32-6afe-481d-9a44-93262f2335ec/extract/0.log" Jun 06 17:08:29.229436 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.229416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl_726dfc32-6afe-481d-9a44-93262f2335ec/util/0.log" Jun 06 17:08:29.255052 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.255034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pdhl_726dfc32-6afe-481d-9a44-93262f2335ec/pull/0.log" Jun 06 17:08:29.284469 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.284419 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2_dfde10e2-3aaa-4a45-9241-faca060a696e/extract/0.log" Jun 06 17:08:29.307084 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.307065 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2_dfde10e2-3aaa-4a45-9241-faca060a696e/util/0.log" Jun 06 17:08:29.327569 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.327553 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xcpt2_dfde10e2-3aaa-4a45-9241-faca060a696e/pull/0.log" Jun 06 17:08:29.442511 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.442486 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cdlwb_f675d2bc-9499-46b8-8b1c-3d6a20ae2588/manager/0.log" Jun 06 17:08:29.475665 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.475643 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6w78f_5dd6271f-de03-4ed3-944a-731ca9cca99d/manager/0.log" Jun 06 17:08:29.498047 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.498029 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mdrwx_9b94f911-6c09-4656-8d77-b99efafd036a/kuadrant-console-plugin/0.log" Jun 06 17:08:29.525878 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.525861 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-q7rnk_212ac249-46c8-40f6-aec8-1768af5adbfd/registry-server/0.log" Jun 06 17:08:29.565074 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:29.564994 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7gz7n_1abfe9f3-a08f-4e63-9a03-4f5f558c908c/manager/0.log" Jun 06 17:08:31.392243 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.392192 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6184fca6-2c59-4923-8fc0-f1287fa1480a/alertmanager/0.log" Jun 06 17:08:31.410731 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.410710 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6184fca6-2c59-4923-8fc0-f1287fa1480a/config-reloader/0.log" Jun 06 17:08:31.433145 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.433111 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6184fca6-2c59-4923-8fc0-f1287fa1480a/kube-rbac-proxy-web/0.log" Jun 06 17:08:31.460706 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.460688 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6184fca6-2c59-4923-8fc0-f1287fa1480a/kube-rbac-proxy/0.log" Jun 06 17:08:31.488174 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.488118 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6184fca6-2c59-4923-8fc0-f1287fa1480a/kube-rbac-proxy-metric/0.log" Jun 06 17:08:31.509183 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.509166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6184fca6-2c59-4923-8fc0-f1287fa1480a/prom-label-proxy/0.log" Jun 06 17:08:31.530068 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.530051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6184fca6-2c59-4923-8fc0-f1287fa1480a/init-config-reloader/0.log" Jun 06 17:08:31.563423 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.563403 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-fcwqd_1847750e-7617-4d3f-8137-138bcd90302a/cluster-monitoring-operator/0.log" Jun 06 17:08:31.678533 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.678504 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b6b878594-8ttqb_1af73209-411a-4803-ac36-ce839b30fa05/metrics-server/0.log" Jun 06 17:08:31.705310 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.705286 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-86xk4_121f7784-f524-4de7-85c1-998510d12511/monitoring-plugin/0.log" Jun 06 17:08:31.890451 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.890380 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvdk_12531c35-9636-45ec-9e64-afca91581456/node-exporter/0.log" Jun 06 17:08:31.910680 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.910654 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvdk_12531c35-9636-45ec-9e64-afca91581456/kube-rbac-proxy/0.log" Jun 06 17:08:31.938113 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.938093 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvdk_12531c35-9636-45ec-9e64-afca91581456/init-textfile/0.log" Jun 06 17:08:31.962808 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.962790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ttd_ee884edc-77d8-4d47-ab25-abd41fefd681/kube-rbac-proxy-main/0.log" Jun 06 17:08:31.982399 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:31.982379 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ttd_ee884edc-77d8-4d47-ab25-abd41fefd681/kube-rbac-proxy-self/0.log" Jun 06 17:08:32.002245 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:32.002200 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ttd_ee884edc-77d8-4d47-ab25-abd41fefd681/openshift-state-metrics/0.log" Jun 06 17:08:32.302891 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:32.302864 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-8pvs9_9cf174a4-71f7-4b87-9f14-677feae31e0b/prometheus-operator-admission-webhook/0.log" Jun 06 17:08:33.759783 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:33.759751 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-7z64z_08e010e7-b1ee-4152-869b-2b9f665dff68/networking-console-plugin/0.log" Jun 06 17:08:34.328852 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.328826 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/2.log" Jun 06 17:08:34.332882 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.332858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qpbdr_722ff46c-6ce4-4617-88d3-36e20ff703c9/console-operator/3.log" Jun 06 17:08:34.717268 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.717222 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c"] Jun 06 17:08:34.717719 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.717704 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0016108d-c0eb-4d81-a9f5-0c40a3c22334" containerName="manager" Jun 06 17:08:34.717769 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.717721 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0016108d-c0eb-4d81-a9f5-0c40a3c22334" containerName="manager" Jun 06 17:08:34.717813 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.717803 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0016108d-c0eb-4d81-a9f5-0c40a3c22334" containerName="manager" Jun 06 17:08:34.721280 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.721264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.723564 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.723542 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2kw2l\"/\"default-dockercfg-f7654\"" Jun 06 17:08:34.723701 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.723569 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2kw2l\"/\"openshift-service-ca.crt\"" Jun 06 17:08:34.723701 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.723583 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2kw2l\"/\"kube-root-ca.crt\"" Jun 06 17:08:34.729275 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.729250 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c"] Jun 06 17:08:34.806965 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.806940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-podres\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.807415 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.806974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-sys\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.807415 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.806994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hczf\" (UniqueName: \"kubernetes.io/projected/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-kube-api-access-7hczf\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.807415 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.807149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-lib-modules\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.807415 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.807207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-proc\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.907907 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.907876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-podres\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.908046 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.907922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-sys\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.908046 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.907950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hczf\" (UniqueName: \"kubernetes.io/projected/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-kube-api-access-7hczf\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.908046 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.908011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-sys\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.908268 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.908041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-podres\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.908268 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.908063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-lib-modules\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.908268 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.908111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-proc\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.908268 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.908159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-lib-modules\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.908268 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.908215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-proc\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.915400 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.915382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hczf\" (UniqueName: \"kubernetes.io/projected/95d930b7-b7af-44ab-9f4e-e8de1b7301cb-kube-api-access-7hczf\") pod \"perf-node-gather-daemonset-j4z5c\" (UID: \"95d930b7-b7af-44ab-9f4e-e8de1b7301cb\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:34.925113 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:34.925091 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-lj4vm_ff45048b-5170-4318-8136-b34efbc1a0d6/download-server/0.log" Jun 06 17:08:35.031967 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:35.031903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:35.166210 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:35.166182 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c"] Jun 06 17:08:35.167847 ip-10-0-131-127 kubenswrapper[2577]: W0606 17:08:35.167820 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95d930b7_b7af_44ab_9f4e_e8de1b7301cb.slice/crio-8fc9b58e531aeb2868e09de1215430368dd1a30f5bc7eb9ae8cb35396e44b4ed WatchSource:0}: Error finding container 8fc9b58e531aeb2868e09de1215430368dd1a30f5bc7eb9ae8cb35396e44b4ed: Status 404 returned error can't find the container with id 8fc9b58e531aeb2868e09de1215430368dd1a30f5bc7eb9ae8cb35396e44b4ed Jun 06 17:08:35.581267 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:35.581224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-mrjxz_0e56049c-46d0-47f8-8759-1903b3cee6da/volume-data-source-validator/0.log" Jun 06 17:08:36.080300 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:36.080253 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" event={"ID":"95d930b7-b7af-44ab-9f4e-e8de1b7301cb","Type":"ContainerStarted","Data":"b898060686de800f9ae476be8d0d89a283acc10b00d210f67fa18c6739e482a1"} Jun 06 17:08:36.080707 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:36.080318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" event={"ID":"95d930b7-b7af-44ab-9f4e-e8de1b7301cb","Type":"ContainerStarted","Data":"8fc9b58e531aeb2868e09de1215430368dd1a30f5bc7eb9ae8cb35396e44b4ed"} Jun 06 17:08:36.080707 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:36.080344 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:36.096756 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:36.096709 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" podStartSLOduration=2.09669535 podStartE2EDuration="2.09669535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 17:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:08:36.094569894 +0000 UTC m=+1278.076044721" watchObservedRunningTime="2026-06-06 17:08:36.09669535 +0000 UTC m=+1278.078170199" Jun 06 17:08:36.825610 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:36.825580 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwsjk_a96ffa7a-747b-4550-a213-58068599c779/dns/0.log" Jun 06 17:08:36.848837 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:36.848803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwsjk_a96ffa7a-747b-4550-a213-58068599c779/kube-rbac-proxy/0.log" Jun 06 17:08:36.895914 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:36.895886 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ms7c9_c6205570-13cf-4c02-b34b-f7513bb8cfed/dns-node-resolver/0.log" Jun 06 17:08:37.510041 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:37.510011 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lt6md_0bcd27ac-3a7a-4331-9782-99e278104b92/node-ca/0.log" Jun 06 17:08:38.450242 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:38.450208 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc66qmg_d98b09ea-5fdc-4a6a-82ac-873d3aef527f/istio-proxy/0.log" Jun 06 17:08:38.613570 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:38.613544 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gtlkp_57f2853c-6e41-4ec6-8751-3acffaf2cd41/payload-pre-processing/0.log" Jun 06 17:08:38.645567 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:38.645541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rlgpn_34a88d31-1dd7-4a20-b8d1-fe1e2124aa28/payload-processing/0.log" Jun 06 17:08:38.666988 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:38.666962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-554b47b59-bkb9r_5e8c01c0-4fcd-4de9-af24-9b33f1ed9238/router/0.log" Jun 06 17:08:39.338788 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:39.338755 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdr9h_30aa7a02-16e5-4ff5-bfbd-d2ecdfbb9e5f/serve-healthcheck-canary/0.log" Jun 06 17:08:39.884747 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:39.884713 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-mv2bv_6c108fee-d835-41a7-a67e-fc6d5f8de8aa/insights-operator/0.log" Jun 06 17:08:39.885467 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:39.885448 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-mv2bv_6c108fee-d835-41a7-a67e-fc6d5f8de8aa/insights-operator/1.log" Jun 06 17:08:39.909826 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:39.909806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-56fw7_f747c769-576b-4619-93c2-ba71aac4b1d4/kube-rbac-proxy/0.log" Jun 06 17:08:39.929814 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:39.929795 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-56fw7_f747c769-576b-4619-93c2-ba71aac4b1d4/exporter/0.log" Jun 06 17:08:39.950756 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:39.950736 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-56fw7_f747c769-576b-4619-93c2-ba71aac4b1d4/extractor/0.log" Jun 06 17:08:42.096076 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:42.096050 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-j4z5c" Jun 06 17:08:42.214587 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:42.214564 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f6689757f-95qmm_790c61be-bef8-4ed8-ae10-d3b54fb8273e/nginx/0.log" Jun 06 17:08:42.457600 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:42.457568 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bd68968c-68rjn_4451a124-f530-471a-a29d-fbea4a451781/manager/0.log" Jun 06 17:08:42.474015 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:42.473992 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bd68968c-68rjn_4451a124-f530-471a-a29d-fbea4a451781/copy-manifests/0.log" Jun 06 17:08:44.224447 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:44.224418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6cfc947f5-c4wch_0561eab2-f35b-4ce1-bf74-658f577f82e4/manager/0.log" Jun 06 17:08:48.735425 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:48.735392 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc66qmg_d98b09ea-5fdc-4a6a-82ac-873d3aef527f/istio-proxy/0.log" Jun 06 17:08:48.851120 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:48.851091 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gtlkp_57f2853c-6e41-4ec6-8751-3acffaf2cd41/payload-pre-processing/0.log" Jun 06 17:08:48.876260 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:48.876215 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rlgpn_34a88d31-1dd7-4a20-b8d1-fe1e2124aa28/payload-processing/0.log" Jun 06 17:08:48.892457 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:48.892418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-554b47b59-bkb9r_5e8c01c0-4fcd-4de9-af24-9b33f1ed9238/router/0.log" Jun 06 17:08:49.809606 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:49.809577 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-f4vff_50001a40-7b39-4edf-aa51-05de9b94fa87/kube-storage-version-migrator-operator/1.log" Jun 06 17:08:49.810404 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:49.810387 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-f4vff_50001a40-7b39-4edf-aa51-05de9b94fa87/kube-storage-version-migrator-operator/0.log" Jun 06 17:08:49.980338 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:49.980307 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc66qmg_d98b09ea-5fdc-4a6a-82ac-873d3aef527f/istio-proxy/0.log" Jun 06 17:08:50.106168 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:50.106087 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gtlkp_57f2853c-6e41-4ec6-8751-3acffaf2cd41/payload-pre-processing/0.log" Jun 06 17:08:50.129925 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:50.129896 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rlgpn_34a88d31-1dd7-4a20-b8d1-fe1e2124aa28/payload-processing/0.log" Jun 06 17:08:50.145114 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:50.145089 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-554b47b59-bkb9r_5e8c01c0-4fcd-4de9-af24-9b33f1ed9238/router/0.log" Jun 06 17:08:50.972654 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:50.972629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp6g5_16f46035-4803-471e-a507-15ca392f5b48/kube-multus-additional-cni-plugins/0.log" Jun 06 17:08:50.992336 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:50.992307 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp6g5_16f46035-4803-471e-a507-15ca392f5b48/egress-router-binary-copy/0.log" Jun 06 17:08:51.011906 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.011877 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp6g5_16f46035-4803-471e-a507-15ca392f5b48/cni-plugins/0.log" Jun 06 17:08:51.031097 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.031068 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp6g5_16f46035-4803-471e-a507-15ca392f5b48/bond-cni-plugin/0.log" Jun 06 17:08:51.052077 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.052051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp6g5_16f46035-4803-471e-a507-15ca392f5b48/routeoverride-cni/0.log" Jun 06 17:08:51.071479 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.071459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp6g5_16f46035-4803-471e-a507-15ca392f5b48/whereabouts-cni-bincopy/0.log" Jun 06 17:08:51.090995 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.090964 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp6g5_16f46035-4803-471e-a507-15ca392f5b48/whereabouts-cni/0.log" Jun 06 17:08:51.459691 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.459666 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q85xn_d1d0f509-b45c-43b0-9ce9-b2de8de20b42/kube-multus/0.log" Jun 06 17:08:51.522179 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.522147 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nl9nt_5491b72a-033f-4bb1-b3cd-18a1b8e63176/network-metrics-daemon/0.log" Jun 06 17:08:51.539892 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.539873 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nl9nt_5491b72a-033f-4bb1-b3cd-18a1b8e63176/kube-rbac-proxy/0.log" Jun 06 17:08:51.680928 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.680894 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc66qmg_d98b09ea-5fdc-4a6a-82ac-873d3aef527f/istio-proxy/0.log" Jun 06 17:08:51.792764 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.792689 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gtlkp_57f2853c-6e41-4ec6-8751-3acffaf2cd41/payload-pre-processing/0.log" Jun 06 17:08:51.815163 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.815141 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rlgpn_34a88d31-1dd7-4a20-b8d1-fe1e2124aa28/payload-processing/0.log" Jun 06 17:08:51.835327 ip-10-0-131-127 kubenswrapper[2577]: I0606 17:08:51.835310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-554b47b59-bkb9r_5e8c01c0-4fcd-4de9-af24-9b33f1ed9238/router/0.log"