Jun 08 21:04:27.284339 ip-10-0-140-214 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 21:04:27.284349 ip-10-0-140-214 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 21:04:27.284356 ip-10-0-140-214 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 21:04:27.284502 ip-10-0-140-214 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 21:04:37.399582 ip-10-0-140-214 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 21:04:37.399598 ip-10-0-140-214 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a5772d3ba12c444cb071606329e3b2ee -- Jun 08 21:07:25.701379 ip-10-0-140-214 systemd[1]: Starting Kubernetes Kubelet... Jun 08 21:07:26.150576 ip-10-0-140-214 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:07:26.150576 ip-10-0-140-214 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 21:07:26.150576 ip-10-0-140-214 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:07:26.150576 ip-10-0-140-214 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 21:07:26.150576 ip-10-0-140-214 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:07:26.152820 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.152710 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 21:07:26.157940 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157925 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:26.157940 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157940 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157944 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157947 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157950 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157953 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157956 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157958 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157961 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157964 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157966 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157969 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157972 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157974 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157977 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157980 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157982 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157991 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157995 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.157997 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158000 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:26.158004 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158003 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158005 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158008 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158023 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158026 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158030 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158032 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158035 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158037 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158040 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158042 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158045 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158047 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158050 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158052 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158055 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158057 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158060 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158062 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:26.158522 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158064 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158069 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158072 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158076 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158079 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158082 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158084 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158087 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158089 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158093 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158095 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158097 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158100 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158102 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158105 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158109 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158112 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158114 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158117 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158119 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:26.158959 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158122 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158125 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158127 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158130 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158132 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158135 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158138 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158140 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158143 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158145 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158147 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158150 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158152 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158155 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158157 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158159 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158162 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158164 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158169 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158172 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:26.159462 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158175 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158180 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158184 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158187 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158189 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158192 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158195 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158198 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158201 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158204 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158207 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158210 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158212 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158215 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158217 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158220 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158223 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158225 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158228 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158896 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:26.159933 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158903 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158906 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158908 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158911 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158913 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158916 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158918 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158921 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158923 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158926 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158928 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158931 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158933 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158936 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158938 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158941 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158944 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158946 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158948 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158952 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:26.160426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158955 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158957 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158960 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158962 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158965 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158968 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158971 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158975 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158979 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158982 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158985 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158988 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158991 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158994 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158996 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.158999 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159002 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159004 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159007 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:26.160952 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159010 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159030 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159034 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159038 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159042 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159048 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159051 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159054 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159057 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159060 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159063 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159066 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159069 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159072 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159075 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159077 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159081 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159084 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159086 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:26.161435 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159090 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159093 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159096 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159098 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159101 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159103 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159106 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159108 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159111 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159113 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159116 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159118 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159121 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159123 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159126 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159128 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159130 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159133 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159137 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159139 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:26.161903 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159142 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159144 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159147 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159150 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159152 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159159 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159162 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159165 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159168 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159170 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159173 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159176 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159178 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159181 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159183 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159186 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159188 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159191 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159193 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159196 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:26.162400 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159544 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159550 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159553 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159557 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159560 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159563 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159566 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159569 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159572 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159574 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159577 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159580 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159583 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159585 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159588 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159591 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159593 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159598 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159600 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159602 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:26.162886 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159605 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159608 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159610 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159612 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159615 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159618 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159620 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159623 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159625 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159628 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159630 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159633 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159635 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159638 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159640 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159643 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159645 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159648 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159650 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159653 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:26.163384 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159655 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159657 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159660 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159664 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159667 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159670 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159673 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159676 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159679 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159684 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159686 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159689 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159691 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159694 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159697 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159699 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159702 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159705 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159707 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:26.163869 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159710 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159712 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159715 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159717 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159719 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159722 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159724 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159727 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159729 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159731 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159734 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159736 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159739 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159741 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159744 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159746 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159749 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159751 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159753 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159756 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:26.164373 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159759 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159763 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159767 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159770 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159772 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159775 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159777 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159780 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159782 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159785 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159789 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159791 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159793 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159796 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159798 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159801 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159803 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159806 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159809 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.159812 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159882 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 21:07:26.164856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159888 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159894 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159899 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159902 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159906 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159909 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159913 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159916 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159919 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159922 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159925 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159928 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159931 2565 flags.go:64] FLAG: --cgroup-root="" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159935 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159939 2565 flags.go:64] FLAG: --client-ca-file="" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159942 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159945 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159949 2565 flags.go:64] FLAG: --cluster-domain="" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159951 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159954 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159957 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159962 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159965 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 21:07:26.165394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159968 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159971 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159974 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159977 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159980 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159982 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159985 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159988 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159996 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.159999 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160002 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160005 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160007 2565 flags.go:64] FLAG: --enable-server="true" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160010 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160031 2565 flags.go:64] FLAG: --event-burst="100" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160035 2565 flags.go:64] FLAG: --event-qps="50" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160042 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160044 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160048 2565 flags.go:64] FLAG: --eviction-hard="" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160051 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160054 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160057 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160061 2565 flags.go:64] FLAG: --eviction-soft="" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160064 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160067 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 21:07:26.165946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160070 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160073 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160076 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160078 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160081 2565 flags.go:64] FLAG: --feature-gates="" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160086 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160089 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160092 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160094 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160097 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160100 2565 flags.go:64] FLAG: --help="false" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160103 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160106 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160108 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160111 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160114 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160117 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160120 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160123 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160126 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160129 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160131 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160134 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160137 2565 flags.go:64] FLAG: --kube-reserved="" Jun 08 21:07:26.166589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160140 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160142 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160145 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160148 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160151 2565 flags.go:64] FLAG: --lock-file="" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160155 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160157 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160160 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160166 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160168 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160171 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160174 2565 flags.go:64] FLAG: --logging-format="text" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160176 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160182 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160184 2565 flags.go:64] FLAG: --manifest-url="" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160187 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160191 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160194 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160198 2565 flags.go:64] FLAG: --max-pods="110" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160201 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160204 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160206 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160209 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160212 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160215 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 21:07:26.167236 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160217 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160223 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160226 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160229 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160232 2565 flags.go:64] FLAG: --pod-cidr="" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160234 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160239 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160242 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160245 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160248 2565 flags.go:64] FLAG: --port="10250" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160251 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160254 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b66329930f2f6fe" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160257 2565 flags.go:64] FLAG: --qos-reserved="" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160261 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160264 2565 flags.go:64] FLAG: --register-node="true" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160267 2565 flags.go:64] FLAG: --register-with-taints="" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160271 2565 flags.go:64] FLAG: --registry-burst="10" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160274 2565 flags.go:64] FLAG: --registry-qps="5" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160276 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160279 2565 flags.go:64] FLAG: --reserved-memory="" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160284 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160287 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160290 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160292 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160295 2565 flags.go:64] FLAG: --runonce="false" Jun 08 21:07:26.168182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160298 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160301 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160304 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160306 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160309 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160312 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160315 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160318 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160321 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160324 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160327 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160329 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160332 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160335 2565 flags.go:64] FLAG: --system-cgroups="" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160338 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160342 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160345 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160348 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160351 2565 flags.go:64] FLAG: --tls-min-version="" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160354 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160358 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160361 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160363 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160366 2565 flags.go:64] FLAG: --v="2" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160370 2565 flags.go:64] FLAG: --version="false" Jun 08 21:07:26.168871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160373 2565 flags.go:64] FLAG: --vmodule="" Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160377 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.160381 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160490 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160493 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160496 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160499 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160502 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160504 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160507 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160510 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160512 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160515 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160517 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160520 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160522 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160525 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160527 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160530 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160532 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:26.169509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160535 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160537 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160540 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160542 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160545 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160547 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160550 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160554 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160556 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160559 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160561 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160564 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160567 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160570 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160573 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160575 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160577 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160580 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160583 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160585 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:26.170009 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160587 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160590 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160592 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160596 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160600 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160602 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160605 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160607 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160610 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160612 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160615 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160617 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160620 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160622 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160625 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160627 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160629 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160632 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160635 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:26.170582 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160638 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160640 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160643 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160645 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160649 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160653 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160656 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160659 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160662 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160665 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160667 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160670 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160673 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160675 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160678 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160680 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160683 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160685 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160689 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:26.171063 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160692 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160695 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160698 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160701 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160704 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160706 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160709 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160711 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160714 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160716 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160719 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160722 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160724 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160728 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160730 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160733 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160735 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160738 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160740 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160743 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:26.171533 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160746 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160749 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160751 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.160754 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.161977 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.169929 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.169943 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.170873 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.170884 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170945 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170951 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170954 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170957 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170960 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170963 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:26.172010 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170966 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170969 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170971 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170974 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170977 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170980 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170983 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170986 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170990 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170993 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170997 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.170999 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171008 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171011 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171030 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171033 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171035 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171038 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171041 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171044 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:26.172406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171046 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171049 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171051 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171054 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171057 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171060 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171062 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171065 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171067 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171070 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171073 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171076 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171078 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171081 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171084 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171086 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171089 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171092 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171094 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171097 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:26.172898 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171099 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171102 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171104 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171107 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171110 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171112 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171115 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171118 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171120 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171123 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171126 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171128 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171131 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171134 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171136 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171139 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171142 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171145 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171148 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171152 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:26.173398 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171157 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171163 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171167 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171170 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171173 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171176 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171179 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171181 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171185 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171188 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171192 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171196 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171199 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171203 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171205 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171208 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171211 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171213 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171215 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:26.173915 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171218 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171220 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171223 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171226 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171228 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171231 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171233 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171236 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171239 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171241 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171244 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171246 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171249 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171251 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.171256 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:07:26.174491 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171394 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171399 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171402 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171405 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171408 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171410 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171413 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171416 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171418 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171421 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171423 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171425 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171428 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171431 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171434 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171436 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171439 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171442 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171444 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171447 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:07:26.174857 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171449 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171452 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171454 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171457 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171459 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171462 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171465 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171467 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171470 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171472 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171474 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171476 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171479 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171481 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171484 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171486 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171488 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171491 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171493 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171497 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:07:26.175350 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171501 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171503 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171506 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171509 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171511 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171515 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171518 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171520 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171523 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171527 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171532 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171536 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171541 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171544 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171548 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171552 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171556 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171559 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171562 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:07:26.175832 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171565 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171568 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171571 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171573 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171576 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171578 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171581 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171584 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171586 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171589 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171591 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171593 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171596 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171598 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171600 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171603 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171605 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171608 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171610 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:07:26.176300 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171613 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171615 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171618 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171620 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171623 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171625 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171627 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171630 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171632 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171635 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171637 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171640 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171642 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171645 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171647 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171649 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171652 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171654 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171657 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171659 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:07:26.176751 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:26.171662 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:07:26.177235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.171666 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:07:26.177235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.171761 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 21:07:26.177235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.173875 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 21:07:26.177235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.175283 2565 server.go:1019] "Starting client certificate rotation" Jun 08 21:07:26.177235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.175385 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:07:26.177235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.175417 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:07:26.178191 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.178178 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:07:26.179440 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.179427 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:07:26.189308 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.189291 2565 log.go:25] "Validated CRI v1 runtime API" Jun 08 21:07:26.193921 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.193906 2565 log.go:25] "Validated CRI v1 image API" Jun 08 21:07:26.194763 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.194751 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 21:07:26.197965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.197946 2565 fs.go:135] Filesystem UUIDs: map[5b97d8bf-385e-498f-ae62-70852605340a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b8235790-8a98-43b6-8069-3ae9d3002d8e:/dev/nvme0n1p4] Jun 08 21:07:26.198068 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.197964 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 21:07:26.205093 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.204959 2565 manager.go:216] Machine: {Timestamp:2026-06-08 21:07:26.20346915 +0000 UTC m=+0.371482933 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093850 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21433aa675fbd31facbe03ba37f890 SystemUUID:ec21433a-a675-fbd3-1fac-be03ba37f890 BootID:a5772d3b-a12c-444c-b071-606329e3b2ee Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:b2:41:4b:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:b2:41:4b:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:25:9d:b7:f9:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 21:07:26.205093 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.205083 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 21:07:26.205215 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.205157 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 21:07:26.207895 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.207878 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:07:26.208650 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.208626 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 21:07:26.208777 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.208655 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-214.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 21:07:26.209417 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.209407 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 21:07:26.209455 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.209420 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 21:07:26.209455 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.209429 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:07:26.210881 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.210868 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:07:26.211782 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.211772 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 21:07:26.214941 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.214930 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:07:26.215061 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.215052 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 21:07:26.215105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.215081 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 08 21:07:26.215105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.215091 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 21:07:26.215105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.215104 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 21:07:26.215222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.215113 2565 kubelet.go:398] "Adding apiserver pod source" Jun 08 21:07:26.215222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.215121 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 21:07:26.215442 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.215431 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:07:26.215471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.215453 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:07:26.219191 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.219174 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 21:07:26.220796 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.220782 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 21:07:26.220850 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.220813 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 21:07:26.222185 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222173 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 21:07:26.222235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222190 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 21:07:26.222235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222195 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 21:07:26.222235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222203 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 21:07:26.222235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222211 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 21:07:26.222235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222217 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 21:07:26.222235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222226 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 21:07:26.222235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222231 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 21:07:26.222235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222237 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 21:07:26.222442 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222243 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 21:07:26.222442 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222251 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 21:07:26.222442 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.222257 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 21:07:26.224126 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.224114 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 21:07:26.224126 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.224123 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 21:07:26.225345 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.225324 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 21:07:26.225345 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.225328 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 21:07:26.227144 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.227127 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxfzf" Jun 08 21:07:26.227343 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.227331 2565 server.go:1268] "Started kubelet" Jun 08 21:07:26.227448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.227412 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 21:07:26.227486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.227415 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 21:07:26.227525 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.227504 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 21:07:26.228112 ip-10-0-140-214 systemd[1]: Started Kubernetes Kubelet. Jun 08 21:07:26.229276 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.229259 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 21:07:26.230365 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.230351 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 08 21:07:26.234647 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.234625 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-214.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 21:07:26.234726 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.234651 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxfzf" Jun 08 21:07:26.235794 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.234765 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-214.ec2.internal.18b7372d81196ea5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-214.ec2.internal,UID:ip-10-0-140-214.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-214.ec2.internal,},FirstTimestamp:2026-06-08 21:07:26.227304101 +0000 UTC m=+0.395317884,LastTimestamp:2026-06-08 21:07:26.227304101 +0000 UTC m=+0.395317884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-214.ec2.internal,}" Jun 08 21:07:26.236202 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.236183 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 21:07:26.237552 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.237534 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 21:07:26.237685 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.237665 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:26.238135 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238085 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 21:07:26.238681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238346 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 21:07:26.238681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238364 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 21:07:26.238681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238384 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 21:07:26.238681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238433 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 08 21:07:26.238681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238440 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 08 21:07:26.238681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238680 2565 factory.go:55] Registering systemd factory Jun 08 21:07:26.238985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238699 2565 factory.go:223] Registration of the systemd container factory successfully Jun 08 21:07:26.238985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238909 2565 factory.go:153] Registering CRI-O factory Jun 08 21:07:26.238985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238922 2565 factory.go:223] Registration of the crio container factory successfully Jun 08 21:07:26.238985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238973 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 21:07:26.238985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.238989 2565 factory.go:103] Registering Raw factory Jun 08 21:07:26.239248 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.239038 2565 manager.go:1196] Started watching for new ooms in manager Jun 08 21:07:26.239487 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.239475 2565 manager.go:349] Starting recovery of all containers Jun 08 21:07:26.245895 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.245864 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 21:07:26.256883 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.256868 2565 manager.go:354] Recovery completed Jun 08 21:07:26.258834 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.258816 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-214.ec2.internal\" not found" node="ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.260815 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.260804 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:26.262756 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.262742 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:26.262828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.262768 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:26.262828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.262778 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:26.263266 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.263249 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 21:07:26.263266 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.263263 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 21:07:26.263375 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.263273 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:26.263375 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.263281 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:07:26.263915 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.263901 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:26.263973 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.263924 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:26.263973 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.263934 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:26.264302 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.264291 2565 policy_none.go:49] "None policy: Start" Jun 08 21:07:26.264333 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.264307 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 21:07:26.264333 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.264317 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 21:07:26.265267 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.265256 2565 policy_none.go:47] "Start" Jun 08 21:07:26.303992 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.301526 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 21:07:26.303992 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.302794 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 21:07:26.303992 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.302884 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 21:07:26.303992 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.302906 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 21:07:26.303992 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.302967 2565 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 08 21:07:26.305134 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.305116 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:26.305589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.305575 2565 manager.go:337] "Starting Device Plugin manager" Jun 08 21:07:26.305690 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.305610 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 21:07:26.305690 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.305620 2565 server.go:87] "Starting device plugin registration server" Jun 08 21:07:26.306095 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.305826 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 21:07:26.306095 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.305839 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 21:07:26.306095 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.305910 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 21:07:26.306095 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.305989 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 21:07:26.306095 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.305999 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 21:07:26.306530 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.306485 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 21:07:26.306606 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.306563 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:26.403423 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.403368 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal"] Jun 08 21:07:26.403501 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.403431 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:26.405453 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.405436 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:26.405538 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.405461 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:26.405538 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.405470 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:26.406520 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.406506 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:26.406580 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.406568 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:26.406660 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.406645 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.406700 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.406673 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:26.407620 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407603 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:26.407620 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407616 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:26.407749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407627 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:26.407749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407637 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:26.407749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407641 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:26.407749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407654 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:26.407749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407680 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.407749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407603 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:26.407749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407706 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:26.407749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.407718 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:26.408714 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.408701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.408785 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.408721 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:07:26.409534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.409517 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:07:26.409620 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.409540 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:07:26.409620 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.409552 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:07:26.414537 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.414521 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.414619 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.414544 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-214.ec2.internal\": node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:26.424150 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.424134 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:26.436539 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.436522 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-214.ec2.internal\" not found" node="ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.439294 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.439279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c10ce4dca6803b8a0a0cff8bbc0d56c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal\" (UID: \"c10ce4dca6803b8a0a0cff8bbc0d56c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.439351 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.439302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10ce4dca6803b8a0a0cff8bbc0d56c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal\" (UID: \"c10ce4dca6803b8a0a0cff8bbc0d56c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.439351 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.439320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22d19728a6b30ba594ad5947a1e84ee3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-214.ec2.internal\" (UID: \"22d19728a6b30ba594ad5947a1e84ee3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.440847 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.440835 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-214.ec2.internal\" not found" node="ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.524905 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.524889 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:26.539997 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.539975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22d19728a6b30ba594ad5947a1e84ee3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-214.ec2.internal\" (UID: \"22d19728a6b30ba594ad5947a1e84ee3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.540069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.540002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22d19728a6b30ba594ad5947a1e84ee3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-214.ec2.internal\" (UID: \"22d19728a6b30ba594ad5947a1e84ee3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.540069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.540048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c10ce4dca6803b8a0a0cff8bbc0d56c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal\" (UID: \"c10ce4dca6803b8a0a0cff8bbc0d56c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.540146 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.540067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10ce4dca6803b8a0a0cff8bbc0d56c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal\" (UID: \"c10ce4dca6803b8a0a0cff8bbc0d56c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.540146 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.540090 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10ce4dca6803b8a0a0cff8bbc0d56c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal\" (UID: \"c10ce4dca6803b8a0a0cff8bbc0d56c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.540146 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.540116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c10ce4dca6803b8a0a0cff8bbc0d56c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal\" (UID: \"c10ce4dca6803b8a0a0cff8bbc0d56c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.625690 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.625671 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:26.726437 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.726387 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:26.740687 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.740668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.745912 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:26.745160 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" Jun 08 21:07:26.827136 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.827111 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:26.927690 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:26.927668 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:27.028173 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:27.028121 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:27.128770 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:27.128747 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:27.175350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.175217 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 21:07:27.175845 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.175465 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:07:27.229726 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:27.229703 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:27.240632 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.240608 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 21:02:26 +0000 UTC" deadline="2028-03-15 14:40:35.794619814 +0000 UTC" Jun 08 21:07:27.240681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.240632 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15497h33m8.55399015s" Jun 08 21:07:27.244475 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.244458 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:27.252342 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:27.252319 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10ce4dca6803b8a0a0cff8bbc0d56c3.slice/crio-39facd80fe6f18c7217c32cbefe40daf675030038ded6d54d834b36a4d8afdba WatchSource:0}: Error finding container 39facd80fe6f18c7217c32cbefe40daf675030038ded6d54d834b36a4d8afdba: Status 404 returned error can't find the container with id 39facd80fe6f18c7217c32cbefe40daf675030038ded6d54d834b36a4d8afdba Jun 08 21:07:27.252799 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:27.252788 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d19728a6b30ba594ad5947a1e84ee3.slice/crio-68d8f2f7ad12b6bfb658c046e3d0d367736b61f14e24473836b8026e7cb9d398 WatchSource:0}: Error finding container 68d8f2f7ad12b6bfb658c046e3d0d367736b61f14e24473836b8026e7cb9d398: Status 404 returned error can't find the container with id 68d8f2f7ad12b6bfb658c046e3d0d367736b61f14e24473836b8026e7cb9d398 Jun 08 21:07:27.256709 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.256697 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:07:27.306482 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.306389 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" event={"ID":"c10ce4dca6803b8a0a0cff8bbc0d56c3","Type":"ContainerStarted","Data":"39facd80fe6f18c7217c32cbefe40daf675030038ded6d54d834b36a4d8afdba"} Jun 08 21:07:27.307496 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.307465 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" event={"ID":"22d19728a6b30ba594ad5947a1e84ee3","Type":"ContainerStarted","Data":"68d8f2f7ad12b6bfb658c046e3d0d367736b61f14e24473836b8026e7cb9d398"} Jun 08 21:07:27.330645 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:27.330626 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:27.430968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.430626 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:27.430968 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:27.430757 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:27.531508 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:27.531478 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:27.632004 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:27.631940 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-214.ec2.internal\" not found" Jun 08 21:07:27.660171 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.660150 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:27.738226 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.738206 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" Jun 08 21:07:27.749608 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.749549 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:07:27.750715 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.750683 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" Jun 08 21:07:27.759282 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:27.759262 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:07:28.216324 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.216298 2565 apiserver.go:52] "Watching apiserver" Jun 08 21:07:28.223942 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.223918 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 21:07:28.225465 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.225441 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-rzngq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal","openshift-multus/multus-additional-cni-plugins-qtq7c","openshift-multus/network-metrics-daemon-r2bj4","kube-system/global-pull-secret-syncer-46vwd","kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn","openshift-dns/node-resolver-7hxfk","openshift-multus/multus-w825h","openshift-network-diagnostics/network-check-target-k9jph","openshift-network-operator/iptables-alerter-5s7ts","openshift-ovn-kubernetes/ovnkube-node-mwdgp","kube-system/konnectivity-agent-f4x86","openshift-cluster-node-tuning-operator/tuned-xrb5t"] Jun 08 21:07:28.226902 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.226881 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.228340 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.228321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:28.229242 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.229208 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 21:07:28.229356 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.229321 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-88qsg\"" Jun 08 21:07:28.229468 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.229451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 21:07:28.229731 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.229711 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 21:07:28.229815 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.229760 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.230743 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.230725 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 21:07:28.230834 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.230749 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hrp99\"" Jun 08 21:07:28.230998 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.230986 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 21:07:28.231501 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.231483 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:28.231580 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.231555 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:28.232491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.232057 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 21:07:28.232491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.232181 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 21:07:28.232491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.232234 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 21:07:28.232491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.232311 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 21:07:28.232491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.232320 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 21:07:28.232491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.232239 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pnbd5\"" Jun 08 21:07:28.232773 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.232643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.232773 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.232695 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:28.233816 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.233796 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.235508 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.235488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w825h" Jun 08 21:07:28.236107 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.236087 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9g8jw\"" Jun 08 21:07:28.236471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.236121 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 21:07:28.236471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.236151 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:07:28.236471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.236424 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.237422 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.237402 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 21:07:28.237669 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.237639 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nzzlq\"" Jun 08 21:07:28.237798 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.237656 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.238929 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.238520 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 21:07:28.238929 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.238638 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 21:07:28.238929 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.238644 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 21:07:28.238929 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.238665 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 21:07:28.238929 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.238923 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-26wgg\"" Jun 08 21:07:28.239212 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.238968 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:28.239212 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.239044 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:28.240291 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.240137 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 21:07:28.240291 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.240137 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 21:07:28.240291 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.240198 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d5sjf\"" Jun 08 21:07:28.241211 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.241196 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.243136 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.242928 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.243444 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.243423 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 21:07:28.243935 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.243919 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 21:07:28.243975 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.243949 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:07:28.244322 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.244304 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zwb56\"" Jun 08 21:07:28.245400 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.245380 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 21:07:28.245774 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.245585 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 21:07:28.245774 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.245666 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9njw2\"" Jun 08 21:07:28.246676 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.246659 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 21:07:28.247038 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.246847 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 21:07:28.247179 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.247164 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 21:07:28.247248 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.247198 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 21:07:28.248084 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-etc-kubernetes\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.248175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248095 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f22e0f0a-0cdc-4c1d-a852-408d98572076-serviceca\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.248175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-cnibin\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.248175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-conf-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.248175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f22e0f0a-0cdc-4c1d-a852-408d98572076-host\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.248368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-etc-selinux\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.248368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:28.248368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-socket-dir-parent\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.248368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-netns\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.248368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-hostroot\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.248368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-k8s-cni-cncf-io\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.248368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vpr6\" (UniqueName: \"kubernetes.io/projected/f22e0f0a-0cdc-4c1d-a852-408d98572076-kube-api-access-7vpr6\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.248368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-socket-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-registration-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-sys-fs\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-run\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-var-lib-kubelet\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzhxh\" (UniqueName: \"kubernetes.io/projected/d69d2095-bac9-4160-b48b-58a1af9ddd11-kube-api-access-gzhxh\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55a22b3-abfb-47dd-a1ca-573d521c3352-tmp-dir\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-kubelet-config\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-sys\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248652 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6180f8ea-7395-4556-9699-7c1c127d1c67-agent-certs\") pod \"konnectivity-agent-f4x86\" (UID: \"6180f8ea-7395-4556-9699-7c1c127d1c67\") " pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-system-cni-dir\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.248696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248720 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248744 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysctl-d\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-tmp\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-multus-certs\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz8m6\" (UniqueName: \"kubernetes.io/projected/f26f36a5-4005-496b-a3a6-1fd09949eeda-kube-api-access-hz8m6\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-cnibin\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-kubelet\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjlbl\" (UniqueName: \"kubernetes.io/projected/e55a22b3-abfb-47dd-a1ca-573d521c3352-kube-api-access-xjlbl\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98d4443d-5324-45b1-a390-5008f031a6d6-multus-daemon-config\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6180f8ea-7395-4556-9699-7c1c127d1c67-konnectivity-ca\") pod \"konnectivity-agent-f4x86\" (UID: \"6180f8ea-7395-4556-9699-7c1c127d1c67\") " pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.248986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-cni-binary-copy\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-tuned\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98d4443d-5324-45b1-a390-5008f031a6d6-cni-binary-copy\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:28.249260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wlbl\" (UniqueName: \"kubernetes.io/projected/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-kube-api-access-8wlbl\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-cni-bin\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-cni-multus\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e55a22b3-abfb-47dd-a1ca-573d521c3352-hosts-file\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249278 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-os-release\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysconfig\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysctl-conf\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-systemd\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-system-cni-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-dbus\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-cni-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-device-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249509 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbzp4\" (UniqueName: \"kubernetes.io/projected/c101ce08-965d-4659-83d6-3c891032c66d-kube-api-access-gbzp4\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249533 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-lib-modules\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-os-release\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.249965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96n97\" (UniqueName: \"kubernetes.io/projected/98d4443d-5324-45b1-a390-5008f031a6d6-kube-api-access-96n97\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.250497 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249654 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-kubernetes\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.250497 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-host\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.250497 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249678 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:07:28.250497 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.249699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-modprobe-d\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.294975 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.294951 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqr44" Jun 08 21:07:28.302766 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.302746 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqr44" Jun 08 21:07:28.339206 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.339183 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 21:07:28.344542 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.344522 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:07:28.350375 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzhxh\" (UniqueName: \"kubernetes.io/projected/d69d2095-bac9-4160-b48b-58a1af9ddd11-kube-api-access-gzhxh\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.350483 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350384 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55a22b3-abfb-47dd-a1ca-573d521c3352-tmp-dir\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.350483 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-kubelet-config\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.350483 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-sys\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.350483 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-slash\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.350483 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-cni-bin\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.350641 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.350641 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6180f8ea-7395-4556-9699-7c1c127d1c67-agent-certs\") pod \"konnectivity-agent-f4x86\" (UID: \"6180f8ea-7395-4556-9699-7c1c127d1c67\") " pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:28.350641 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-system-cni-dir\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.350641 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.350641 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.350641 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysctl-d\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.350865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-tmp\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.350865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-multus-certs\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.350865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350739 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55a22b3-abfb-47dd-a1ca-573d521c3352-tmp-dir\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.350865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-kubelet-config\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.350865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350828 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-multus-certs\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.350865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-sys\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.351114 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350896 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.351114 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.350942 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-system-cni-dir\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.351219 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351117 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.351219 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351141 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 21:07:28.351287 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351236 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysctl-d\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.351412 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351386 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.351506 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz8m6\" (UniqueName: \"kubernetes.io/projected/f26f36a5-4005-496b-a3a6-1fd09949eeda-kube-api-access-hz8m6\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:28.351506 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56z7l\" (UniqueName: \"kubernetes.io/projected/e84f215f-cb69-4120-a5ee-1027a66cc97f-kube-api-access-56z7l\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.351506 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-run-netns\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.351506 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-log-socket\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.351694 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-cnibin\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.351694 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-kubelet\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.351694 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.351582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-cnibin\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.352072 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjlbl\" (UniqueName: \"kubernetes.io/projected/e55a22b3-abfb-47dd-a1ca-573d521c3352-kube-api-access-xjlbl\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.352129 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352081 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-kubelet\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.352129 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-ovn\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.352234 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-node-log\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.352234 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovn-node-metrics-cert\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.352234 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98d4443d-5324-45b1-a390-5008f031a6d6-multus-daemon-config\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.352234 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6180f8ea-7395-4556-9699-7c1c127d1c67-konnectivity-ca\") pod \"konnectivity-agent-f4x86\" (UID: \"6180f8ea-7395-4556-9699-7c1c127d1c67\") " pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:28.352421 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-cni-binary-copy\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.352421 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.352421 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-tuned\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.352421 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-kubelet\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.352794 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352767 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98d4443d-5324-45b1-a390-5008f031a6d6-multus-daemon-config\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.352884 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352769 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6180f8ea-7395-4556-9699-7c1c127d1c67-konnectivity-ca\") pod \"konnectivity-agent-f4x86\" (UID: \"6180f8ea-7395-4556-9699-7c1c127d1c67\") " pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:28.352884 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352816 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-var-lib-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.352884 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352846 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-env-overrides\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.352884 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98d4443d-5324-45b1-a390-5008f031a6d6-cni-binary-copy\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.353163 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352889 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-cni-binary-copy\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.353163 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:28.353163 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c101ce08-965d-4659-83d6-3c891032c66d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.353163 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.353163 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.352968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wlbl\" (UniqueName: \"kubernetes.io/projected/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-kube-api-access-8wlbl\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.353163 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.353050 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:28.353163 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-systemd\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.353163 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.353165 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret podName:e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:28.853130105 +0000 UTC m=+3.021143878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret") pod "global-pull-secret-syncer-46vwd" (UID: "e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htv6s\" (UniqueName: \"kubernetes.io/projected/f505d281-c4d1-47bb-8f7f-3061a3adf170-kube-api-access-htv6s\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-cni-bin\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-cni-multus\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353335 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-cni-multus\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353342 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-var-lib-cni-bin\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353349 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e55a22b3-abfb-47dd-a1ca-573d521c3352-hosts-file\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-os-release\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysconfig\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysctl-conf\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e55a22b3-abfb-47dd-a1ca-573d521c3352-hosts-file\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-systemd\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e84f215f-cb69-4120-a5ee-1027a66cc97f-host-slash\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353484 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-os-release\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysconfig\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.353519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-system-cni-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-dbus\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-system-cni-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e84f215f-cb69-4120-a5ee-1027a66cc97f-iptables-alerter-script\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353570 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-sysctl-conf\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-etc-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovnkube-config\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98d4443d-5324-45b1-a390-5008f031a6d6-cni-binary-copy\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-dbus\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-cni-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353701 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-systemd\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353706 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-cni-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-device-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-device-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbzp4\" (UniqueName: \"kubernetes.io/projected/c101ce08-965d-4659-83d6-3c891032c66d-kube-api-access-gbzp4\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-lib-modules\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353935 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-cni-netd\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.354190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.353974 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-lib-modules\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-os-release\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96n97\" (UniqueName: \"kubernetes.io/projected/98d4443d-5324-45b1-a390-5008f031a6d6-kube-api-access-96n97\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-kubernetes\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-host\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354110 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-os-release\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-modprobe-d\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354167 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-kubernetes\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovnkube-script-lib\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-etc-kubernetes\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354253 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f22e0f0a-0cdc-4c1d-a852-408d98572076-serviceca\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-cnibin\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-conf-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-etc-kubernetes\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f22e0f0a-0cdc-4c1d-a852-408d98572076-host\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-etc-selinux\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-etc-selinux\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.354968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354407 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-conf-dir\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-host\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c101ce08-965d-4659-83d6-3c891032c66d-cnibin\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354475 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f22e0f0a-0cdc-4c1d-a852-408d98572076-host\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354510 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-systemd-units\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-socket-dir-parent\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.354541 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-netns\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.354594 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:07:28.854578809 +0000 UTC m=+3.022592586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354615 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-multus-socket-dir-parent\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-netns\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-hostroot\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-hostroot\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-k8s-cni-cncf-io\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98d4443d-5324-45b1-a390-5008f031a6d6-host-run-k8s-cni-cncf-io\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.354936 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f22e0f0a-0cdc-4c1d-a852-408d98572076-serviceca\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vpr6\" (UniqueName: \"kubernetes.io/projected/f22e0f0a-0cdc-4c1d-a852-408d98572076-kube-api-access-7vpr6\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.355591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-socket-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-registration-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355280 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-tmp\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-sys-fs\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-tuned\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-run\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-var-lib-kubelet\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-registration-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355400 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-socket-dir\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d69d2095-bac9-4160-b48b-58a1af9ddd11-sys-fs\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355466 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-run\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-var-lib-kubelet\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6180f8ea-7395-4556-9699-7c1c127d1c67-agent-certs\") pod \"konnectivity-agent-f4x86\" (UID: \"6180f8ea-7395-4556-9699-7c1c127d1c67\") " pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:28.356200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.355560 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-etc-modprobe-d\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.360582 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.360141 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:28.360582 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.360169 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:28.360582 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.360190 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r84q for pod openshift-network-diagnostics/network-check-target-k9jph: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:28.360582 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.360249 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q podName:0c84d74a-a7e6-478f-9651-1cdbfa45c9fc nodeName:}" failed. No retries permitted until 2026-06-08 21:07:28.86022783 +0000 UTC m=+3.028241616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6r84q" (UniqueName: "kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q") pod "network-check-target-k9jph" (UID: "0c84d74a-a7e6-478f-9651-1cdbfa45c9fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:28.361466 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.361432 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzhxh\" (UniqueName: \"kubernetes.io/projected/d69d2095-bac9-4160-b48b-58a1af9ddd11-kube-api-access-gzhxh\") pod \"aws-ebs-csi-driver-node-xr5vn\" (UID: \"d69d2095-bac9-4160-b48b-58a1af9ddd11\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.364190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.364032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vpr6\" (UniqueName: \"kubernetes.io/projected/f22e0f0a-0cdc-4c1d-a852-408d98572076-kube-api-access-7vpr6\") pod \"node-ca-rzngq\" (UID: \"f22e0f0a-0cdc-4c1d-a852-408d98572076\") " pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.364190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.364156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wlbl\" (UniqueName: \"kubernetes.io/projected/c10ae7d9-253a-41fa-aa14-1dae63f5d84a-kube-api-access-8wlbl\") pod \"tuned-xrb5t\" (UID: \"c10ae7d9-253a-41fa-aa14-1dae63f5d84a\") " pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.364409 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.364376 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjlbl\" (UniqueName: \"kubernetes.io/projected/e55a22b3-abfb-47dd-a1ca-573d521c3352-kube-api-access-xjlbl\") pod \"node-resolver-7hxfk\" (UID: \"e55a22b3-abfb-47dd-a1ca-573d521c3352\") " pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.364485 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.364411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbzp4\" (UniqueName: \"kubernetes.io/projected/c101ce08-965d-4659-83d6-3c891032c66d-kube-api-access-gbzp4\") pod \"multus-additional-cni-plugins-qtq7c\" (UID: \"c101ce08-965d-4659-83d6-3c891032c66d\") " pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.365437 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.365413 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96n97\" (UniqueName: \"kubernetes.io/projected/98d4443d-5324-45b1-a390-5008f031a6d6-kube-api-access-96n97\") pod \"multus-w825h\" (UID: \"98d4443d-5324-45b1-a390-5008f031a6d6\") " pod="openshift-multus/multus-w825h" Jun 08 21:07:28.365885 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.365865 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz8m6\" (UniqueName: \"kubernetes.io/projected/f26f36a5-4005-496b-a3a6-1fd09949eeda-kube-api-access-hz8m6\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:28.456610 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456765 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovnkube-script-lib\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456765 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-run-ovn-kubernetes\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456765 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-systemd-units\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456798 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-slash\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-cni-bin\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-slash\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56z7l\" (UniqueName: \"kubernetes.io/projected/e84f215f-cb69-4120-a5ee-1027a66cc97f-kube-api-access-56z7l\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456875 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-cni-bin\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.456922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-run-netns\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-log-socket\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-ovn\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-node-log\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456997 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-log-socket\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456843 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-systemd-units\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.456955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-run-netns\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovn-node-metrics-cert\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457062 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-node-log\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-kubelet\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-var-lib-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-env-overrides\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457064 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-ovn\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-systemd\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-var-lib-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457166 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-kubelet\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htv6s\" (UniqueName: \"kubernetes.io/projected/f505d281-c4d1-47bb-8f7f-3061a3adf170-kube-api-access-htv6s\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457196 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-run-systemd\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.457388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e84f215f-cb69-4120-a5ee-1027a66cc97f-host-slash\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e84f215f-cb69-4120-a5ee-1027a66cc97f-iptables-alerter-script\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovnkube-script-lib\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457253 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-etc-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovnkube-config\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-cni-netd\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457282 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e84f215f-cb69-4120-a5ee-1027a66cc97f-host-slash\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457335 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-etc-openvswitch\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f505d281-c4d1-47bb-8f7f-3061a3adf170-host-cni-netd\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-env-overrides\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457753 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovnkube-config\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.458448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.457804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e84f215f-cb69-4120-a5ee-1027a66cc97f-iptables-alerter-script\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.459492 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.459474 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f505d281-c4d1-47bb-8f7f-3061a3adf170-ovn-node-metrics-cert\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.466355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.466306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56z7l\" (UniqueName: \"kubernetes.io/projected/e84f215f-cb69-4120-a5ee-1027a66cc97f-kube-api-access-56z7l\") pod \"iptables-alerter-5s7ts\" (UID: \"e84f215f-cb69-4120-a5ee-1027a66cc97f\") " pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.466425 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.466387 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htv6s\" (UniqueName: \"kubernetes.io/projected/f505d281-c4d1-47bb-8f7f-3061a3adf170-kube-api-access-htv6s\") pod \"ovnkube-node-mwdgp\" (UID: \"f505d281-c4d1-47bb-8f7f-3061a3adf170\") " pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.538325 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.538289 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" Jun 08 21:07:28.549005 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.548986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:28.556660 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.556638 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" Jun 08 21:07:28.562196 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.562173 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" Jun 08 21:07:28.569809 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.569788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w825h" Jun 08 21:07:28.575550 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.575533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rzngq" Jun 08 21:07:28.583158 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.583136 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7hxfk" Jun 08 21:07:28.590720 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.590694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5s7ts" Jun 08 21:07:28.596301 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.596283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:28.860138 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.860060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:28.860138 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.860116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:28.860333 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.860213 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:28.860333 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.860215 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:28.860333 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.860264 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:07:29.860251723 +0000 UTC m=+4.028265493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:28.860333 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.860282 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret podName:e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:29.860272547 +0000 UTC m=+4.028286319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret") pod "global-pull-secret-syncer-46vwd" (UID: "e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:28.961088 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:28.961061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:28.961222 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.961209 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:28.961263 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.961227 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:28.961263 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.961236 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r84q for pod openshift-network-diagnostics/network-check-target-k9jph: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:28.961323 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:28.961287 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q podName:0c84d74a-a7e6-478f-9651-1cdbfa45c9fc nodeName:}" failed. No retries permitted until 2026-06-08 21:07:29.961272342 +0000 UTC m=+4.129286123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r84q" (UniqueName: "kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q") pod "network-check-target-k9jph" (UID: "0c84d74a-a7e6-478f-9651-1cdbfa45c9fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:29.116481 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:29.116441 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69d2095_bac9_4160_b48b_58a1af9ddd11.slice/crio-cd20fd0e35724103bf32e3275df66cb55908870b080ab7e0e8264251960e3734 WatchSource:0}: Error finding container cd20fd0e35724103bf32e3275df66cb55908870b080ab7e0e8264251960e3734: Status 404 returned error can't find the container with id cd20fd0e35724103bf32e3275df66cb55908870b080ab7e0e8264251960e3734 Jun 08 21:07:29.117665 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:29.117642 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc101ce08_965d_4659_83d6_3c891032c66d.slice/crio-81275f260b275c54b70d03acf9391fda58c67975ec9db8304ea0a9553395eab4 WatchSource:0}: Error finding container 81275f260b275c54b70d03acf9391fda58c67975ec9db8304ea0a9553395eab4: Status 404 returned error can't find the container with id 81275f260b275c54b70d03acf9391fda58c67975ec9db8304ea0a9553395eab4 Jun 08 21:07:29.118308 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:29.118196 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22e0f0a_0cdc_4c1d_a852_408d98572076.slice/crio-168c00fa47fd0d08dd3a0c729fd785b99ea49c06a66aae381d23af8b48e291dd WatchSource:0}: Error finding container 168c00fa47fd0d08dd3a0c729fd785b99ea49c06a66aae381d23af8b48e291dd: Status 404 returned error can't find the container with id 168c00fa47fd0d08dd3a0c729fd785b99ea49c06a66aae381d23af8b48e291dd Jun 08 21:07:29.122734 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:29.122714 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84f215f_cb69_4120_a5ee_1027a66cc97f.slice/crio-06e27c61505cece528cab22a721832cafa5610d4eee1966f6c778c90d88edf31 WatchSource:0}: Error finding container 06e27c61505cece528cab22a721832cafa5610d4eee1966f6c778c90d88edf31: Status 404 returned error can't find the container with id 06e27c61505cece528cab22a721832cafa5610d4eee1966f6c778c90d88edf31 Jun 08 21:07:29.123781 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:07:29.123763 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf505d281_c4d1_47bb_8f7f_3061a3adf170.slice/crio-24d6ea1ebaa087296f7530c5db4171e1a117fc479cee6ee969e9da1c62adbc2c WatchSource:0}: Error finding container 24d6ea1ebaa087296f7530c5db4171e1a117fc479cee6ee969e9da1c62adbc2c: Status 404 returned error can't find the container with id 24d6ea1ebaa087296f7530c5db4171e1a117fc479cee6ee969e9da1c62adbc2c Jun 08 21:07:29.306058 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.305988 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:02:28 +0000 UTC" deadline="2027-11-20 16:31:49.679557671 +0000 UTC" Jun 08 21:07:29.306058 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.306057 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12715h24m20.373504899s" Jun 08 21:07:29.312347 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.312167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" event={"ID":"22d19728a6b30ba594ad5947a1e84ee3","Type":"ContainerStarted","Data":"ead099f3e75daa4b59cba0f69228de208750f208eb9f47a5d62c10d565e8bb69"} Jun 08 21:07:29.313296 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.313269 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" event={"ID":"c10ae7d9-253a-41fa-aa14-1dae63f5d84a","Type":"ContainerStarted","Data":"5cf9a5f010e18251926f1ff49a0230e3590db818dd5048c94f82436843bd9841"} Jun 08 21:07:29.314386 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.314363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"24d6ea1ebaa087296f7530c5db4171e1a117fc479cee6ee969e9da1c62adbc2c"} Jun 08 21:07:29.315534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.315512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5s7ts" event={"ID":"e84f215f-cb69-4120-a5ee-1027a66cc97f","Type":"ContainerStarted","Data":"06e27c61505cece528cab22a721832cafa5610d4eee1966f6c778c90d88edf31"} Jun 08 21:07:29.317553 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.317510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerStarted","Data":"81275f260b275c54b70d03acf9391fda58c67975ec9db8304ea0a9553395eab4"} Jun 08 21:07:29.318977 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.318955 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" event={"ID":"d69d2095-bac9-4160-b48b-58a1af9ddd11","Type":"ContainerStarted","Data":"cd20fd0e35724103bf32e3275df66cb55908870b080ab7e0e8264251960e3734"} Jun 08 21:07:29.320999 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.320977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f4x86" event={"ID":"6180f8ea-7395-4556-9699-7c1c127d1c67","Type":"ContainerStarted","Data":"9fef56e874e7081eb5fa1607bba4e20f03d8da1fb15a1fe4b4a19275a3f9216e"} Jun 08 21:07:29.321982 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.321959 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7hxfk" event={"ID":"e55a22b3-abfb-47dd-a1ca-573d521c3352","Type":"ContainerStarted","Data":"b2271dac3ecc4c9b64ef2c2fb1ba7bc425c0d8c556f1f92b1fb786f7a7a0e56f"} Jun 08 21:07:29.323065 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.323043 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w825h" event={"ID":"98d4443d-5324-45b1-a390-5008f031a6d6","Type":"ContainerStarted","Data":"c711f9ddf0e0129a41b7f0d30e76bb4e36ea45ab5abfea4f0ed2bad18bac4267"} Jun 08 21:07:29.324029 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.323990 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rzngq" event={"ID":"f22e0f0a-0cdc-4c1d-a852-408d98572076","Type":"ContainerStarted","Data":"168c00fa47fd0d08dd3a0c729fd785b99ea49c06a66aae381d23af8b48e291dd"} Jun 08 21:07:29.868237 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.868155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:29.868399 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.868282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:29.868399 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:29.868338 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:29.868399 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:29.868392 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:29.868551 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:29.868409 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:07:31.868389497 +0000 UTC m=+6.036403283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:29.868551 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:29.868444 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret podName:e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:31.868428469 +0000 UTC m=+6.036442253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret") pod "global-pull-secret-syncer-46vwd" (UID: "e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:29.968999 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:29.968964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:29.969174 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:29.969156 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:29.969253 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:29.969178 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:29.969253 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:29.969190 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r84q for pod openshift-network-diagnostics/network-check-target-k9jph: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:29.969350 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:29.969253 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q podName:0c84d74a-a7e6-478f-9651-1cdbfa45c9fc nodeName:}" failed. No retries permitted until 2026-06-08 21:07:31.969235764 +0000 UTC m=+6.137249537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r84q" (UniqueName: "kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q") pod "network-check-target-k9jph" (UID: "0c84d74a-a7e6-478f-9651-1cdbfa45c9fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:30.306128 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:30.305856 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:30.306535 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:30.306189 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:30.306597 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:30.306569 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:30.306673 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:30.306652 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:30.306733 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:30.306723 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:30.306823 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:30.306805 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:30.306934 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:30.306901 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:02:28 +0000 UTC" deadline="2028-01-08 19:01:25.408989873 +0000 UTC" Jun 08 21:07:30.306987 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:30.306939 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13893h53m55.102056233s" Jun 08 21:07:30.332092 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:30.332059 2565 generic.go:356] "Generic (PLEG): container finished" podID="c10ce4dca6803b8a0a0cff8bbc0d56c3" containerID="839a6657abbf5d86cbfa8441ec3ceb2ccbe748f7b24f56f7d6ddb6489484e039" exitCode=0 Jun 08 21:07:30.332894 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:30.332866 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" event={"ID":"c10ce4dca6803b8a0a0cff8bbc0d56c3","Type":"ContainerDied","Data":"839a6657abbf5d86cbfa8441ec3ceb2ccbe748f7b24f56f7d6ddb6489484e039"} Jun 08 21:07:30.345933 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:30.345887 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-214.ec2.internal" podStartSLOduration=3.345870221 podStartE2EDuration="3.345870221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:29.326303122 +0000 UTC m=+3.494316914" watchObservedRunningTime="2026-06-08 21:07:30.345870221 +0000 UTC m=+4.513884023" Jun 08 21:07:31.343193 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:31.342552 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" event={"ID":"c10ce4dca6803b8a0a0cff8bbc0d56c3","Type":"ContainerStarted","Data":"923b757bfda7ea033bfa2074e24b14bb746dfa34c87fa6a3f7f8db0d3bceb59a"} Jun 08 21:07:31.886163 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:31.886128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:31.886328 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:31.886218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:31.886385 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:31.886334 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:31.886447 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:31.886390 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret podName:e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:35.886371633 +0000 UTC m=+10.054385410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret") pod "global-pull-secret-syncer-46vwd" (UID: "e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:31.886765 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:31.886742 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:31.886892 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:31.886807 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:07:35.886791582 +0000 UTC m=+10.054805357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:31.986640 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:31.986610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:31.986808 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:31.986785 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:31.986881 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:31.986809 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:31.986881 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:31.986821 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r84q for pod openshift-network-diagnostics/network-check-target-k9jph: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:31.986881 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:31.986872 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q podName:0c84d74a-a7e6-478f-9651-1cdbfa45c9fc nodeName:}" failed. No retries permitted until 2026-06-08 21:07:35.986854189 +0000 UTC m=+10.154867961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r84q" (UniqueName: "kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q") pod "network-check-target-k9jph" (UID: "0c84d74a-a7e6-478f-9651-1cdbfa45c9fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:32.311221 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:32.311142 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:32.311221 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:32.311154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:32.311419 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:32.311295 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:32.311475 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:32.311431 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:32.311637 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:32.311616 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:32.311782 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:32.311759 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:34.304133 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:34.304098 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:34.304566 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:34.304102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:34.304566 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:34.304220 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:34.304566 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:34.304285 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:34.304566 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:34.304098 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:34.304566 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:34.304370 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:35.918477 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:35.918435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:35.918937 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:35.918502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:35.918937 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:35.918618 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:35.918937 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:35.918675 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:07:43.918656887 +0000 UTC m=+18.086670657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:35.919136 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:35.919060 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:35.919136 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:35.919110 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret podName:e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:43.919095202 +0000 UTC m=+18.087108978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret") pod "global-pull-secret-syncer-46vwd" (UID: "e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:36.018827 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:36.018794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:36.019036 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:36.018928 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:36.019036 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:36.018941 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:36.019036 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:36.018949 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r84q for pod openshift-network-diagnostics/network-check-target-k9jph: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:36.019036 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:36.018996 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q podName:0c84d74a-a7e6-478f-9651-1cdbfa45c9fc nodeName:}" failed. No retries permitted until 2026-06-08 21:07:44.018980593 +0000 UTC m=+18.186994380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r84q" (UniqueName: "kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q") pod "network-check-target-k9jph" (UID: "0c84d74a-a7e6-478f-9651-1cdbfa45c9fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:36.303968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:36.303886 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:36.304129 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:36.303989 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:36.304398 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:36.304375 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:36.304500 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:36.304472 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:36.304657 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:36.304620 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:36.304763 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:36.304742 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:38.304076 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:38.304040 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:38.304510 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:38.304166 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:38.304581 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:38.304556 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:38.304669 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:38.304643 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:38.304733 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:38.304720 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:38.304822 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:38.304802 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:40.303878 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:40.303849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:40.303878 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:40.303849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:40.303878 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:40.303885 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:40.304423 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:40.304006 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:40.304494 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:40.304426 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:40.304546 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:40.304502 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:42.303506 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:42.303471 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:42.304100 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:42.303588 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:42.304100 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:42.303479 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:42.304100 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:42.303724 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:42.304100 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:42.303615 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:42.304100 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:42.303834 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:43.981763 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:43.981729 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:43.981763 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:43.981770 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:43.982194 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:43.981860 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:43.982194 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:43.981861 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:43.982194 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:43.981906 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:07:59.981893392 +0000 UTC m=+34.149907162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:07:43.982194 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:43.981919 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret podName:e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57 nodeName:}" failed. No retries permitted until 2026-06-08 21:07:59.981912324 +0000 UTC m=+34.149926095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret") pod "global-pull-secret-syncer-46vwd" (UID: "e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:07:44.082033 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:44.081990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:44.082167 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:44.082131 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:07:44.082167 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:44.082150 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:07:44.082167 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:44.082159 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r84q for pod openshift-network-diagnostics/network-check-target-k9jph: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:44.082279 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:44.082199 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q podName:0c84d74a-a7e6-478f-9651-1cdbfa45c9fc nodeName:}" failed. No retries permitted until 2026-06-08 21:08:00.082187765 +0000 UTC m=+34.250201535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r84q" (UniqueName: "kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q") pod "network-check-target-k9jph" (UID: "0c84d74a-a7e6-478f-9651-1cdbfa45c9fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:07:44.304105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:44.304034 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:44.304105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:44.304066 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:44.304316 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:44.304032 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:44.304316 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:44.304145 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:44.304316 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:44.304232 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:44.304316 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:44.304303 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:46.304007 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:46.303745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:46.304007 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:46.303830 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:46.304007 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:46.303832 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:46.304007 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:46.303893 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:46.304007 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:46.303910 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:46.304007 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:46.303975 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:48.303724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.303520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:48.303724 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:48.303603 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:48.303724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.303656 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:48.303724 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:48.303697 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:48.304701 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.304038 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:48.304701 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:48.304139 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:48.384045 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.383789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" event={"ID":"c10ae7d9-253a-41fa-aa14-1dae63f5d84a","Type":"ContainerStarted","Data":"deb6ab4e446d850f59e0fde9447f1d43656d1d08b3da4e762587d201c5aa5bcf"} Jun 08 21:07:48.386325 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.386299 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"4e78bbd01af0f014d4aa646f78cee9f54a75668d4b59207146affaed0334f26e"} Jun 08 21:07:48.388010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.387985 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerStarted","Data":"c2839bdc3c6be85a25745d2237050a94fe5ae5ed6cadd35ea7116fa6dcf9a2b2"} Jun 08 21:07:48.389888 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.389861 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" event={"ID":"d69d2095-bac9-4160-b48b-58a1af9ddd11","Type":"ContainerStarted","Data":"c61764a21288c49422775860d4cf81b7e005e488f5511ae6ba8094e8799397f6"} Jun 08 21:07:48.392255 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.392233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f4x86" event={"ID":"6180f8ea-7395-4556-9699-7c1c127d1c67","Type":"ContainerStarted","Data":"58035fff557dad6a6c2d69f70acb58204dd5a8e689f8af03f8eb4ded97d2b0b5"} Jun 08 21:07:48.399875 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.399834 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xrb5t" podStartSLOduration=3.366924776 podStartE2EDuration="22.399818542s" totalImagesPullingTime="19.032893766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:48.399583541 +0000 UTC m=+22.567597332" watchObservedRunningTime="2026-06-08 21:07:48.399818542 +0000 UTC m=+22.567832335" Jun 08 21:07:48.399999 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.399975 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-214.ec2.internal" podStartSLOduration=21.399969409 podStartE2EDuration="21.399969409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:31.358395374 +0000 UTC m=+5.526409167" watchObservedRunningTime="2026-06-08 21:07:48.399969409 +0000 UTC m=+22.567983200" Jun 08 21:07:48.434215 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.434181 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f4x86" podStartSLOduration=11.9472899 podStartE2EDuration="22.434168175s" totalImagesPullingTime="10.486878275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:48.433680279 +0000 UTC m=+22.601694071" watchObservedRunningTime="2026-06-08 21:07:48.434168175 +0000 UTC m=+22.602181967" Jun 08 21:07:48.928881 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.928797 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:48.929387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:48.929366 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:49.398324 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.398292 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7hxfk" event={"ID":"e55a22b3-abfb-47dd-a1ca-573d521c3352","Type":"ContainerStarted","Data":"a80015da457a4df7a8a1df2869064a341dc4da83bab19c002a264a05f8f07e81"} Jun 08 21:07:49.399757 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.399731 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w825h" event={"ID":"98d4443d-5324-45b1-a390-5008f031a6d6","Type":"ContainerStarted","Data":"fe1d2ce358bac02f319adfb585fb965b397d24138fe35f7257a10df968a92a38"} Jun 08 21:07:49.401084 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.401065 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rzngq" event={"ID":"f22e0f0a-0cdc-4c1d-a852-408d98572076","Type":"ContainerStarted","Data":"a9c69e1843577a057facad2cada4853ae943c276859ad996a6d9d35772c383a7"} Jun 08 21:07:49.403588 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.403571 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:07:49.403931 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.403913 2565 generic.go:356] "Generic (PLEG): container finished" podID="f505d281-c4d1-47bb-8f7f-3061a3adf170" containerID="928e997174f18d1224796fbb055d50bc5de7530c232670e6a780c22901af4db1" exitCode=1 Jun 08 21:07:49.404036 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.403972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"1069d7cf92bf443c1e55c08175fa416c7b0bb0cbeb843fb6db4f6a7f862d1b13"} Jun 08 21:07:49.404086 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.404045 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"0ea758cd4e79661af7f7b4ffd2254552524bf0329a8627c80f5d26b98ffa0f7b"} Jun 08 21:07:49.404086 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.404078 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"644c846b887dc7c4b7451a9490b023395a6026c4f07cd67e31449675bf9c9c1f"} Jun 08 21:07:49.404174 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.404106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"d8d91852cf6387d7076f2d7c04aa663d6ea0e9c808686a4ddf5c4c3054c6e428"} Jun 08 21:07:49.404174 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.404141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerDied","Data":"928e997174f18d1224796fbb055d50bc5de7530c232670e6a780c22901af4db1"} Jun 08 21:07:49.405281 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.405264 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5s7ts" event={"ID":"e84f215f-cb69-4120-a5ee-1027a66cc97f","Type":"ContainerStarted","Data":"51c90a5b775d299657f65f7a3c25b76a715c9c2e4b617bb7daabf0a246ca5fdb"} Jun 08 21:07:49.406585 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.406565 2565 generic.go:356] "Generic (PLEG): container finished" podID="c101ce08-965d-4659-83d6-3c891032c66d" containerID="c2839bdc3c6be85a25745d2237050a94fe5ae5ed6cadd35ea7116fa6dcf9a2b2" exitCode=0 Jun 08 21:07:49.406668 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.406643 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerDied","Data":"c2839bdc3c6be85a25745d2237050a94fe5ae5ed6cadd35ea7116fa6dcf9a2b2"} Jun 08 21:07:49.413622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.413587 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7hxfk" podStartSLOduration=4.499215384 podStartE2EDuration="23.413575473s" totalImagesPullingTime="18.914360089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:49.413414509 +0000 UTC m=+23.581428300" watchObservedRunningTime="2026-06-08 21:07:49.413575473 +0000 UTC m=+23.581589265" Jun 08 21:07:49.449503 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.449422 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w825h" podStartSLOduration=4.364680815 podStartE2EDuration="23.449412306s" totalImagesPullingTime="19.084731491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:49.449148254 +0000 UTC m=+23.617162058" watchObservedRunningTime="2026-06-08 21:07:49.449412306 +0000 UTC m=+23.617426099" Jun 08 21:07:49.463403 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.463365 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5s7ts" podStartSLOduration=4.547083858 podStartE2EDuration="23.463351008s" totalImagesPullingTime="18.91626715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:49.46323161 +0000 UTC m=+23.631245413" watchObservedRunningTime="2026-06-08 21:07:49.463351008 +0000 UTC m=+23.631364801" Jun 08 21:07:49.717740 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:49.717719 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 21:07:50.305592 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:50.305555 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:50.305773 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:50.305679 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:50.306110 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:50.306083 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:50.306187 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:50.306172 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:50.306245 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:50.306231 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:50.306329 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:50.306313 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:50.319232 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:50.319140 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T21:07:49.717736192Z","UUID":"28c7ecec-4efb-4c1f-8404-ce850868e500","Handler":null,"Name":"","Endpoint":""} Jun 08 21:07:50.320741 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:50.320716 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 21:07:50.320835 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:50.320763 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 21:07:50.411391 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:50.411354 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" event={"ID":"d69d2095-bac9-4160-b48b-58a1af9ddd11","Type":"ContainerStarted","Data":"d4d805e43ad2f37c27449b987c90e65d504ab6225d07064cb51fd13e6843694b"} Jun 08 21:07:50.412003 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:50.411446 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 21:07:51.417182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:51.417150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:07:51.417639 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:51.417560 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"8a7427ce81f98a2bf0cfc160fd010aeefe8b110ac32d095a8aadc20887ef1472"} Jun 08 21:07:51.419753 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:51.419727 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" event={"ID":"d69d2095-bac9-4160-b48b-58a1af9ddd11","Type":"ContainerStarted","Data":"e3382fcd9ef6a7e17e72aa7ca6f3cb952853063df8b4db7df21551f44beb0974"} Jun 08 21:07:51.437288 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:51.437248 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rzngq" podStartSLOduration=6.516666934 podStartE2EDuration="25.437236383s" totalImagesPullingTime="18.920569449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:49.477291892 +0000 UTC m=+23.645305684" watchObservedRunningTime="2026-06-08 21:07:51.437236383 +0000 UTC m=+25.605250175" Jun 08 21:07:51.437554 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:51.437530 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xr5vn" podStartSLOduration=4.283395572 podStartE2EDuration="25.437522725s" totalImagesPullingTime="21.154127153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:51.436781086 +0000 UTC m=+25.604794878" watchObservedRunningTime="2026-06-08 21:07:51.437522725 +0000 UTC m=+25.605536522" Jun 08 21:07:52.303863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:52.303830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:52.304042 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:52.303922 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:52.304042 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:52.303830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:52.304042 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:52.304034 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:52.304182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:52.303830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:52.304182 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:52.304147 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:54.304049 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.304001 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:54.304049 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.304034 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:54.304519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.304004 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:54.304519 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:54.304141 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:54.304519 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:54.304191 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:54.304519 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:54.304259 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:54.428715 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.428693 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:07:54.429146 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.429119 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"36878eafb33c3ea58ad44d27760849e8aaf923a5f773ae462f7952e2fbd66717"} Jun 08 21:07:54.429368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.429351 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:54.429576 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.429556 2565 scope.go:117] "RemoveContainer" containerID="928e997174f18d1224796fbb055d50bc5de7530c232670e6a780c22901af4db1" Jun 08 21:07:54.431786 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.431759 2565 generic.go:356] "Generic (PLEG): container finished" podID="c101ce08-965d-4659-83d6-3c891032c66d" containerID="1a39b0e658a257e0d2c26ff87d572527e5920a693388fdd6b031dad4567ee228" exitCode=0 Jun 08 21:07:54.431867 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.431812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerDied","Data":"1a39b0e658a257e0d2c26ff87d572527e5920a693388fdd6b031dad4567ee228"} Jun 08 21:07:54.447472 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.447451 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:54.996747 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.996578 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:54.996886 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.996824 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 21:07:54.997088 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:54.997071 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f4x86" Jun 08 21:07:55.074534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.074452 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:55.155514 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.155482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:55.440247 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.440222 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:07:55.440794 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.440613 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" event={"ID":"f505d281-c4d1-47bb-8f7f-3061a3adf170","Type":"ContainerStarted","Data":"99bf7adf7f0dd0fadc3a73f0e3d9598bd7aed8f5a9b0a9ac41dcdc78b45353a4"} Jun 08 21:07:55.440850 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.440833 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:55.440909 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.440896 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:55.455482 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.455464 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:07:55.470482 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.470442 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" podStartSLOduration=10.430607481 podStartE2EDuration="29.470428783s" totalImagesPullingTime="19.039821302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:07:55.46876134 +0000 UTC m=+29.636775153" watchObservedRunningTime="2026-06-08 21:07:55.470428783 +0000 UTC m=+29.638442575" Jun 08 21:07:55.489033 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.488995 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r2bj4"] Jun 08 21:07:55.489166 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.489152 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:55.489256 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:55.489234 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:55.500237 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.500219 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-46vwd"] Jun 08 21:07:55.500318 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.500310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:55.500422 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:55.500396 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:55.510974 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.510951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k9jph"] Jun 08 21:07:55.511081 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.511059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:55.511163 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:55.511145 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:55.583320 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.583235 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:55.642061 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.642036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:55.911412 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.911345 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:55.972187 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:55.972166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:56.444667 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:56.444642 2565 generic.go:356] "Generic (PLEG): container finished" podID="c101ce08-965d-4659-83d6-3c891032c66d" containerID="413f0b73cd6cff346c38e6cfb63731f80ca2f7c20550491cc4abb48bf546575b" exitCode=0 Jun 08 21:07:56.444980 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:56.444718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerDied","Data":"413f0b73cd6cff346c38e6cfb63731f80ca2f7c20550491cc4abb48bf546575b"} Jun 08 21:07:56.792700 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:56.792618 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:56.853766 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:56.853734 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:57.303175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:57.303147 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:57.303280 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:57.303181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:57.303280 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:57.303179 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:57.303280 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:57.303248 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:57.303386 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:57.303327 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:07:57.303419 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:57.303395 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:57.649852 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:57.649824 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:07:58.450387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:58.450217 2565 generic.go:356] "Generic (PLEG): container finished" podID="c101ce08-965d-4659-83d6-3c891032c66d" containerID="987fc274adc68adea57980bb1ed4abd57646e87e4888965de433d5651d92dee7" exitCode=0 Jun 08 21:07:58.450387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:58.450284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerDied","Data":"987fc274adc68adea57980bb1ed4abd57646e87e4888965de433d5651d92dee7"} Jun 08 21:07:59.303950 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:59.303920 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:07:59.304305 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:59.303928 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:07:59.304305 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:59.304036 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46vwd" podUID="e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57" Jun 08 21:07:59.304305 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:59.304130 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9jph" podUID="0c84d74a-a7e6-478f-9651-1cdbfa45c9fc" Jun 08 21:07:59.304305 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:07:59.303935 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:07:59.304305 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:07:59.304227 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:08:00.008808 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:00.008780 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:08:00.009067 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:00.008832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:08:00.009067 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:00.008929 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:08:00.009067 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:00.008929 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:08:00.009067 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:00.008975 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret podName:e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:32.008962293 +0000 UTC m=+66.176976062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret") pod "global-pull-secret-syncer-46vwd" (UID: "e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:08:00.009067 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:00.008988 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:08:32.008981704 +0000 UTC m=+66.176995475 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:08:00.109190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:00.109161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:08:00.109320 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:00.109290 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:08:00.109320 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:00.109308 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:08:00.109320 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:00.109316 2565 projected.go:196] Error preparing data for projected volume kube-api-access-6r84q for pod openshift-network-diagnostics/network-check-target-k9jph: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:08:00.109463 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:00.109388 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q podName:0c84d74a-a7e6-478f-9651-1cdbfa45c9fc nodeName:}" failed. No retries permitted until 2026-06-08 21:08:32.109374658 +0000 UTC m=+66.277388429 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6r84q" (UniqueName: "kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q") pod "network-check-target-k9jph" (UID: "0c84d74a-a7e6-478f-9651-1cdbfa45c9fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:08:00.644742 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:00.644702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:00.692287 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:00.692252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:01.183740 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.183710 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-214.ec2.internal" event="NodeReady" Jun 08 21:08:01.183925 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.183838 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 21:08:01.227327 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.227298 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n4wmk"] Jun 08 21:08:01.248528 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.248499 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q5ssl"] Jun 08 21:08:01.248664 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.248597 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.251186 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.251165 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 21:08:01.251461 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.251202 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r7ngx\"" Jun 08 21:08:01.251532 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.251479 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 21:08:01.268732 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.268713 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4wmk"] Jun 08 21:08:01.268836 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.268751 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q5ssl"] Jun 08 21:08:01.268882 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.268837 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q5ssl" Jun 08 21:08:01.271705 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.271471 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 21:08:01.271705 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.271487 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 21:08:01.271705 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.271555 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 21:08:01.271705 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.271630 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k9xh6\"" Jun 08 21:08:01.303454 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.303435 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:08:01.303574 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.303465 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:08:01.303574 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.303435 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:08:01.306763 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.306745 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:08:01.306863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.306768 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:08:01.306863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.306747 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m779s\"" Jun 08 21:08:01.306863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.306788 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:08:01.306863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.306747 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8cvr\"" Jun 08 21:08:01.307106 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.306897 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:08:01.418355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.418330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27b38eb9-0c8a-4b0a-914d-8bdb328df801-config-volume\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.418492 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.418386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd9ae466-e3df-4221-844f-8e25cd28ede7-cert\") pod \"ingress-canary-q5ssl\" (UID: \"bd9ae466-e3df-4221-844f-8e25cd28ede7\") " pod="openshift-ingress-canary/ingress-canary-q5ssl" Jun 08 21:08:01.418492 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.418445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27b38eb9-0c8a-4b0a-914d-8bdb328df801-tmp-dir\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.418492 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.418478 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.418648 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.418496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9s8j\" (UniqueName: \"kubernetes.io/projected/27b38eb9-0c8a-4b0a-914d-8bdb328df801-kube-api-access-n9s8j\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.418648 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.418519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj6qw\" (UniqueName: \"kubernetes.io/projected/bd9ae466-e3df-4221-844f-8e25cd28ede7-kube-api-access-cj6qw\") pod \"ingress-canary-q5ssl\" (UID: \"bd9ae466-e3df-4221-844f-8e25cd28ede7\") " pod="openshift-ingress-canary/ingress-canary-q5ssl" Jun 08 21:08:01.519788 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.519712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd9ae466-e3df-4221-844f-8e25cd28ede7-cert\") pod \"ingress-canary-q5ssl\" (UID: \"bd9ae466-e3df-4221-844f-8e25cd28ede7\") " pod="openshift-ingress-canary/ingress-canary-q5ssl" Jun 08 21:08:01.519788 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.519750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27b38eb9-0c8a-4b0a-914d-8bdb328df801-tmp-dir\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.519788 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.519782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.520048 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:01.519873 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:01.520048 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:01.519941 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:02.019921151 +0000 UTC m=+36.187934952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:08:01.520048 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.519960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9s8j\" (UniqueName: \"kubernetes.io/projected/27b38eb9-0c8a-4b0a-914d-8bdb328df801-kube-api-access-n9s8j\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.520048 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.519993 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj6qw\" (UniqueName: \"kubernetes.io/projected/bd9ae466-e3df-4221-844f-8e25cd28ede7-kube-api-access-cj6qw\") pod \"ingress-canary-q5ssl\" (UID: \"bd9ae466-e3df-4221-844f-8e25cd28ede7\") " pod="openshift-ingress-canary/ingress-canary-q5ssl" Jun 08 21:08:01.520242 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.520061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27b38eb9-0c8a-4b0a-914d-8bdb328df801-config-volume\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.520242 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.520116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27b38eb9-0c8a-4b0a-914d-8bdb328df801-tmp-dir\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.520547 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.520530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27b38eb9-0c8a-4b0a-914d-8bdb328df801-config-volume\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.524557 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.524535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd9ae466-e3df-4221-844f-8e25cd28ede7-cert\") pod \"ingress-canary-q5ssl\" (UID: \"bd9ae466-e3df-4221-844f-8e25cd28ede7\") " pod="openshift-ingress-canary/ingress-canary-q5ssl" Jun 08 21:08:01.530433 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.530408 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9s8j\" (UniqueName: \"kubernetes.io/projected/27b38eb9-0c8a-4b0a-914d-8bdb328df801-kube-api-access-n9s8j\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:01.531006 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.530987 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj6qw\" (UniqueName: \"kubernetes.io/projected/bd9ae466-e3df-4221-844f-8e25cd28ede7-kube-api-access-cj6qw\") pod \"ingress-canary-q5ssl\" (UID: \"bd9ae466-e3df-4221-844f-8e25cd28ede7\") " pod="openshift-ingress-canary/ingress-canary-q5ssl" Jun 08 21:08:01.578547 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:01.578517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q5ssl" Jun 08 21:08:02.022922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:02.022888 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:02.023407 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:02.023048 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:02.023407 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:02.023122 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:03.023103818 +0000 UTC m=+37.191117588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:08:03.021430 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:03.021293 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q5ssl"] Jun 08 21:08:03.024712 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:08:03.024686 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9ae466_e3df_4221_844f_8e25cd28ede7.slice/crio-988a8cf0eaeb4cc0a6e36b55a819eb0ce79a3ea3391703d8c125b591b2ce7ed0 WatchSource:0}: Error finding container 988a8cf0eaeb4cc0a6e36b55a819eb0ce79a3ea3391703d8c125b591b2ce7ed0: Status 404 returned error can't find the container with id 988a8cf0eaeb4cc0a6e36b55a819eb0ce79a3ea3391703d8c125b591b2ce7ed0 Jun 08 21:08:03.029637 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:03.029608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:03.029769 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:03.029741 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:03.029992 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:03.029893 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:05.029811467 +0000 UTC m=+39.197825241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:08:03.465374 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:03.465339 2565 generic.go:356] "Generic (PLEG): container finished" podID="c101ce08-965d-4659-83d6-3c891032c66d" containerID="d70458d4ddd8407863a45e434ced24d3f188fd3aa68ac033a50ef1a526a29ed3" exitCode=0 Jun 08 21:08:03.465549 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:03.465437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerDied","Data":"d70458d4ddd8407863a45e434ced24d3f188fd3aa68ac033a50ef1a526a29ed3"} Jun 08 21:08:03.467184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:03.467156 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q5ssl" event={"ID":"bd9ae466-e3df-4221-844f-8e25cd28ede7","Type":"ContainerStarted","Data":"988a8cf0eaeb4cc0a6e36b55a819eb0ce79a3ea3391703d8c125b591b2ce7ed0"} Jun 08 21:08:04.472587 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:04.472556 2565 generic.go:356] "Generic (PLEG): container finished" podID="c101ce08-965d-4659-83d6-3c891032c66d" containerID="e9f78e3aa8d8925fa1daa5f171b673a11577f7558110b1ea566b84c924aef3fa" exitCode=0 Jun 08 21:08:04.473207 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:04.472611 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerDied","Data":"e9f78e3aa8d8925fa1daa5f171b673a11577f7558110b1ea566b84c924aef3fa"} Jun 08 21:08:05.047563 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.047544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:05.047656 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:05.047643 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:05.047701 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:05.047692 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:09.047677448 +0000 UTC m=+43.215691221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:08:05.471198 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.471167 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:05.481595 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.481566 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" event={"ID":"c101ce08-965d-4659-83d6-3c891032c66d","Type":"ContainerStarted","Data":"1629799fb813e83356eee93e0b17a0382e6f99e8793e508fc40ca6cf41599448"} Jun 08 21:08:05.482928 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.482907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q5ssl" event={"ID":"bd9ae466-e3df-4221-844f-8e25cd28ede7","Type":"ContainerStarted","Data":"4e79ad07fcf23b826842c1615cf35d37cda429660eeccebc60cdca09cc213b53"} Jun 08 21:08:05.506872 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.506804 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qtq7c" podStartSLOduration=10.134160856 podStartE2EDuration="39.506791469s" totalImagesPullingTime="29.372630613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:05.506209115 +0000 UTC m=+39.674222926" watchObservedRunningTime="2026-06-08 21:08:05.506791469 +0000 UTC m=+39.674805257" Jun 08 21:08:05.522459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.522410 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q5ssl" podStartSLOduration=2.569770075 podStartE2EDuration="4.522394745s" totalImagesPullingTime="1.95262467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:05.52226034 +0000 UTC m=+39.690274134" watchObservedRunningTime="2026-06-08 21:08:05.522394745 +0000 UTC m=+39.690408537" Jun 08 21:08:05.532158 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.532136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:05.602859 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.602827 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:05.656459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.656436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:05.710497 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:05.710470 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:09.072148 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:09.072114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:09.072515 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:09.072230 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:09.072515 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:09.072285 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:17.072271609 +0000 UTC m=+51.240285380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:08:17.125245 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:17.125209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:17.125780 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:17.125314 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:17.125780 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:17.125365 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:33.125350295 +0000 UTC m=+67.293364065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:08:17.556880 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:17.556854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:17.607214 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:17.607189 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:18.575507 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:18.575477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:18.630440 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:18.630414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:27.457165 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:27.457137 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mwdgp" Jun 08 21:08:27.565081 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:27.565045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:27.625282 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:27.625256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:27.676399 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:27.676380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:31.852535 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:31.852507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:31.906162 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:31.906133 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:08:32.020859 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.020831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:08:32.020963 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.020889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:08:32.023708 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.023689 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:08:32.023760 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.023707 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:08:32.032069 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:32.032048 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:08:32.032160 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:32.032124 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:09:36.032105266 +0000 UTC m=+130.200119042 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : secret "metrics-daemon-secret" not found Jun 08 21:08:32.035326 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.035309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57-original-pull-secret\") pod \"global-pull-secret-syncer-46vwd\" (UID: \"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57\") " pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:08:32.121796 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.121740 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:08:32.124583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.124569 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:08:32.134691 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.134673 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:08:32.144889 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.144864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r84q\" (UniqueName: \"kubernetes.io/projected/0c84d74a-a7e6-478f-9651-1cdbfa45c9fc-kube-api-access-6r84q\") pod \"network-check-target-k9jph\" (UID: \"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc\") " pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:08:32.221657 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.221638 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8cvr\"" Jun 08 21:08:32.223420 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.223404 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46vwd" Jun 08 21:08:32.229342 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.229326 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:08:32.354963 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.354936 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-46vwd"] Jun 08 21:08:32.365966 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.365943 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k9jph"] Jun 08 21:08:32.369099 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:08:32.369070 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c84d74a_a7e6_478f_9651_1cdbfa45c9fc.slice/crio-3b81df6fbb35a1a9325fa3e2ef917b2281cb320df6b06340467f27a658c5ce94 WatchSource:0}: Error finding container 3b81df6fbb35a1a9325fa3e2ef917b2281cb320df6b06340467f27a658c5ce94: Status 404 returned error can't find the container with id 3b81df6fbb35a1a9325fa3e2ef917b2281cb320df6b06340467f27a658c5ce94 Jun 08 21:08:32.540799 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.540761 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k9jph" event={"ID":"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc","Type":"ContainerStarted","Data":"3b81df6fbb35a1a9325fa3e2ef917b2281cb320df6b06340467f27a658c5ce94"} Jun 08 21:08:32.541840 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:32.541815 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-46vwd" event={"ID":"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57","Type":"ContainerStarted","Data":"b953381ad547f03a52b383c9bf5224dcc0f9852c034df951b93a137a719b0aa0"} Jun 08 21:08:33.130388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:33.130355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:08:33.130843 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:33.130499 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:08:33.130843 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:08:33.130560 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:09:05.130542729 +0000 UTC m=+99.298556498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:08:37.556920 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:37.556879 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k9jph" event={"ID":"0c84d74a-a7e6-478f-9651-1cdbfa45c9fc","Type":"ContainerStarted","Data":"09ee328a57162c58c817948e35d11a214720b40d6e9c2b64693ed49c96086b53"} Jun 08 21:08:37.557428 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:37.557036 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:08:37.562328 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:37.562296 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-46vwd" event={"ID":"e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57","Type":"ContainerStarted","Data":"2f62b0b4349f58cf876e75d453234945b78699ed75450ba4d7732369b4792f6c"} Jun 08 21:08:37.572360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:37.572307 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k9jph" podStartSLOduration=67.376214803 podStartE2EDuration="1m11.57229182s" totalImagesPullingTime="4.196077017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:37.571953724 +0000 UTC m=+71.739967516" watchObservedRunningTime="2026-06-08 21:08:37.57229182 +0000 UTC m=+71.740305613" Jun 08 21:08:37.589511 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:08:37.589455 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-46vwd" podStartSLOduration=67.381518579 podStartE2EDuration="1m11.589443437s" totalImagesPullingTime="4.207924858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:37.589168405 +0000 UTC m=+71.757182198" watchObservedRunningTime="2026-06-08 21:08:37.589443437 +0000 UTC m=+71.757457228" Jun 08 21:09:05.141085 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:09:05.141053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:09:05.141444 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:09:05.141177 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:09:05.141444 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:09:05.141248 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:09.141230068 +0000 UTC m=+163.309243847 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:09:08.567146 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:09:08.567120 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k9jph" Jun 08 21:09:36.035873 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:09:36.035838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:09:36.036369 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:09:36.035947 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:09:36.036369 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:09:36.036009 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs podName:f26f36a5-4005-496b-a3a6-1fd09949eeda nodeName:}" failed. No retries permitted until 2026-06-08 21:11:38.035994738 +0000 UTC m=+252.204008508 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs") pod "network-metrics-daemon-r2bj4" (UID: "f26f36a5-4005-496b-a3a6-1fd09949eeda") : secret "metrics-daemon-secret" not found Jun 08 21:09:37.547265 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:09:37.547226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:09:50.566744 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:09:50.566696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:04.259729 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:04.259694 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n4wmk" podUID="27b38eb9-0c8a-4b0a-914d-8bdb328df801" Jun 08 21:10:04.313613 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:04.313583 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r2bj4" podUID="f26f36a5-4005-496b-a3a6-1fd09949eeda" Jun 08 21:10:04.767949 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:04.767923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4wmk" Jun 08 21:10:09.148030 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:09.147993 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:10:09.148497 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:09.148126 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:10:09.148497 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:09.148195 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls podName:27b38eb9-0c8a-4b0a-914d-8bdb328df801 nodeName:}" failed. No retries permitted until 2026-06-08 21:12:11.148180726 +0000 UTC m=+285.316194496 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls") pod "dns-default-n4wmk" (UID: "27b38eb9-0c8a-4b0a-914d-8bdb328df801") : secret "dns-default-metrics-tls" not found Jun 08 21:10:13.895403 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.895358 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-gc672"] Jun 08 21:10:13.897401 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.897385 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l"] Jun 08 21:10:13.897531 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.897515 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:13.899696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.899629 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:13.900302 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.900278 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw"] Jun 08 21:10:13.900714 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.900696 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xpcpr\"" Jun 08 21:10:13.900854 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.900838 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 21:10:13.901995 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.901977 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67fcb56664-4sdsj"] Jun 08 21:10:13.902105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.902089 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:13.902638 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.902622 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 21:10:13.903155 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.903138 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-589cl\"" Jun 08 21:10:13.903265 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.903172 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 21:10:13.903535 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.903517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:13.903719 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.903701 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:10:13.903801 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.903705 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 21:10:13.907526 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.907508 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 21:10:13.907657 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.907592 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 21:10:13.907657 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.907611 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 21:10:13.907657 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.907615 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 21:10:13.908683 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.908637 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 21:10:13.908683 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.908669 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6m7xf\"" Jun 08 21:10:13.909003 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.908949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 21:10:13.909111 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.909050 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 21:10:13.909111 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.909100 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tzf2p\"" Jun 08 21:10:13.909206 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.909168 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 21:10:13.914353 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.914336 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-gc672"] Jun 08 21:10:13.915451 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.915345 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 21:10:13.921426 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.921409 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l"] Jun 08 21:10:13.929787 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.929765 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw"] Jun 08 21:10:13.939486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.939469 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fcb56664-4sdsj"] Jun 08 21:10:13.976850 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.976821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:13.976956 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.976867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c3fd102-2650-4e0d-909e-6bce6446cbee-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:13.997067 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.997044 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-nw8zc"] Jun 08 21:10:13.999448 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.999432 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w"] Jun 08 21:10:13.999570 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:13.999552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.001621 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.001605 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959"] Jun 08 21:10:14.001725 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.001712 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w" Jun 08 21:10:14.002424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.002402 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 21:10:14.002424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.002420 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 21:10:14.002549 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.002435 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wfl5l\"" Jun 08 21:10:14.002549 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.002441 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 21:10:14.002549 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.002441 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 21:10:14.003717 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.003700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.004674 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.004656 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dzrvg\"" Jun 08 21:10:14.005838 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.005819 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 21:10:14.006119 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.005954 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 21:10:14.006277 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.006168 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-szgrg\"" Jun 08 21:10:14.006538 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.006524 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 21:10:14.006610 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.006584 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:10:14.008086 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.008072 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 21:10:14.010603 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.010586 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w"] Jun 08 21:10:14.011484 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.011467 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-nw8zc"] Jun 08 21:10:14.012441 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.012421 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959"] Jun 08 21:10:14.077486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjt54\" (UniqueName: \"kubernetes.io/projected/7894097a-c3ab-416d-9a48-d0ce5af90dae-kube-api-access-xjt54\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.077598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-installation-pull-secrets\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.077598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:14.077598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c3fd102-2650-4e0d-909e-6bce6446cbee-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:14.077598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-image-registry-private-configuration\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.077789 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2xfz\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-kube-api-access-h2xfz\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.077789 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.077647 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 21:10:14.077789 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.077702 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert podName:7c3fd102-2650-4e0d-909e-6bce6446cbee nodeName:}" failed. No retries permitted until 2026-06-08 21:10:14.577684564 +0000 UTC m=+168.745698349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gc672" (UID: "7c3fd102-2650-4e0d-909e-6bce6446cbee") : secret "networking-console-plugin-cert" not found Jun 08 21:10:14.077789 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077783 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7894097a-c3ab-416d-9a48-d0ce5af90dae-config\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.077955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ebba62c-938d-4419-a9ee-514cb9d34db7-ca-trust-extracted\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.077955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-745c2\" (UniqueName: \"kubernetes.io/projected/94072c29-45ee-463d-9cb0-8e87481d5c49-kube-api-access-745c2\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.077955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-certificates\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.077955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-trusted-ca\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.077955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.077955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7894097a-c3ab-416d-9a48-d0ce5af90dae-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.077955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.077955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/94072c29-45ee-463d-9cb0-8e87481d5c49-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.078223 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.077965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-bound-sa-token\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.078223 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.078137 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c3fd102-2650-4e0d-909e-6bce6446cbee-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:14.153117 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.153061 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:14.178884 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.178864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/94072c29-45ee-463d-9cb0-8e87481d5c49-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.178966 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.178898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-image-registry-private-configuration\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.178966 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.178916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-certificates\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.178966 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.178946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-trusted-ca-bundle\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.179109 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.178987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7894097a-c3ab-416d-9a48-d0ce5af90dae-config\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.179109 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-tmp\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.179109 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-serving-cert\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.179109 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.179299 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-service-ca-bundle\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.179299 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.179164 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:10:14.179299 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.179299 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.179178 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fcb56664-4sdsj: secret "image-registry-tls" not found Jun 08 21:10:14.179299 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.179286 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls podName:4ebba62c-938d-4419-a9ee-514cb9d34db7 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:14.67926639 +0000 UTC m=+168.847280160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls") pod "image-registry-67fcb56664-4sdsj" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7") : secret "image-registry-tls" not found Jun 08 21:10:14.179299 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjt54\" (UniqueName: \"kubernetes.io/projected/7894097a-c3ab-416d-9a48-d0ce5af90dae-kube-api-access-xjt54\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-installation-pull-secrets\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5dq2\" (UniqueName: \"kubernetes.io/projected/b96a0179-43e5-4b2b-b931-2540226edb9b-kube-api-access-b5dq2\") pod \"network-check-source-dbd9cf844-zqn2w\" (UID: \"b96a0179-43e5-4b2b-b931-2540226edb9b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ebba62c-938d-4419-a9ee-514cb9d34db7-ca-trust-extracted\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrgss\" (UniqueName: \"kubernetes.io/projected/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-kube-api-access-rrgss\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2xfz\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-kube-api-access-h2xfz\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179538 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-certificates\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfr59\" (UniqueName: \"kubernetes.io/projected/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-kube-api-access-zfr59\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.179622 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-745c2\" (UniqueName: \"kubernetes.io/projected/94072c29-45ee-463d-9cb0-8e87481d5c49-kube-api-access-745c2\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179628 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-trusted-ca\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/94072c29-45ee-463d-9cb0-8e87481d5c49-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7894097a-c3ab-416d-9a48-d0ce5af90dae-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-snapshots\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7894097a-c3ab-416d-9a48-d0ce5af90dae-config\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-bound-sa-token\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.179746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ebba62c-938d-4419-a9ee-514cb9d34db7-ca-trust-extracted\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.179857 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:14.180260 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.179906 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls podName:94072c29-45ee-463d-9cb0-8e87481d5c49 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:14.679891111 +0000 UTC m=+168.847904884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6blw" (UID: "94072c29-45ee-463d-9cb0-8e87481d5c49") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:14.180717 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.180370 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-trusted-ca\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.181826 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.181804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-image-registry-private-configuration\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.181993 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.181979 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-installation-pull-secrets\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.182090 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.182076 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7894097a-c3ab-416d-9a48-d0ce5af90dae-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.190818 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.190792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-bound-sa-token\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.191185 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.191164 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-745c2\" (UniqueName: \"kubernetes.io/projected/94072c29-45ee-463d-9cb0-8e87481d5c49-kube-api-access-745c2\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.191818 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.191802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2xfz\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-kube-api-access-h2xfz\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.191957 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.191939 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjt54\" (UniqueName: \"kubernetes.io/projected/7894097a-c3ab-416d-9a48-d0ce5af90dae-kube-api-access-xjt54\") pod \"service-ca-operator-6bc5ff68f5-thk6l\" (UID: \"7894097a-c3ab-416d-9a48-d0ce5af90dae\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.213116 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.213085 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" Jun 08 21:10:14.254947 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.254914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:14.280764 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.280738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-trusted-ca-bundle\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.280921 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.280782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-tmp\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.280921 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.280797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-serving-cert\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.281075 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.280984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-service-ca-bundle\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.281075 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.281045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.281179 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.281076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.281179 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.281103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5dq2\" (UniqueName: \"kubernetes.io/projected/b96a0179-43e5-4b2b-b931-2540226edb9b-kube-api-access-b5dq2\") pod \"network-check-source-dbd9cf844-zqn2w\" (UID: \"b96a0179-43e5-4b2b-b931-2540226edb9b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w" Jun 08 21:10:14.281179 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.281123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrgss\" (UniqueName: \"kubernetes.io/projected/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-kube-api-access-rrgss\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.281179 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.281152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfr59\" (UniqueName: \"kubernetes.io/projected/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-kube-api-access-zfr59\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.281371 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.281210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-snapshots\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.282467 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.281903 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-tmp\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.282467 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.281953 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-snapshots\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.282467 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.282010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-trusted-ca-bundle\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.282467 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.282444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-service-ca-bundle\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.282733 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.282617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.283152 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.283129 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.283274 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.283255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-serving-cert\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.301162 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.301141 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrgss\" (UniqueName: \"kubernetes.io/projected/4094b4af-2c80-4dbd-a5ac-3fdb315f4123-kube-api-access-rrgss\") pod \"insights-operator-896549976-nw8zc\" (UID: \"4094b4af-2c80-4dbd-a5ac-3fdb315f4123\") " pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.301257 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.301180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfr59\" (UniqueName: \"kubernetes.io/projected/b47e7973-90b3-4b1f-bcf3-f7b2eafb4414-kube-api-access-zfr59\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-hs959\" (UID: \"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.301257 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.301248 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5dq2\" (UniqueName: \"kubernetes.io/projected/b96a0179-43e5-4b2b-b931-2540226edb9b-kube-api-access-b5dq2\") pod \"network-check-source-dbd9cf844-zqn2w\" (UID: \"b96a0179-43e5-4b2b-b931-2540226edb9b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w" Jun 08 21:10:14.309089 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.309073 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-nw8zc" Jun 08 21:10:14.316484 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.316467 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w" Jun 08 21:10:14.321645 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.321623 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" Jun 08 21:10:14.327898 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.327866 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l"] Jun 08 21:10:14.331675 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:14.331650 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7894097a_c3ab_416d_9a48_d0ce5af90dae.slice/crio-d17bba87c54d5af8c82470825ab8fbb1f149443e3095ff349edad613f776561b WatchSource:0}: Error finding container d17bba87c54d5af8c82470825ab8fbb1f149443e3095ff349edad613f776561b: Status 404 returned error can't find the container with id d17bba87c54d5af8c82470825ab8fbb1f149443e3095ff349edad613f776561b Jun 08 21:10:14.445954 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.445923 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-nw8zc"] Jun 08 21:10:14.449691 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:14.449665 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4094b4af_2c80_4dbd_a5ac_3fdb315f4123.slice/crio-b741333992a2bae91836bbd8c63a97d2b2bedb2709184fa73a81a7168f86dbf1 WatchSource:0}: Error finding container b741333992a2bae91836bbd8c63a97d2b2bedb2709184fa73a81a7168f86dbf1: Status 404 returned error can't find the container with id b741333992a2bae91836bbd8c63a97d2b2bedb2709184fa73a81a7168f86dbf1 Jun 08 21:10:14.584758 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.584730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:14.584924 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.584900 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 21:10:14.584986 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.584973 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert podName:7c3fd102-2650-4e0d-909e-6bce6446cbee nodeName:}" failed. No retries permitted until 2026-06-08 21:10:15.58495346 +0000 UTC m=+169.752967231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gc672" (UID: "7c3fd102-2650-4e0d-909e-6bce6446cbee") : secret "networking-console-plugin-cert" not found Jun 08 21:10:14.665496 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.665438 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959"] Jun 08 21:10:14.668457 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:14.668431 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47e7973_90b3_4b1f_bcf3_f7b2eafb4414.slice/crio-3850a7bcddadeda9085f63bada2334093326fbb17aa332b4fd6a786058ef08f6 WatchSource:0}: Error finding container 3850a7bcddadeda9085f63bada2334093326fbb17aa332b4fd6a786058ef08f6: Status 404 returned error can't find the container with id 3850a7bcddadeda9085f63bada2334093326fbb17aa332b4fd6a786058ef08f6 Jun 08 21:10:14.668618 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.668598 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w"] Jun 08 21:10:14.670633 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:14.670606 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96a0179_43e5_4b2b_b931_2540226edb9b.slice/crio-e1747c76adf1e26d4c53770648511c795e04526a0a1d93c4052bc7c7c3c925e1 WatchSource:0}: Error finding container e1747c76adf1e26d4c53770648511c795e04526a0a1d93c4052bc7c7c3c925e1: Status 404 returned error can't find the container with id e1747c76adf1e26d4c53770648511c795e04526a0a1d93c4052bc7c7c3c925e1 Jun 08 21:10:14.685376 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.685332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:14.685470 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.685415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:14.685470 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.685449 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:10:14.685470 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.685467 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fcb56664-4sdsj: secret "image-registry-tls" not found Jun 08 21:10:14.685631 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.685525 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls podName:4ebba62c-938d-4419-a9ee-514cb9d34db7 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:15.685506359 +0000 UTC m=+169.853520143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls") pod "image-registry-67fcb56664-4sdsj" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7") : secret "image-registry-tls" not found Jun 08 21:10:14.685631 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.685524 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:14.685631 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:14.685580 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls podName:94072c29-45ee-463d-9cb0-8e87481d5c49 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:15.685565659 +0000 UTC m=+169.853579442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6blw" (UID: "94072c29-45ee-463d-9cb0-8e87481d5c49") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:14.795450 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.795417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w" event={"ID":"b96a0179-43e5-4b2b-b931-2540226edb9b","Type":"ContainerStarted","Data":"d46cde959f4b5a66d541940d6a02de7ac79fbf33a9d7fd250e6ce7b597a4b8a9"} Jun 08 21:10:14.795575 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.795468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w" event={"ID":"b96a0179-43e5-4b2b-b931-2540226edb9b","Type":"ContainerStarted","Data":"e1747c76adf1e26d4c53770648511c795e04526a0a1d93c4052bc7c7c3c925e1"} Jun 08 21:10:14.796603 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.796578 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" event={"ID":"7894097a-c3ab-416d-9a48-d0ce5af90dae","Type":"ContainerStarted","Data":"d17bba87c54d5af8c82470825ab8fbb1f149443e3095ff349edad613f776561b"} Jun 08 21:10:14.797541 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.797519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" event={"ID":"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414","Type":"ContainerStarted","Data":"3850a7bcddadeda9085f63bada2334093326fbb17aa332b4fd6a786058ef08f6"} Jun 08 21:10:14.798591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.798544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nw8zc" event={"ID":"4094b4af-2c80-4dbd-a5ac-3fdb315f4123","Type":"ContainerStarted","Data":"b741333992a2bae91836bbd8c63a97d2b2bedb2709184fa73a81a7168f86dbf1"} Jun 08 21:10:14.810273 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:14.810238 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zqn2w" podStartSLOduration=1.8102257480000001 podStartE2EDuration="1.810225748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:14.809097875 +0000 UTC m=+168.977111690" watchObservedRunningTime="2026-06-08 21:10:14.810225748 +0000 UTC m=+168.978239591" Jun 08 21:10:15.593825 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:15.593783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:15.594260 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:15.593999 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 21:10:15.594260 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:15.594080 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert podName:7c3fd102-2650-4e0d-909e-6bce6446cbee nodeName:}" failed. No retries permitted until 2026-06-08 21:10:17.594061555 +0000 UTC m=+171.762075332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gc672" (UID: "7c3fd102-2650-4e0d-909e-6bce6446cbee") : secret "networking-console-plugin-cert" not found Jun 08 21:10:15.694735 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:15.694691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:15.694906 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:15.694797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:15.694906 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:15.694842 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:10:15.694906 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:15.694863 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fcb56664-4sdsj: secret "image-registry-tls" not found Jun 08 21:10:15.695075 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:15.694921 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls podName:4ebba62c-938d-4419-a9ee-514cb9d34db7 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:17.694900423 +0000 UTC m=+171.862914196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls") pod "image-registry-67fcb56664-4sdsj" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7") : secret "image-registry-tls" not found Jun 08 21:10:15.695075 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:15.694951 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:15.695075 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:15.695036 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls podName:94072c29-45ee-463d-9cb0-8e87481d5c49 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:17.695002396 +0000 UTC m=+171.863016182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6blw" (UID: "94072c29-45ee-463d-9cb0-8e87481d5c49") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:16.305403 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:16.305372 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:10:16.875759 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:16.875720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:16.978983 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:16.978944 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:17.613092 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:17.613044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:17.613284 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:17.613224 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 21:10:17.613335 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:17.613309 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert podName:7c3fd102-2650-4e0d-909e-6bce6446cbee nodeName:}" failed. No retries permitted until 2026-06-08 21:10:21.61328858 +0000 UTC m=+175.781302366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gc672" (UID: "7c3fd102-2650-4e0d-909e-6bce6446cbee") : secret "networking-console-plugin-cert" not found Jun 08 21:10:17.714316 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:17.714280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:17.714451 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:17.714352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:17.714451 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:17.714434 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:17.714593 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:17.714445 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:10:17.714593 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:17.714464 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fcb56664-4sdsj: secret "image-registry-tls" not found Jun 08 21:10:17.714593 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:17.714494 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls podName:94072c29-45ee-463d-9cb0-8e87481d5c49 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:21.71447739 +0000 UTC m=+175.882491171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6blw" (UID: "94072c29-45ee-463d-9cb0-8e87481d5c49") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:17.714593 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:17.714509 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls podName:4ebba62c-938d-4419-a9ee-514cb9d34db7 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:21.714501985 +0000 UTC m=+175.882515754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls") pod "image-registry-67fcb56664-4sdsj" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7") : secret "image-registry-tls" not found Jun 08 21:10:18.677846 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:18.677809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:18.732449 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:18.732417 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:18.812485 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:18.812451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nw8zc" event={"ID":"4094b4af-2c80-4dbd-a5ac-3fdb315f4123","Type":"ContainerStarted","Data":"f27a3f257b188390817d3a2f8ceddba9dff336ea335d49aab751b6e6ab9caecc"} Jun 08 21:10:18.813903 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:18.813876 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" event={"ID":"7894097a-c3ab-416d-9a48-d0ce5af90dae","Type":"ContainerStarted","Data":"f96b37cd024128a30be3fcc6be2c61d7734afdb2b2ca0a85b5a9f1c6905d9eff"} Jun 08 21:10:18.815387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:18.815362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" event={"ID":"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414","Type":"ContainerStarted","Data":"8a24da6a0e6346a7e68911245f2d8497d014c8a38dac6c285ae356fdb548fc38"} Jun 08 21:10:18.836263 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:18.836221 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-nw8zc" podStartSLOduration=2.53660103 podStartE2EDuration="5.836207476s" totalImagesPullingTime="3.299606446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:18.835242913 +0000 UTC m=+173.003256707" watchObservedRunningTime="2026-06-08 21:10:18.836207476 +0000 UTC m=+173.004221265" Jun 08 21:10:18.849630 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:18.849581 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" podStartSLOduration=2.7712456960000003 podStartE2EDuration="5.849564297s" totalImagesPullingTime="3.078318601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:18.848710043 +0000 UTC m=+173.016723836" watchObservedRunningTime="2026-06-08 21:10:18.849564297 +0000 UTC m=+173.017578073" Jun 08 21:10:18.863444 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:18.863403 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" podStartSLOduration=2.452479609 podStartE2EDuration="5.86338508s" totalImagesPullingTime="3.410905471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:18.862971733 +0000 UTC m=+173.030985569" watchObservedRunningTime="2026-06-08 21:10:18.86338508 +0000 UTC m=+173.031398871" Jun 08 21:10:19.084903 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:19.084867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:19.179887 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:19.179847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:19.290211 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:19.290179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:19.381370 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:19.381285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:19.481360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:19.481332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:19.810510 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:19.810478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:19.915275 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:19.915230 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:20.389772 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:20.389750 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7hxfk_e55a22b3-abfb-47dd-a1ca-573d521c3352/dns-node-resolver/0.log" Jun 08 21:10:21.378916 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.378888 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rjwnw"] Jun 08 21:10:21.383000 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.382983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.385288 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.385264 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 08 21:10:21.385405 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.385355 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 08 21:10:21.385467 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.385458 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-g87nr\"" Jun 08 21:10:21.386461 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.386445 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 08 21:10:21.386536 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.386477 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 08 21:10:21.391360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.391343 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rjwnw"] Jun 08 21:10:21.409435 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.409411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:21.460337 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.460308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:21.544316 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.544284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfbkc\" (UniqueName: \"kubernetes.io/projected/495f7222-fa74-42c1-9733-a4a73e3120f6-kube-api-access-bfbkc\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.544466 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.544322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/495f7222-fa74-42c1-9733-a4a73e3120f6-signing-key\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.544466 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.544343 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/495f7222-fa74-42c1-9733-a4a73e3120f6-signing-cabundle\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.645171 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.645105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfbkc\" (UniqueName: \"kubernetes.io/projected/495f7222-fa74-42c1-9733-a4a73e3120f6-kube-api-access-bfbkc\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.645171 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.645136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/495f7222-fa74-42c1-9733-a4a73e3120f6-signing-key\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.645171 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.645158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/495f7222-fa74-42c1-9733-a4a73e3120f6-signing-cabundle\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.645355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.645234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:21.645355 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:21.645319 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 21:10:21.645422 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:21.645385 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert podName:7c3fd102-2650-4e0d-909e-6bce6446cbee nodeName:}" failed. No retries permitted until 2026-06-08 21:10:29.645367102 +0000 UTC m=+183.813380876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gc672" (UID: "7c3fd102-2650-4e0d-909e-6bce6446cbee") : secret "networking-console-plugin-cert" not found Jun 08 21:10:21.645814 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.645787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/495f7222-fa74-42c1-9733-a4a73e3120f6-signing-cabundle\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.647658 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.647625 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/495f7222-fa74-42c1-9733-a4a73e3120f6-signing-key\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.653582 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.653550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfbkc\" (UniqueName: \"kubernetes.io/projected/495f7222-fa74-42c1-9733-a4a73e3120f6-kube-api-access-bfbkc\") pod \"service-ca-7d74d578b8-rjwnw\" (UID: \"495f7222-fa74-42c1-9733-a4a73e3120f6\") " pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.692053 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.692032 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" Jun 08 21:10:21.745910 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.745875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:21.746099 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:21.746076 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:10:21.746181 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:21.746103 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fcb56664-4sdsj: secret "image-registry-tls" not found Jun 08 21:10:21.746181 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.746117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:21.746181 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:21.746153 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls podName:4ebba62c-938d-4419-a9ee-514cb9d34db7 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:29.746138601 +0000 UTC m=+183.914152374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls") pod "image-registry-67fcb56664-4sdsj" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7") : secret "image-registry-tls" not found Jun 08 21:10:21.746331 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:21.746218 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:21.746331 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:21.746272 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls podName:94072c29-45ee-463d-9cb0-8e87481d5c49 nodeName:}" failed. No retries permitted until 2026-06-08 21:10:29.746255235 +0000 UTC m=+183.914269017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6blw" (UID: "94072c29-45ee-463d-9cb0-8e87481d5c49") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:10:21.789709 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.789686 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzngq_f22e0f0a-0cdc-4c1d-a852-408d98572076/node-ca/0.log" Jun 08 21:10:21.811156 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.811124 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rjwnw"] Jun 08 21:10:21.814456 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:21.814426 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495f7222_fa74_42c1_9733_a4a73e3120f6.slice/crio-4cd39150c125a42fb373b9bd6276c252b009798380cd8dc11606ccb82e07f36f WatchSource:0}: Error finding container 4cd39150c125a42fb373b9bd6276c252b009798380cd8dc11606ccb82e07f36f: Status 404 returned error can't find the container with id 4cd39150c125a42fb373b9bd6276c252b009798380cd8dc11606ccb82e07f36f Jun 08 21:10:21.825216 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.825188 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" event={"ID":"495f7222-fa74-42c1-9733-a4a73e3120f6","Type":"ContainerStarted","Data":"4cd39150c125a42fb373b9bd6276c252b009798380cd8dc11606ccb82e07f36f"} Jun 08 21:10:21.893969 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.893935 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:21.993387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:21.993359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:22.589204 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:22.589172 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q5ssl_bd9ae466-e3df-4221-844f-8e25cd28ede7/serve-healthcheck-canary/0.log" Jun 08 21:10:22.811846 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:22.811814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:22.830344 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:22.830314 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" event={"ID":"495f7222-fa74-42c1-9733-a4a73e3120f6","Type":"ContainerStarted","Data":"2401d6a70eaee02c78b6d0db52633daedbda39ebae59c0b3f6b3599b1da94e17"} Jun 08 21:10:22.913331 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:22.913244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:23.014105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:23.014069 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:23.113789 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:23.113751 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:23.214555 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:23.214519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:23.314900 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:23.314853 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:23.513930 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:23.513843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:24.716515 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:24.716486 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:24.920830 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:24.920782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:25.120778 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:25.120656 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:25.315888 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:25.315858 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:25.421646 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:25.421552 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:25.523626 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:25.523588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:26.315033 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:26.314988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:26.365274 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:26.365234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:26.716663 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:26.716629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:26.767139 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:26.767106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:27.112403 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:27.112320 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:27.313239 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:27.313186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:27.911377 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:27.911341 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:28.112555 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:28.112519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:28.514654 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:28.514625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:28.753533 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:28.753501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:29.230789 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.230752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:29.331974 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.331939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:29.514699 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.514612 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:29.708565 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.708536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:29.708717 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:29.708699 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 21:10:29.708781 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:10:29.708771 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert podName:7c3fd102-2650-4e0d-909e-6bce6446cbee nodeName:}" failed. No retries permitted until 2026-06-08 21:10:45.708751757 +0000 UTC m=+199.876765533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gc672" (UID: "7c3fd102-2650-4e0d-909e-6bce6446cbee") : secret "networking-console-plugin-cert" not found Jun 08 21:10:29.809856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.809796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:29.809856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.809845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:29.812394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.812370 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"image-registry-67fcb56664-4sdsj\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:29.812491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.812370 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/94072c29-45ee-463d-9cb0-8e87481d5c49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6blw\" (UID: \"94072c29-45ee-463d-9cb0-8e87481d5c49\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:29.822861 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.822841 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6m7xf\"" Jun 08 21:10:29.827418 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.827402 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tzf2p\"" Jun 08 21:10:29.830703 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.830690 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" Jun 08 21:10:29.835326 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.835311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:29.918711 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.918556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:29.961223 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.961171 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-rjwnw" podStartSLOduration=8.961151004 podStartE2EDuration="8.961151004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:22.848222394 +0000 UTC m=+177.016236185" watchObservedRunningTime="2026-06-08 21:10:29.961151004 +0000 UTC m=+184.129164795" Jun 08 21:10:29.963125 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.962836 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw"] Jun 08 21:10:29.965090 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:29.965054 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94072c29_45ee_463d_9cb0_8e87481d5c49.slice/crio-e32a2fd399858092a29e9d62ef22b7109f54338cd5633c75561207786ff4b9ac WatchSource:0}: Error finding container e32a2fd399858092a29e9d62ef22b7109f54338cd5633c75561207786ff4b9ac: Status 404 returned error can't find the container with id e32a2fd399858092a29e9d62ef22b7109f54338cd5633c75561207786ff4b9ac Jun 08 21:10:29.979337 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:29.979313 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fcb56664-4sdsj"] Jun 08 21:10:29.983164 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:29.983141 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebba62c_938d_4419_a9ee_514cb9d34db7.slice/crio-c195f9c6df3376385daddbe3920ad6fbadd1ff94157f690e9c3f3891af15e77a WatchSource:0}: Error finding container c195f9c6df3376385daddbe3920ad6fbadd1ff94157f690e9c3f3891af15e77a: Status 404 returned error can't find the container with id c195f9c6df3376385daddbe3920ad6fbadd1ff94157f690e9c3f3891af15e77a Jun 08 21:10:30.115780 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:30.115706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:30.525478 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:30.525449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:30.859677 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:30.859601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" event={"ID":"4ebba62c-938d-4419-a9ee-514cb9d34db7","Type":"ContainerStarted","Data":"62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240"} Jun 08 21:10:30.859677 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:30.859653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" event={"ID":"4ebba62c-938d-4419-a9ee-514cb9d34db7","Type":"ContainerStarted","Data":"c195f9c6df3376385daddbe3920ad6fbadd1ff94157f690e9c3f3891af15e77a"} Jun 08 21:10:30.859677 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:30.859674 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:10:30.860655 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:30.860633 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" event={"ID":"94072c29-45ee-463d-9cb0-8e87481d5c49","Type":"ContainerStarted","Data":"e32a2fd399858092a29e9d62ef22b7109f54338cd5633c75561207786ff4b9ac"} Jun 08 21:10:30.876596 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:30.876558 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" podStartSLOduration=17.876546395 podStartE2EDuration="17.876546395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:30.876278418 +0000 UTC m=+185.044292229" watchObservedRunningTime="2026-06-08 21:10:30.876546395 +0000 UTC m=+185.044560177" Jun 08 21:10:30.917889 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:30.917812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:31.316725 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:31.316686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:31.751215 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:31.751178 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:31.916848 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:31.916803 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:32.315431 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:32.315352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:32.451819 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:32.451776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:32.553002 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:32.552973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:32.718252 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:32.718224 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:32.871517 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:32.871485 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" event={"ID":"94072c29-45ee-463d-9cb0-8e87481d5c49","Type":"ContainerStarted","Data":"c6fd712387b1c28c48608db429c4dba003e40c4e4bec515a8f01edd0cd04df40"} Jun 08 21:10:32.890110 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:32.890061 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6blw" podStartSLOduration=17.87568397 podStartE2EDuration="19.890045727s" totalImagesPullingTime="2.014361757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:32.889428423 +0000 UTC m=+187.057442236" watchObservedRunningTime="2026-06-08 21:10:32.890045727 +0000 UTC m=+187.058059517" Jun 08 21:10:33.115203 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:33.115126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:33.315766 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:33.315719 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:33.712879 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:33.712844 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:33.913150 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:33.913117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:41.791180 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:41.791149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:41.841927 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:41.841896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:43.682506 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.682475 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fcb56664-4sdsj"] Jun 08 21:10:43.724826 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.724788 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54f4658f85-fbljc"] Jun 08 21:10:43.727341 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.727320 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7mc5w"] Jun 08 21:10:43.727473 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.727459 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.729368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.729351 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.731778 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.731761 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 21:10:43.731905 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.731813 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 21:10:43.731905 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.731823 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zbqgp\"" Jun 08 21:10:43.741632 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.741609 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f4658f85-fbljc"] Jun 08 21:10:43.756296 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.756259 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7mc5w"] Jun 08 21:10:43.797826 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.797804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:43.811951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.811924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1500bf9f-4aad-4f5f-8e21-594bce1f3733-image-registry-private-configuration\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.812089 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.811963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1500bf9f-4aad-4f5f-8e21-594bce1f3733-installation-pull-secrets\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.812089 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.811980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6875278-3171-4a21-9b08-bbafb3d90514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.812089 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812045 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1500bf9f-4aad-4f5f-8e21-594bce1f3733-trusted-ca\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.812089 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6875278-3171-4a21-9b08-bbafb3d90514-data-volume\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.812215 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwvfw\" (UniqueName: \"kubernetes.io/projected/e6875278-3171-4a21-9b08-bbafb3d90514-kube-api-access-bwvfw\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.812215 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6875278-3171-4a21-9b08-bbafb3d90514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.812215 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1500bf9f-4aad-4f5f-8e21-594bce1f3733-registry-certificates\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.812302 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6875278-3171-4a21-9b08-bbafb3d90514-crio-socket\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.812302 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkjhl\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-kube-api-access-jkjhl\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.812373 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-registry-tls\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.812373 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812323 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1500bf9f-4aad-4f5f-8e21-594bce1f3733-ca-trust-extracted\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.812373 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.812345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-bound-sa-token\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.893132 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.893098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:43.912994 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.912969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkjhl\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-kube-api-access-jkjhl\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913142 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-registry-tls\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913142 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1500bf9f-4aad-4f5f-8e21-594bce1f3733-ca-trust-extracted\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913142 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-bound-sa-token\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913142 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1500bf9f-4aad-4f5f-8e21-594bce1f3733-image-registry-private-configuration\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913142 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1500bf9f-4aad-4f5f-8e21-594bce1f3733-installation-pull-secrets\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913142 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6875278-3171-4a21-9b08-bbafb3d90514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.913429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1500bf9f-4aad-4f5f-8e21-594bce1f3733-trusted-ca\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6875278-3171-4a21-9b08-bbafb3d90514-data-volume\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.913429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwvfw\" (UniqueName: \"kubernetes.io/projected/e6875278-3171-4a21-9b08-bbafb3d90514-kube-api-access-bwvfw\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.913429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6875278-3171-4a21-9b08-bbafb3d90514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.913429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1500bf9f-4aad-4f5f-8e21-594bce1f3733-registry-certificates\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6875278-3171-4a21-9b08-bbafb3d90514-crio-socket\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.913429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913403 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6875278-3171-4a21-9b08-bbafb3d90514-crio-socket\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.913760 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1500bf9f-4aad-4f5f-8e21-594bce1f3733-ca-trust-extracted\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.913760 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6875278-3171-4a21-9b08-bbafb3d90514-data-volume\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.913908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.913882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6875278-3171-4a21-9b08-bbafb3d90514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.914422 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.914400 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1500bf9f-4aad-4f5f-8e21-594bce1f3733-registry-certificates\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.914777 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.914480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1500bf9f-4aad-4f5f-8e21-594bce1f3733-trusted-ca\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.915985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.915968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-registry-tls\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.916096 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.915988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6875278-3171-4a21-9b08-bbafb3d90514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.916096 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.916012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1500bf9f-4aad-4f5f-8e21-594bce1f3733-installation-pull-secrets\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.916394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.916374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1500bf9f-4aad-4f5f-8e21-594bce1f3733-image-registry-private-configuration\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.921327 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.921307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwvfw\" (UniqueName: \"kubernetes.io/projected/e6875278-3171-4a21-9b08-bbafb3d90514-kube-api-access-bwvfw\") pod \"insights-runtime-extractor-7mc5w\" (UID: \"e6875278-3171-4a21-9b08-bbafb3d90514\") " pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:43.921427 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.921310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-bound-sa-token\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:43.921427 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:43.921398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkjhl\" (UniqueName: \"kubernetes.io/projected/1500bf9f-4aad-4f5f-8e21-594bce1f3733-kube-api-access-jkjhl\") pod \"image-registry-54f4658f85-fbljc\" (UID: \"1500bf9f-4aad-4f5f-8e21-594bce1f3733\") " pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:44.037181 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.037122 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:44.042752 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.042733 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7mc5w" Jun 08 21:10:44.172417 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.172394 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f4658f85-fbljc"] Jun 08 21:10:44.174593 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:44.174566 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1500bf9f_4aad_4f5f_8e21_594bce1f3733.slice/crio-899a14e58f68099521585f46667d0dfb1e810bc4b0832d6a3f24d246ce83b269 WatchSource:0}: Error finding container 899a14e58f68099521585f46667d0dfb1e810bc4b0832d6a3f24d246ce83b269: Status 404 returned error can't find the container with id 899a14e58f68099521585f46667d0dfb1e810bc4b0832d6a3f24d246ce83b269 Jun 08 21:10:44.185169 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.185145 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7mc5w"] Jun 08 21:10:44.188374 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:44.188277 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6875278_3171_4a21_9b08_bbafb3d90514.slice/crio-e5151ddb3bd22b6899fb7684ac81a1fb78347df26fe0c4c130e297d48228d6e4 WatchSource:0}: Error finding container e5151ddb3bd22b6899fb7684ac81a1fb78347df26fe0c4c130e297d48228d6e4: Status 404 returned error can't find the container with id e5151ddb3bd22b6899fb7684ac81a1fb78347df26fe0c4c130e297d48228d6e4 Jun 08 21:10:44.909805 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.909771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mc5w" event={"ID":"e6875278-3171-4a21-9b08-bbafb3d90514","Type":"ContainerStarted","Data":"abfe922036f082b07a5c09265afd5777d0be290608cc7635964b6255031a196d"} Jun 08 21:10:44.910162 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.909833 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mc5w" event={"ID":"e6875278-3171-4a21-9b08-bbafb3d90514","Type":"ContainerStarted","Data":"e5151ddb3bd22b6899fb7684ac81a1fb78347df26fe0c4c130e297d48228d6e4"} Jun 08 21:10:44.911113 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.911087 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" event={"ID":"1500bf9f-4aad-4f5f-8e21-594bce1f3733","Type":"ContainerStarted","Data":"635db510e4a3fd74d1ecfa35335adfb20afa26f0c0447e98f69dc06b75b20342"} Jun 08 21:10:44.911240 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.911131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" event={"ID":"1500bf9f-4aad-4f5f-8e21-594bce1f3733","Type":"ContainerStarted","Data":"899a14e58f68099521585f46667d0dfb1e810bc4b0832d6a3f24d246ce83b269"} Jun 08 21:10:44.911240 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.911208 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:10:44.928748 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:44.928706 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podStartSLOduration=1.9286918 podStartE2EDuration="1.9286918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:44.928303363 +0000 UTC m=+199.096317164" watchObservedRunningTime="2026-06-08 21:10:44.9286918 +0000 UTC m=+199.096705621" Jun 08 21:10:45.729846 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:45.729814 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:45.732745 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:45.732719 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c3fd102-2650-4e0d-909e-6bce6446cbee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gc672\" (UID: \"7c3fd102-2650-4e0d-909e-6bce6446cbee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:45.917353 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:45.917316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mc5w" event={"ID":"e6875278-3171-4a21-9b08-bbafb3d90514","Type":"ContainerStarted","Data":"3e3737c667fd265d94c0025b0dc90cc6a6cd7525b9fee51c6a31351ba3f3fac1"} Jun 08 21:10:46.009897 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:46.009829 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xpcpr\"" Jun 08 21:10:46.017356 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:46.017334 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" Jun 08 21:10:46.160473 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:46.160441 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-gc672"] Jun 08 21:10:46.163406 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:46.163379 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3fd102_2650_4e0d_909e_6bce6446cbee.slice/crio-d3d742a989313331ebd50ae5e40d57bc5ca8d7e2e332d26db0ba67c32b32b580 WatchSource:0}: Error finding container d3d742a989313331ebd50ae5e40d57bc5ca8d7e2e332d26db0ba67c32b32b580: Status 404 returned error can't find the container with id d3d742a989313331ebd50ae5e40d57bc5ca8d7e2e332d26db0ba67c32b32b580 Jun 08 21:10:46.491734 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:46.491697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:46.551230 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:46.551192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:46.835982 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:46.835887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:46.921453 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:46.921422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" event={"ID":"7c3fd102-2650-4e0d-909e-6bce6446cbee","Type":"ContainerStarted","Data":"d3d742a989313331ebd50ae5e40d57bc5ca8d7e2e332d26db0ba67c32b32b580"} Jun 08 21:10:47.927296 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:47.927257 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mc5w" event={"ID":"e6875278-3171-4a21-9b08-bbafb3d90514","Type":"ContainerStarted","Data":"6c9740773c540781c3f370f7bf2278cf83d5a63871ea3b062840cfcffce955c4"} Jun 08 21:10:48.932055 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:48.932005 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" event={"ID":"7c3fd102-2650-4e0d-909e-6bce6446cbee","Type":"ContainerStarted","Data":"ef4c7386e3a22f28a0c2a3270984e5bfb837dd8d89bd7eb53000b8c030af44fc"} Jun 08 21:10:48.947610 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:48.947564 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gc672" podStartSLOduration=33.916521583 podStartE2EDuration="35.947549866s" totalImagesPullingTime="2.031028283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:48.947129718 +0000 UTC m=+203.115143522" watchObservedRunningTime="2026-06-08 21:10:48.947549866 +0000 UTC m=+203.115563656" Jun 08 21:10:48.948173 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:48.948149 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7mc5w" podStartSLOduration=2.968266468 podStartE2EDuration="5.948138896s" totalImagesPullingTime="2.979872428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:10:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:47.950564016 +0000 UTC m=+202.118577807" watchObservedRunningTime="2026-06-08 21:10:48.948138896 +0000 UTC m=+203.116152686" Jun 08 21:10:49.024026 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:49.023951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:49.124979 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:49.124948 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:49.176723 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:49.176690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:49.731112 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:49.731075 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:51.620266 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.620218 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:51.821817 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.821780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:51.853073 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.853047 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27"] Jun 08 21:10:51.856485 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.856464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:51.859151 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.859130 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 21:10:51.859271 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.859141 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 21:10:51.859363 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.859187 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 21:10:51.860222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.860204 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sjck8\"" Jun 08 21:10:51.863153 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.863130 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jbjqs"] Jun 08 21:10:51.865823 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.865805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.868218 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.868197 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 21:10:51.868746 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.868725 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 21:10:51.868932 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.868913 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 21:10:51.869061 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.869036 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27"] Jun 08 21:10:51.869272 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.869247 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rmmpg\"" Jun 08 21:10:51.908302 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.908276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:51.969442 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.969407 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:51.979237 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-root\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.979350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979250 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-wtmp\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.979350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vswg\" (UniqueName: \"kubernetes.io/projected/0c312f9e-8e77-4707-965e-d913d3ae55ab-kube-api-access-6vswg\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:51.979350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.979350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn6pr\" (UniqueName: \"kubernetes.io/projected/55d0b667-787d-4b7c-ad0d-386dc89a0f32-kube-api-access-vn6pr\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.979482 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-textfile\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.979482 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-sys\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.979482 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.979583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d0b667-787d-4b7c-ad0d-386dc89a0f32-metrics-client-ca\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:51.979583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c312f9e-8e77-4707-965e-d913d3ae55ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:51.979583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979536 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c312f9e-8e77-4707-965e-d913d3ae55ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:51.979583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c312f9e-8e77-4707-965e-d913d3ae55ab-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:51.979713 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:51.979594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-tls\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.064384 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.064351 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:52.080496 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn6pr\" (UniqueName: \"kubernetes.io/projected/55d0b667-787d-4b7c-ad0d-386dc89a0f32-kube-api-access-vn6pr\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080618 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-textfile\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080618 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-sys\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080618 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080618 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d0b667-787d-4b7c-ad0d-386dc89a0f32-metrics-client-ca\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080618 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c312f9e-8e77-4707-965e-d913d3ae55ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.080618 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c312f9e-8e77-4707-965e-d913d3ae55ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080615 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-sys\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c312f9e-8e77-4707-965e-d913d3ae55ab-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080684 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-tls\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-root\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-wtmp\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vswg\" (UniqueName: \"kubernetes.io/projected/0c312f9e-8e77-4707-965e-d913d3ae55ab-kube-api-access-6vswg\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-root\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.080922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-textfile\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.081360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.080967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-wtmp\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.081360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.081288 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.081922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.081884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d0b667-787d-4b7c-ad0d-386dc89a0f32-metrics-client-ca\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.082235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.082212 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c312f9e-8e77-4707-965e-d913d3ae55ab-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.083401 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.083368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c312f9e-8e77-4707-965e-d913d3ae55ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.083491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.083469 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c312f9e-8e77-4707-965e-d913d3ae55ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.083533 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.083477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.083577 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.083563 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55d0b667-787d-4b7c-ad0d-386dc89a0f32-node-exporter-tls\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.090088 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.090063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn6pr\" (UniqueName: \"kubernetes.io/projected/55d0b667-787d-4b7c-ad0d-386dc89a0f32-kube-api-access-vn6pr\") pod \"node-exporter-jbjqs\" (UID: \"55d0b667-787d-4b7c-ad0d-386dc89a0f32\") " pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.092599 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.092554 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vswg\" (UniqueName: \"kubernetes.io/projected/0c312f9e-8e77-4707-965e-d913d3ae55ab-kube-api-access-6vswg\") pod \"openshift-state-metrics-65f78d5c66-zwm27\" (UID: \"0c312f9e-8e77-4707-965e-d913d3ae55ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.164579 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.164519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:52.168378 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.168351 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" Jun 08 21:10:52.179834 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.179814 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jbjqs" Jun 08 21:10:52.189496 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:52.189471 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d0b667_787d_4b7c_ad0d_386dc89a0f32.slice/crio-262c336b5dd1ed8faef1e325cdf55d93f48d191629ae1bc23030afe169ecb5f0 WatchSource:0}: Error finding container 262c336b5dd1ed8faef1e325cdf55d93f48d191629ae1bc23030afe169ecb5f0: Status 404 returned error can't find the container with id 262c336b5dd1ed8faef1e325cdf55d93f48d191629ae1bc23030afe169ecb5f0 Jun 08 21:10:52.264757 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.264716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:52.302069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.302045 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27"] Jun 08 21:10:52.305681 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:52.305649 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c312f9e_8e77_4707_965e_d913d3ae55ab.slice/crio-a8a49063880084d2bcb062696be3977c1b7331df838cb6b6a8ce52ff5fb973d5 WatchSource:0}: Error finding container a8a49063880084d2bcb062696be3977c1b7331df838cb6b6a8ce52ff5fb973d5: Status 404 returned error can't find the container with id a8a49063880084d2bcb062696be3977c1b7331df838cb6b6a8ce52ff5fb973d5 Jun 08 21:10:52.527050 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.527001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:52.844307 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.844168 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:52.922969 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.922894 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:52.950125 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.950075 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" event={"ID":"0c312f9e-8e77-4707-965e-d913d3ae55ab","Type":"ContainerStarted","Data":"737c35348dcd7c6d06a5793b9718e4c339bd68f42f3b099f2b204b741f9f1d5f"} Jun 08 21:10:52.950272 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.950143 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" event={"ID":"0c312f9e-8e77-4707-965e-d913d3ae55ab","Type":"ContainerStarted","Data":"1c5d5bed18e98725ddbc5019ca631124048f61e24331f625ea4ec0c894c7fc3c"} Jun 08 21:10:52.950272 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.950174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" event={"ID":"0c312f9e-8e77-4707-965e-d913d3ae55ab","Type":"ContainerStarted","Data":"a8a49063880084d2bcb062696be3977c1b7331df838cb6b6a8ce52ff5fb973d5"} Jun 08 21:10:52.951748 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:52.951718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbjqs" event={"ID":"55d0b667-787d-4b7c-ad0d-386dc89a0f32","Type":"ContainerStarted","Data":"262c336b5dd1ed8faef1e325cdf55d93f48d191629ae1bc23030afe169ecb5f0"} Jun 08 21:10:53.042356 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.042325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:53.688103 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.688068 2565 patch_prober.go:28] interesting pod/image-registry-67fcb56664-4sdsj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:10:53.688246 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.688125 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" podUID="4ebba62c-938d-4419-a9ee-514cb9d34db7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:10:53.849616 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.849586 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn"] Jun 08 21:10:53.852164 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.852148 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:53.854921 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.854896 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 21:10:53.855057 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.854947 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 21:10:53.855057 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.854976 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pnkk7\"" Jun 08 21:10:53.855137 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.855084 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 21:10:53.855220 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.855203 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 21:10:53.855253 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.855209 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-iah1nbsblc78\"" Jun 08 21:10:53.855282 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.855266 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 21:10:53.863409 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.863386 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn"] Jun 08 21:10:53.956444 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.956364 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" event={"ID":"0c312f9e-8e77-4707-965e-d913d3ae55ab","Type":"ContainerStarted","Data":"da636353cb2831d2b1c91121164b2b0869375c959ac65656a495f159fdf52a79"} Jun 08 21:10:53.957765 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.957744 2565 generic.go:356] "Generic (PLEG): container finished" podID="55d0b667-787d-4b7c-ad0d-386dc89a0f32" containerID="ffb8bdff20d540e98f0ed3063e53f6753a22497380f8837ea273624232036b7e" exitCode=0 Jun 08 21:10:53.957864 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.957811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbjqs" event={"ID":"55d0b667-787d-4b7c-ad0d-386dc89a0f32","Type":"ContainerDied","Data":"ffb8bdff20d540e98f0ed3063e53f6753a22497380f8837ea273624232036b7e"} Jun 08 21:10:53.973627 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.973590 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zwm27" podStartSLOduration=2.008041288 podStartE2EDuration="2.973566278s" totalImagesPullingTime="965.52499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:53.973006313 +0000 UTC m=+208.141020127" watchObservedRunningTime="2026-06-08 21:10:53.973566278 +0000 UTC m=+208.141580070" Jun 08 21:10:53.997112 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.997088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:53.997229 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.997119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vjw9\" (UniqueName: \"kubernetes.io/projected/ae186360-2d66-4a37-96ff-cad8b84462af-kube-api-access-8vjw9\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:53.997229 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.997158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:53.997303 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.997221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-grpc-tls\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:53.997303 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.997277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae186360-2d66-4a37-96ff-cad8b84462af-metrics-client-ca\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:53.997303 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.997295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-tls\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:53.997447 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.997363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:53.997447 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:53.997429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.098000 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.097973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.098134 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.098049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.098190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.098170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vjw9\" (UniqueName: \"kubernetes.io/projected/ae186360-2d66-4a37-96ff-cad8b84462af-kube-api-access-8vjw9\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.098264 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.098247 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.098378 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.098360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-grpc-tls\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.098439 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.098404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae186360-2d66-4a37-96ff-cad8b84462af-metrics-client-ca\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.098439 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.098434 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-tls\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.098551 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.098532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.099793 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.099764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae186360-2d66-4a37-96ff-cad8b84462af-metrics-client-ca\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.101235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.101208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.101342 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.101213 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.101543 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.101523 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-tls\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.101738 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.101718 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-grpc-tls\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.101916 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.101897 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.102329 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.102311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae186360-2d66-4a37-96ff-cad8b84462af-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.106194 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.106173 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vjw9\" (UniqueName: \"kubernetes.io/projected/ae186360-2d66-4a37-96ff-cad8b84462af-kube-api-access-8vjw9\") pod \"thanos-querier-5ccd54c4bb-jkzvn\" (UID: \"ae186360-2d66-4a37-96ff-cad8b84462af\") " pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.160654 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.160627 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:54.291784 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.291418 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn"] Jun 08 21:10:54.292636 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:54.292594 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae186360_2d66_4a37_96ff_cad8b84462af.slice/crio-00bda34d215562629b53a9d3abdbbff0431ef49e16af61e0c1baf6b51a50f5ce WatchSource:0}: Error finding container 00bda34d215562629b53a9d3abdbbff0431ef49e16af61e0c1baf6b51a50f5ce: Status 404 returned error can't find the container with id 00bda34d215562629b53a9d3abdbbff0431ef49e16af61e0c1baf6b51a50f5ce Jun 08 21:10:54.772031 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.771983 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:54.820231 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.820198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:54.955848 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.955791 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:54.964638 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.964609 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbjqs" event={"ID":"55d0b667-787d-4b7c-ad0d-386dc89a0f32","Type":"ContainerStarted","Data":"e0e7432c813a8f3d4bb15a9247f5ae7c5ef5f9f52f2fe386139f0c43ff856f67"} Jun 08 21:10:54.964770 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.964668 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbjqs" event={"ID":"55d0b667-787d-4b7c-ad0d-386dc89a0f32","Type":"ContainerStarted","Data":"f0fde8386438a9ba68ef98cff1103b3fc4753c92d955bd4e41719902b04f238a"} Jun 08 21:10:54.965923 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.965894 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" event={"ID":"ae186360-2d66-4a37-96ff-cad8b84462af","Type":"ContainerStarted","Data":"00bda34d215562629b53a9d3abdbbff0431ef49e16af61e0c1baf6b51a50f5ce"} Jun 08 21:10:54.987334 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:54.987285 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jbjqs" podStartSLOduration=3.058706978 podStartE2EDuration="3.987266928s" totalImagesPullingTime="848.804345ms" totalInitContainerRuntime="79.755605ms" isStatefulPod=true podCreationTimestamp="2026-06-08 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:54.985704029 +0000 UTC m=+209.153717822" watchObservedRunningTime="2026-06-08 21:10:54.987266928 +0000 UTC m=+209.155280718" Jun 08 21:10:55.132145 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:55.132073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:56.637381 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.637314 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx"] Jun 08 21:10:56.639460 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.639443 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:56.641769 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.641751 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 21:10:56.641873 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.641753 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4vg9h\"" Jun 08 21:10:56.643637 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.643610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:56.649477 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.649454 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx"] Jun 08 21:10:56.726221 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.722507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/919c0b2d-06f7-4776-9c6c-6024de7d5b3d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-2ftxx\" (UID: \"919c0b2d-06f7-4776-9c6c-6024de7d5b3d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:56.726221 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.722604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqcm\" (UniqueName: \"kubernetes.io/projected/919c0b2d-06f7-4776-9c6c-6024de7d5b3d-kube-api-access-mcqcm\") pod \"monitoring-plugin-76b68cc874-2ftxx\" (UID: \"919c0b2d-06f7-4776-9c6c-6024de7d5b3d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:56.751838 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.751808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:56.823994 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.823964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqcm\" (UniqueName: \"kubernetes.io/projected/919c0b2d-06f7-4776-9c6c-6024de7d5b3d-kube-api-access-mcqcm\") pod \"monitoring-plugin-76b68cc874-2ftxx\" (UID: \"919c0b2d-06f7-4776-9c6c-6024de7d5b3d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:56.824138 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.824096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/919c0b2d-06f7-4776-9c6c-6024de7d5b3d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-2ftxx\" (UID: \"919c0b2d-06f7-4776-9c6c-6024de7d5b3d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:56.826473 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.826453 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/919c0b2d-06f7-4776-9c6c-6024de7d5b3d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-2ftxx\" (UID: \"919c0b2d-06f7-4776-9c6c-6024de7d5b3d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:56.832402 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.832374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqcm\" (UniqueName: \"kubernetes.io/projected/919c0b2d-06f7-4776-9c6c-6024de7d5b3d-kube-api-access-mcqcm\") pod \"monitoring-plugin-76b68cc874-2ftxx\" (UID: \"919c0b2d-06f7-4776-9c6c-6024de7d5b3d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:56.947990 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.947972 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:56.976658 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.976629 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" event={"ID":"ae186360-2d66-4a37-96ff-cad8b84462af","Type":"ContainerStarted","Data":"507828c61148aa13bcda01b64ddd5b3bf1e275a22b5f053ca8e7d5e4b69753be"} Jun 08 21:10:56.976781 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.976739 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" event={"ID":"ae186360-2d66-4a37-96ff-cad8b84462af","Type":"ContainerStarted","Data":"22686c23c62892b420fe6f36e4c8e7345c8ee5a05731d2c6d8e53e118556942c"} Jun 08 21:10:56.976781 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:56.976779 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" event={"ID":"ae186360-2d66-4a37-96ff-cad8b84462af","Type":"ContainerStarted","Data":"eeec0860758011d21d35c48519bb60a5b9516cde638709a27d05c5b18539ad70"} Jun 08 21:10:57.085592 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:57.085520 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx"] Jun 08 21:10:57.089345 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:10:57.089313 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919c0b2d_06f7_4776_9c6c_6024de7d5b3d.slice/crio-e0f83ddaa11c243516fba1b412a1724176660c4e7390540894ab1d1470e19efc WatchSource:0}: Error finding container e0f83ddaa11c243516fba1b412a1724176660c4e7390540894ab1d1470e19efc: Status 404 returned error can't find the container with id e0f83ddaa11c243516fba1b412a1724176660c4e7390540894ab1d1470e19efc Jun 08 21:10:57.981387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:57.981354 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" event={"ID":"919c0b2d-06f7-4776-9c6c-6024de7d5b3d","Type":"ContainerStarted","Data":"e0f83ddaa11c243516fba1b412a1724176660c4e7390540894ab1d1470e19efc"} Jun 08 21:10:57.984469 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:57.984443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" event={"ID":"ae186360-2d66-4a37-96ff-cad8b84462af","Type":"ContainerStarted","Data":"e9216b81a5c5b4881d412c7c75b230f1b5aa474bdde14aa6fbf4517615c83cde"} Jun 08 21:10:57.984585 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:57.984501 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" event={"ID":"ae186360-2d66-4a37-96ff-cad8b84462af","Type":"ContainerStarted","Data":"163578156c4efbf7e4af43a75c70f34474d534bdcf4d3fb2377b87ab16620e83"} Jun 08 21:10:57.984585 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:57.984529 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" event={"ID":"ae186360-2d66-4a37-96ff-cad8b84462af","Type":"ContainerStarted","Data":"b5dc721b4f474756d1d91b2ae780b1ec1a0d9949db239e315c3516c3503627bd"} Jun 08 21:10:57.984649 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:57.984630 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:10:58.007500 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:58.007449 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" podStartSLOduration=2.175519666 podStartE2EDuration="5.00743067s" totalImagesPullingTime="2.831911004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:58.005313817 +0000 UTC m=+212.173327624" watchObservedRunningTime="2026-06-08 21:10:58.00743067 +0000 UTC m=+212.175444462" Jun 08 21:10:58.054368 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:58.054336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:58.989857 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:58.989820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" event={"ID":"919c0b2d-06f7-4776-9c6c-6024de7d5b3d","Type":"ContainerStarted","Data":"21ace154eca81f712ecd61bbd8d91773b7fb809edd1c4a04329323d87cf75d5d"} Jun 08 21:10:58.990355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:58.990119 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:58.994906 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:58.994883 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" Jun 08 21:10:59.005820 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.005778 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-2ftxx" podStartSLOduration=1.789280279 podStartE2EDuration="3.005762274s" totalImagesPullingTime="1.216481995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:10:59.00474603 +0000 UTC m=+213.172759820" watchObservedRunningTime="2026-06-08 21:10:59.005762274 +0000 UTC m=+213.173776065" Jun 08 21:10:59.687681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.687647 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-8v5wv"] Jun 08 21:10:59.689670 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.689650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-8v5wv" Jun 08 21:10:59.692291 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.692263 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 21:10:59.692481 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.692463 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 21:10:59.692599 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.692584 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tkfjj\"" Jun 08 21:10:59.713756 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.713728 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-8v5wv"] Jun 08 21:10:59.720801 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.720774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:59.747404 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.747375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvbd\" (UniqueName: \"kubernetes.io/projected/d1f4c12f-65f4-4454-976d-2efb2834a35a-kube-api-access-dvvbd\") pod \"downloads-6657875f97-8v5wv\" (UID: \"d1f4c12f-65f4-4454-976d-2efb2834a35a\") " pod="openshift-console/downloads-6657875f97-8v5wv" Jun 08 21:10:59.808062 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.808031 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:59.848257 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.848230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvbd\" (UniqueName: \"kubernetes.io/projected/d1f4c12f-65f4-4454-976d-2efb2834a35a-kube-api-access-dvvbd\") pod \"downloads-6657875f97-8v5wv\" (UID: \"d1f4c12f-65f4-4454-976d-2efb2834a35a\") " pod="openshift-console/downloads-6657875f97-8v5wv" Jun 08 21:10:59.857891 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.857862 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvbd\" (UniqueName: \"kubernetes.io/projected/d1f4c12f-65f4-4454-976d-2efb2834a35a-kube-api-access-dvvbd\") pod \"downloads-6657875f97-8v5wv\" (UID: \"d1f4c12f-65f4-4454-976d-2efb2834a35a\") " pod="openshift-console/downloads-6657875f97-8v5wv" Jun 08 21:10:59.984781 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.984710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:10:59.997608 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:10:59.997586 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-8v5wv" Jun 08 21:11:00.122515 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:00.122488 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-8v5wv"] Jun 08 21:11:00.125778 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:11:00.125751 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f4c12f_65f4_4454_976d_2efb2834a35a.slice/crio-cdec8739c5be86a80770cb0b130f0143b424780b7059ea0c02f395db4bd61056 WatchSource:0}: Error finding container cdec8739c5be86a80770cb0b130f0143b424780b7059ea0c02f395db4bd61056: Status 404 returned error can't find the container with id cdec8739c5be86a80770cb0b130f0143b424780b7059ea0c02f395db4bd61056 Jun 08 21:11:00.355555 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:00.355481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:00.404516 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:00.404488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:00.764243 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:00.764215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:00.811495 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:00.811464 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:00.965713 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:00.965687 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:00.997338 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:00.997311 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-8v5wv" event={"ID":"d1f4c12f-65f4-4454-976d-2efb2834a35a","Type":"ContainerStarted","Data":"cdec8739c5be86a80770cb0b130f0143b424780b7059ea0c02f395db4bd61056"} Jun 08 21:11:01.111487 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:01.111418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:01.215225 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:01.215194 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:01.314773 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:01.314730 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:01.412543 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:01.412471 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:01.514129 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:01.514095 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:03.224209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:03.224147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:03.273098 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:03.273053 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:03.689125 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:03.689087 2565 patch_prober.go:28] interesting pod/image-registry-67fcb56664-4sdsj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:03.689301 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:03.689146 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" podUID="4ebba62c-938d-4419-a9ee-514cb9d34db7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:03.997608 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:03.997526 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5ccd54c4bb-jkzvn" Jun 08 21:11:04.042321 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:04.042292 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:04.042464 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:04.042344 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:05.922051 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:05.921991 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:05.922486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:05.922075 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:08.702831 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:08.702788 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" podUID="4ebba62c-938d-4419-a9ee-514cb9d34db7" containerName="registry" containerID="cri-o://62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240" gracePeriod=30 Jun 08 21:11:08.958760 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:08.958706 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:11:09.029431 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.029400 2565 generic.go:356] "Generic (PLEG): container finished" podID="4ebba62c-938d-4419-a9ee-514cb9d34db7" containerID="62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240" exitCode=0 Jun 08 21:11:09.029563 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.029445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" event={"ID":"4ebba62c-938d-4419-a9ee-514cb9d34db7","Type":"ContainerDied","Data":"62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240"} Jun 08 21:11:09.029563 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.029448 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" Jun 08 21:11:09.029563 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.029483 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fcb56664-4sdsj" event={"ID":"4ebba62c-938d-4419-a9ee-514cb9d34db7","Type":"ContainerDied","Data":"c195f9c6df3376385daddbe3920ad6fbadd1ff94157f690e9c3f3891af15e77a"} Jun 08 21:11:09.029563 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.029502 2565 scope.go:117] "RemoveContainer" containerID="62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240" Jun 08 21:11:09.037227 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.037210 2565 scope.go:117] "RemoveContainer" containerID="62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240" Jun 08 21:11:09.037491 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:11:09.037472 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240\": container with ID starting with 62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240 not found: ID does not exist" containerID="62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240" Jun 08 21:11:09.037545 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.037503 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240"} err="failed to get container status \"62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240\": rpc error: code = NotFound desc = could not find container \"62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240\": container with ID starting with 62efbbbdc0b8ecf36f5d2eb62768d92deaf519535b80454205eaa1bcd0cdf240 not found: ID does not exist" Jun 08 21:11:09.128467 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.128433 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") pod \"4ebba62c-938d-4419-a9ee-514cb9d34db7\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " Jun 08 21:11:09.128591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.128492 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-installation-pull-secrets\") pod \"4ebba62c-938d-4419-a9ee-514cb9d34db7\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " Jun 08 21:11:09.128591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.128517 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-bound-sa-token\") pod \"4ebba62c-938d-4419-a9ee-514cb9d34db7\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " Jun 08 21:11:09.128591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.128564 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2xfz\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-kube-api-access-h2xfz\") pod \"4ebba62c-938d-4419-a9ee-514cb9d34db7\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " Jun 08 21:11:09.128744 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.128613 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ebba62c-938d-4419-a9ee-514cb9d34db7-ca-trust-extracted\") pod \"4ebba62c-938d-4419-a9ee-514cb9d34db7\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " Jun 08 21:11:09.128744 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.128659 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-trusted-ca\") pod \"4ebba62c-938d-4419-a9ee-514cb9d34db7\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " Jun 08 21:11:09.128744 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.128687 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-certificates\") pod \"4ebba62c-938d-4419-a9ee-514cb9d34db7\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " Jun 08 21:11:09.128744 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.128715 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-image-registry-private-configuration\") pod \"4ebba62c-938d-4419-a9ee-514cb9d34db7\" (UID: \"4ebba62c-938d-4419-a9ee-514cb9d34db7\") " Jun 08 21:11:09.129393 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.129115 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4ebba62c-938d-4419-a9ee-514cb9d34db7" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:11:09.129698 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.129669 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4ebba62c-938d-4419-a9ee-514cb9d34db7" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:11:09.131573 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.131325 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4ebba62c-938d-4419-a9ee-514cb9d34db7" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:11:09.131716 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.131686 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-kube-api-access-h2xfz" (OuterVolumeSpecName: "kube-api-access-h2xfz") pod "4ebba62c-938d-4419-a9ee-514cb9d34db7" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7"). InnerVolumeSpecName "kube-api-access-h2xfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:11:09.131861 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.131830 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4ebba62c-938d-4419-a9ee-514cb9d34db7" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:11:09.131935 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.131889 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4ebba62c-938d-4419-a9ee-514cb9d34db7" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:11:09.132426 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.132220 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4ebba62c-938d-4419-a9ee-514cb9d34db7" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:11:09.139488 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.139460 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ebba62c-938d-4419-a9ee-514cb9d34db7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4ebba62c-938d-4419-a9ee-514cb9d34db7" (UID: "4ebba62c-938d-4419-a9ee-514cb9d34db7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:11:09.229911 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.229850 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ebba62c-938d-4419-a9ee-514cb9d34db7-ca-trust-extracted\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:11:09.229911 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.229875 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-trusted-ca\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:11:09.229911 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.229885 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-certificates\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:11:09.229911 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.229893 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-image-registry-private-configuration\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:11:09.229911 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.229903 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-registry-tls\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:11:09.229911 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.229910 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ebba62c-938d-4419-a9ee-514cb9d34db7-installation-pull-secrets\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:11:09.229911 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.229918 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-bound-sa-token\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:11:09.230365 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.229926 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2xfz\" (UniqueName: \"kubernetes.io/projected/4ebba62c-938d-4419-a9ee-514cb9d34db7-kube-api-access-h2xfz\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:11:09.350338 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.350310 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fcb56664-4sdsj"] Jun 08 21:11:09.355376 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:09.355344 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67fcb56664-4sdsj"] Jun 08 21:11:10.309938 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.309901 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ebba62c-938d-4419-a9ee-514cb9d34db7" path="/var/lib/kubelet/pods/4ebba62c-938d-4419-a9ee-514cb9d34db7/volumes" Jun 08 21:11:10.399170 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.399136 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54ff4f4cc9-wsd8k"] Jun 08 21:11:10.399486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.399470 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ebba62c-938d-4419-a9ee-514cb9d34db7" containerName="registry" Jun 08 21:11:10.399569 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.399490 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ebba62c-938d-4419-a9ee-514cb9d34db7" containerName="registry" Jun 08 21:11:10.399612 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.399578 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ebba62c-938d-4419-a9ee-514cb9d34db7" containerName="registry" Jun 08 21:11:10.403351 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.403329 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.407222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.407163 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 21:11:10.407222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.407185 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 21:11:10.407222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.407163 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qjn4l\"" Jun 08 21:11:10.407462 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.407233 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 21:11:10.407462 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.407336 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 21:11:10.407462 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.407386 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 21:11:10.411973 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.411953 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ff4f4cc9-wsd8k"] Jun 08 21:11:10.540271 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.540238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-serving-cert\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.540412 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.540293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-service-ca\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.540412 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.540351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6rfk\" (UniqueName: \"kubernetes.io/projected/1941313b-58aa-419f-a8e9-a6c6474cc1a3-kube-api-access-s6rfk\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.540412 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.540372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-oauth-config\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.540534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.540435 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-config\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.540534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.540479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-oauth-serving-cert\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.641428 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.641349 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-service-ca\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.641428 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.641398 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6rfk\" (UniqueName: \"kubernetes.io/projected/1941313b-58aa-419f-a8e9-a6c6474cc1a3-kube-api-access-s6rfk\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.641654 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.641542 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-oauth-config\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.641654 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.641638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-config\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.641746 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.641700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-oauth-serving-cert\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.641746 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.641740 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-serving-cert\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.642177 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.642132 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-service-ca\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.642316 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.642294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-config\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.642549 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.642524 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-oauth-serving-cert\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.644425 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.644383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-oauth-config\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.644721 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.644697 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-serving-cert\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.649067 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.649041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6rfk\" (UniqueName: \"kubernetes.io/projected/1941313b-58aa-419f-a8e9-a6c6474cc1a3-kube-api-access-s6rfk\") pod \"console-54ff4f4cc9-wsd8k\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.715143 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.715118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:10.851814 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:10.851785 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ff4f4cc9-wsd8k"] Jun 08 21:11:10.854819 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:11:10.854781 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1941313b_58aa_419f_a8e9_a6c6474cc1a3.slice/crio-bfdc19bfd85bfc48457e14ebdea6a4587ae0d0c586a1569ac6f52c1b680f91f2 WatchSource:0}: Error finding container bfdc19bfd85bfc48457e14ebdea6a4587ae0d0c586a1569ac6f52c1b680f91f2: Status 404 returned error can't find the container with id bfdc19bfd85bfc48457e14ebdea6a4587ae0d0c586a1569ac6f52c1b680f91f2 Jun 08 21:11:11.039274 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:11.039233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ff4f4cc9-wsd8k" event={"ID":"1941313b-58aa-419f-a8e9-a6c6474cc1a3","Type":"ContainerStarted","Data":"bfdc19bfd85bfc48457e14ebdea6a4587ae0d0c586a1569ac6f52c1b680f91f2"} Jun 08 21:11:14.042247 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:14.042201 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:14.042776 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:14.042263 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:14.588983 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:14.588945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:14.637964 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:14.637915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:15.922738 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:15.922702 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:15.923156 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:15.922766 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:17.385820 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.385786 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b78f7f595-rsb77"] Jun 08 21:11:17.390654 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.390631 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.399136 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.399108 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b78f7f595-rsb77"] Jun 08 21:11:17.399259 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.399197 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 21:11:17.507063 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.507038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-serving-cert\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.507222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.507111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-oauth-config\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.507222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.507138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5cw4\" (UniqueName: \"kubernetes.io/projected/4dd74a67-2de9-4523-acbc-d6e55d997605-kube-api-access-t5cw4\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.507222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.507163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-service-ca\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.507222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.507195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-trusted-ca-bundle\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.507403 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.507258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-console-config\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.507403 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.507298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-oauth-serving-cert\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.591623 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.591564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:17.608590 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.608563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-serving-cert\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.608729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.608631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-oauth-config\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.608729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.608658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5cw4\" (UniqueName: \"kubernetes.io/projected/4dd74a67-2de9-4523-acbc-d6e55d997605-kube-api-access-t5cw4\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.608729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.608685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-service-ca\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.608729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.608713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-trusted-ca-bundle\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.608937 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.608743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-console-config\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.608937 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.608763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-oauth-serving-cert\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.609555 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.609529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-console-config\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.609815 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.609764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-service-ca\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.609815 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.609780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-trusted-ca-bundle\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.609985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.609850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-oauth-serving-cert\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.611371 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.611352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-serving-cert\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.611489 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.611468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-oauth-config\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.616704 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.616681 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5cw4\" (UniqueName: \"kubernetes.io/projected/4dd74a67-2de9-4523-acbc-d6e55d997605-kube-api-access-t5cw4\") pod \"console-6b78f7f595-rsb77\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:17.702869 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:17.702831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:19.722402 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:19.722369 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b78f7f595-rsb77"] Jun 08 21:11:19.725209 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:11:19.725168 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd74a67_2de9_4523_acbc_d6e55d997605.slice/crio-b92b8e7ed7d8da1cc79d298bbddc77900fdcd1bb2aed528b82244269fc53ea77 WatchSource:0}: Error finding container b92b8e7ed7d8da1cc79d298bbddc77900fdcd1bb2aed528b82244269fc53ea77: Status 404 returned error can't find the container with id b92b8e7ed7d8da1cc79d298bbddc77900fdcd1bb2aed528b82244269fc53ea77 Jun 08 21:11:20.082280 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.082236 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78f7f595-rsb77" event={"ID":"4dd74a67-2de9-4523-acbc-d6e55d997605","Type":"ContainerStarted","Data":"033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d"} Jun 08 21:11:20.082459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.082343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78f7f595-rsb77" event={"ID":"4dd74a67-2de9-4523-acbc-d6e55d997605","Type":"ContainerStarted","Data":"b92b8e7ed7d8da1cc79d298bbddc77900fdcd1bb2aed528b82244269fc53ea77"} Jun 08 21:11:20.084066 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.084030 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-8v5wv" event={"ID":"d1f4c12f-65f4-4454-976d-2efb2834a35a","Type":"ContainerStarted","Data":"484152f1f59e7bee69d25765fc8f16de5712ca6dbeae8e4004baa4efefc52f2f"} Jun 08 21:11:20.084204 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.084194 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-8v5wv" Jun 08 21:11:20.086204 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.086178 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ff4f4cc9-wsd8k" event={"ID":"1941313b-58aa-419f-a8e9-a6c6474cc1a3","Type":"ContainerStarted","Data":"a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede"} Jun 08 21:11:20.096394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.096370 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-8v5wv" Jun 08 21:11:20.102765 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.102718 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b78f7f595-rsb77" podStartSLOduration=3.102699866 podStartE2EDuration="3.102699866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:11:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:11:20.100340963 +0000 UTC m=+234.268354753" watchObservedRunningTime="2026-06-08 21:11:20.102699866 +0000 UTC m=+234.270713657" Jun 08 21:11:20.117851 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.117799 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54ff4f4cc9-wsd8k" podStartSLOduration=1.37987465 podStartE2EDuration="10.117780046s" totalImagesPullingTime="8.737905396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:11:20.116578628 +0000 UTC m=+234.284592418" watchObservedRunningTime="2026-06-08 21:11:20.117780046 +0000 UTC m=+234.285793840" Jun 08 21:11:20.132450 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.132402 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-8v5wv" podStartSLOduration=1.6479267050000002 podStartE2EDuration="21.132389167s" totalImagesPullingTime="19.484462462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:11:20.131218742 +0000 UTC m=+234.299232532" watchObservedRunningTime="2026-06-08 21:11:20.132389167 +0000 UTC m=+234.300402961" Jun 08 21:11:20.715611 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.715570 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:20.715800 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.715748 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:11:20.717354 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.717319 2565 patch_prober.go:28] interesting pod/console-54ff4f4cc9-wsd8k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 08 21:11:20.717477 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:20.717374 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54ff4f4cc9-wsd8k" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 08 21:11:23.399970 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:23.399932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:23.450537 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:23.450505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:24.042127 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:24.042095 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:24.042314 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:24.042158 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:24.042314 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:24.042204 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:11:24.042739 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:24.042709 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"635db510e4a3fd74d1ecfa35335adfb20afa26f0c0447e98f69dc06b75b20342"} pod="openshift-image-registry/image-registry-54f4658f85-fbljc" containerMessage="Container registry failed liveness probe, will be restarted" Jun 08 21:11:24.047401 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:24.047370 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:24.047546 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:24.047423 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:26.786443 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:26.786398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:26.843034 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:26.842974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:27.703498 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:27.703461 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:27.703672 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:27.703542 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:11:27.704925 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:27.704897 2565 patch_prober.go:28] interesting pod/console-6b78f7f595-rsb77 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 08 21:11:27.705072 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:27.704947 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b78f7f595-rsb77" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 08 21:11:30.376869 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:30.376833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:30.716442 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:30.716409 2565 patch_prober.go:28] interesting pod/console-54ff4f4cc9-wsd8k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 08 21:11:30.716610 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:30.716456 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54ff4f4cc9-wsd8k" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 08 21:11:31.215063 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:31.214995 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:31.265906 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:31.265874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:32.265567 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:32.265532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:32.325097 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:32.325064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:34.047355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:34.047317 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:34.047756 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:34.047377 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:37.703909 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:37.703869 2565 patch_prober.go:28] interesting pod/console-6b78f7f595-rsb77 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 08 21:11:37.704385 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:37.703945 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b78f7f595-rsb77" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 08 21:11:38.087108 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:38.086996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:11:38.089425 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:38.089404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f36a5-4005-496b-a3a6-1fd09949eeda-metrics-certs\") pod \"network-metrics-daemon-r2bj4\" (UID: \"f26f36a5-4005-496b-a3a6-1fd09949eeda\") " pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:11:38.208858 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:38.208826 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m779s\"" Jun 08 21:11:38.216865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:38.216838 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2bj4" Jun 08 21:11:38.358738 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:38.358687 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r2bj4"] Jun 08 21:11:38.367593 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:11:38.367565 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26f36a5_4005_496b_a3a6_1fd09949eeda.slice/crio-69682fbcdbdac9c7ee49232613206ed93e4ea10cbed1b24aa9df99c1df08eb8b WatchSource:0}: Error finding container 69682fbcdbdac9c7ee49232613206ed93e4ea10cbed1b24aa9df99c1df08eb8b: Status 404 returned error can't find the container with id 69682fbcdbdac9c7ee49232613206ed93e4ea10cbed1b24aa9df99c1df08eb8b Jun 08 21:11:39.164003 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:39.163965 2565 generic.go:356] "Generic (PLEG): container finished" podID="b47e7973-90b3-4b1f-bcf3-f7b2eafb4414" containerID="8a24da6a0e6346a7e68911245f2d8497d014c8a38dac6c285ae356fdb548fc38" exitCode=0 Jun 08 21:11:39.164488 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:39.164045 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" event={"ID":"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414","Type":"ContainerDied","Data":"8a24da6a0e6346a7e68911245f2d8497d014c8a38dac6c285ae356fdb548fc38"} Jun 08 21:11:39.164488 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:39.164459 2565 scope.go:117] "RemoveContainer" containerID="8a24da6a0e6346a7e68911245f2d8497d014c8a38dac6c285ae356fdb548fc38" Jun 08 21:11:39.165412 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:39.165393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r2bj4" event={"ID":"f26f36a5-4005-496b-a3a6-1fd09949eeda","Type":"ContainerStarted","Data":"69682fbcdbdac9c7ee49232613206ed93e4ea10cbed1b24aa9df99c1df08eb8b"} Jun 08 21:11:40.011034 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.010987 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:40.061477 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.061447 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:40.171103 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.170981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r2bj4" event={"ID":"f26f36a5-4005-496b-a3a6-1fd09949eeda","Type":"ContainerStarted","Data":"27eef4f0a04ed6464939ec7da1baa5dd8604dc2efedab9305753e7b348133e70"} Jun 08 21:11:40.171103 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.171069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r2bj4" event={"ID":"f26f36a5-4005-496b-a3a6-1fd09949eeda","Type":"ContainerStarted","Data":"38f931cd2cfacf6b3d278502887f705f5d868d504f5560c28743564d319380a4"} Jun 08 21:11:40.172724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.172707 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-hs959" event={"ID":"b47e7973-90b3-4b1f-bcf3-f7b2eafb4414","Type":"ContainerStarted","Data":"de67aa55156eca5ee1105eaa2a6f3e444a7c19e5cd8feba43fc5174e19a89e2d"} Jun 08 21:11:40.186396 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.186350 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r2bj4" podStartSLOduration=252.947871511 podStartE2EDuration="4m14.186330449s" totalImagesPullingTime="1.238458938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:11:40.184873163 +0000 UTC m=+254.352886954" watchObservedRunningTime="2026-06-08 21:11:40.186330449 +0000 UTC m=+254.354344243" Jun 08 21:11:40.268481 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.268427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:40.321602 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.321545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:40.716125 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.716089 2565 patch_prober.go:28] interesting pod/console-54ff4f4cc9-wsd8k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 08 21:11:40.716295 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:40.716147 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54ff4f4cc9-wsd8k" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 08 21:11:44.047425 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:44.047388 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:11:44.047978 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:44.047473 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:11:47.703550 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:47.703510 2565 patch_prober.go:28] interesting pod/console-6b78f7f595-rsb77 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 08 21:11:47.704010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:47.703573 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b78f7f595-rsb77" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 08 21:11:48.204143 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:48.204110 2565 generic.go:356] "Generic (PLEG): container finished" podID="4094b4af-2c80-4dbd-a5ac-3fdb315f4123" containerID="f27a3f257b188390817d3a2f8ceddba9dff336ea335d49aab751b6e6ab9caecc" exitCode=0 Jun 08 21:11:48.204315 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:48.204189 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nw8zc" event={"ID":"4094b4af-2c80-4dbd-a5ac-3fdb315f4123","Type":"ContainerDied","Data":"f27a3f257b188390817d3a2f8ceddba9dff336ea335d49aab751b6e6ab9caecc"} Jun 08 21:11:48.204578 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:48.204560 2565 scope.go:117] "RemoveContainer" containerID="f27a3f257b188390817d3a2f8ceddba9dff336ea335d49aab751b6e6ab9caecc" Jun 08 21:11:48.205748 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:48.205728 2565 generic.go:356] "Generic (PLEG): container finished" podID="7894097a-c3ab-416d-9a48-d0ce5af90dae" containerID="f96b37cd024128a30be3fcc6be2c61d7734afdb2b2ca0a85b5a9f1c6905d9eff" exitCode=0 Jun 08 21:11:48.205828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:48.205767 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" event={"ID":"7894097a-c3ab-416d-9a48-d0ce5af90dae","Type":"ContainerDied","Data":"f96b37cd024128a30be3fcc6be2c61d7734afdb2b2ca0a85b5a9f1c6905d9eff"} Jun 08 21:11:48.206049 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:48.206034 2565 scope.go:117] "RemoveContainer" containerID="f96b37cd024128a30be3fcc6be2c61d7734afdb2b2ca0a85b5a9f1c6905d9eff" Jun 08 21:11:49.066935 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:49.066880 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" containerID="cri-o://635db510e4a3fd74d1ecfa35335adfb20afa26f0c0447e98f69dc06b75b20342" gracePeriod=30 Jun 08 21:11:49.211794 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:49.211719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-thk6l" event={"ID":"7894097a-c3ab-416d-9a48-d0ce5af90dae","Type":"ContainerStarted","Data":"d4a71e5ef121244ffdfd7becbf29ddf0aae399d9d6140c50be6c8e729338b2cf"} Jun 08 21:11:49.213423 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:49.213399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nw8zc" event={"ID":"4094b4af-2c80-4dbd-a5ac-3fdb315f4123","Type":"ContainerStarted","Data":"0ccd656e5ff00a469b50d266ecbc6b9e76770c46c274ee0da1bdcb5350f40085"} Jun 08 21:11:49.648828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:49.648788 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:49.750427 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:49.750396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:50.219970 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:50.219944 2565 generic.go:356] "Generic (PLEG): container finished" podID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerID="635db510e4a3fd74d1ecfa35335adfb20afa26f0c0447e98f69dc06b75b20342" exitCode=0 Jun 08 21:11:50.220293 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:50.220052 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" event={"ID":"1500bf9f-4aad-4f5f-8e21-594bce1f3733","Type":"ContainerDied","Data":"635db510e4a3fd74d1ecfa35335adfb20afa26f0c0447e98f69dc06b75b20342"} Jun 08 21:11:50.715799 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:50.715759 2565 patch_prober.go:28] interesting pod/console-54ff4f4cc9-wsd8k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 08 21:11:50.716001 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:50.715814 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54ff4f4cc9-wsd8k" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 08 21:11:51.230222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:51.230190 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" event={"ID":"1500bf9f-4aad-4f5f-8e21-594bce1f3733","Type":"ContainerStarted","Data":"7828bf100a7fb8b0431b1d540fa7190c6ed4df666bcdeeb6357c864b945575d7"} Jun 08 21:11:51.230660 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:51.230337 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:11:52.716535 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:52.716508 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-f6blw_94072c29-45ee-463d-9cb0-8e87481d5c49/cluster-monitoring-operator/0.log" Jun 08 21:11:53.713397 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:53.713366 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-2ftxx_919c0b2d-06f7-4776-9c6c-6024de7d5b3d/monitoring-plugin/0.log" Jun 08 21:11:54.513418 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:54.513393 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbjqs_55d0b667-787d-4b7c-ad0d-386dc89a0f32/init-textfile/0.log" Jun 08 21:11:54.714835 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:54.714803 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbjqs_55d0b667-787d-4b7c-ad0d-386dc89a0f32/node-exporter/0.log" Jun 08 21:11:54.914087 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:54.913985 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbjqs_55d0b667-787d-4b7c-ad0d-386dc89a0f32/kube-rbac-proxy/0.log" Jun 08 21:11:55.713679 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:55.713645 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwm27_0c312f9e-8e77-4707-965e-d913d3ae55ab/kube-rbac-proxy-main/0.log" Jun 08 21:11:55.914005 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:55.913979 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwm27_0c312f9e-8e77-4707-965e-d913d3ae55ab/kube-rbac-proxy-self/0.log" Jun 08 21:11:56.113527 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:56.113449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwm27_0c312f9e-8e77-4707-965e-d913d3ae55ab/openshift-state-metrics/0.log" Jun 08 21:11:57.703524 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:57.703481 2565 patch_prober.go:28] interesting pod/console-6b78f7f595-rsb77 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 08 21:11:57.703898 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:57.703539 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b78f7f595-rsb77" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 08 21:11:58.913757 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:58.913723 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/thanos-query/0.log" Jun 08 21:11:59.086655 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:59.086619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:59.114869 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:59.114833 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/kube-rbac-proxy-web/0.log" Jun 08 21:11:59.140499 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:59.140467 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:11:59.317335 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:59.317309 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/kube-rbac-proxy/0.log" Jun 08 21:11:59.514941 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:59.514910 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/prom-label-proxy/0.log" Jun 08 21:11:59.715504 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:59.715479 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/kube-rbac-proxy-rules/0.log" Jun 08 21:11:59.914987 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:11:59.914947 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/kube-rbac-proxy-metrics/0.log" Jun 08 21:12:00.113570 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:00.113473 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-gc672_7c3fd102-2650-4e0d-909e-6bce6446cbee/networking-console-plugin/0.log" Jun 08 21:12:00.714766 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:00.714736 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54ff4f4cc9-wsd8k_1941313b-58aa-419f-a8e9-a6c6474cc1a3/console/0.log" Jun 08 21:12:00.715609 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:00.715579 2565 patch_prober.go:28] interesting pod/console-54ff4f4cc9-wsd8k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 08 21:12:00.715729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:00.715643 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54ff4f4cc9-wsd8k" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 08 21:12:00.914731 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:00.914705 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b78f7f595-rsb77_4dd74a67-2de9-4523-acbc-d6e55d997605/console/0.log" Jun 08 21:12:01.116772 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:01.116689 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-8v5wv_d1f4c12f-65f4-4454-976d-2efb2834a35a/download-server/0.log" Jun 08 21:12:02.513921 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:02.513891 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7hxfk_e55a22b3-abfb-47dd-a1ca-573d521c3352/dns-node-resolver/0.log" Jun 08 21:12:03.114008 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:03.113978 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54f4658f85-fbljc_1500bf9f-4aad-4f5f-8e21-594bce1f3733/registry/1.log" Jun 08 21:12:03.914239 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:03.914189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzngq_f22e0f0a-0cdc-4c1d-a852-408d98572076/node-ca/0.log" Jun 08 21:12:04.042458 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:04.042423 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:12:04.042641 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:04.042475 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:12:04.714334 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:04.714303 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q5ssl_bd9ae466-e3df-4221-844f-8e25cd28ede7/serve-healthcheck-canary/0.log" Jun 08 21:12:07.703729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:07.703689 2565 patch_prober.go:28] interesting pod/console-6b78f7f595-rsb77 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 08 21:12:07.704161 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:07.703758 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b78f7f595-rsb77" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 08 21:12:07.768635 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:12:07.768584 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n4wmk" podUID="27b38eb9-0c8a-4b0a-914d-8bdb328df801" Jun 08 21:12:07.915696 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:07.915657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:07.967743 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:07.967636 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:08.301784 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.301705 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4wmk" Jun 08 21:12:08.610542 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.610451 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ff4f4cc9-wsd8k"] Jun 08 21:12:08.612530 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.612498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:08.640338 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.640306 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd966fb6f-tq7f7"] Jun 08 21:12:08.643395 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.643378 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.652461 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.652430 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd966fb6f-tq7f7"] Jun 08 21:12:08.671783 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.671750 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:08.749753 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.749720 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-serving-cert\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.750175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.749759 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-oauth-config\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.750175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.749833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-service-ca\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.750175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.749852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-trusted-ca-bundle\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.750175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.749872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-oauth-serving-cert\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.750175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.749944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd5mh\" (UniqueName: \"kubernetes.io/projected/393d4cdd-d97b-4700-801b-217eeba7129c-kube-api-access-dd5mh\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.750175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.749980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-console-config\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.851040 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.850990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-service-ca\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.851040 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-trusted-ca-bundle\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.851249 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-oauth-serving-cert\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.851249 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd5mh\" (UniqueName: \"kubernetes.io/projected/393d4cdd-d97b-4700-801b-217eeba7129c-kube-api-access-dd5mh\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.851249 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-console-config\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.851249 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-serving-cert\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.851249 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-oauth-config\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.851840 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-service-ca\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.852209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851855 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-oauth-serving-cert\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.852209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-trusted-ca-bundle\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.852343 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.851945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-console-config\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.853835 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.853812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-oauth-config\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.854010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.853992 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-serving-cert\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.858533 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.858511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd5mh\" (UniqueName: \"kubernetes.io/projected/393d4cdd-d97b-4700-801b-217eeba7129c-kube-api-access-dd5mh\") pod \"console-6fd966fb6f-tq7f7\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:08.957989 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:08.957954 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:09.087146 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:09.087115 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd966fb6f-tq7f7"] Jun 08 21:12:09.089844 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:12:09.089818 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393d4cdd_d97b_4700_801b_217eeba7129c.slice/crio-e69ab75053876aa3cbe0bf7f780c5814440a3ed58e7be2c1899d853b1c6b327d WatchSource:0}: Error finding container e69ab75053876aa3cbe0bf7f780c5814440a3ed58e7be2c1899d853b1c6b327d: Status 404 returned error can't find the container with id e69ab75053876aa3cbe0bf7f780c5814440a3ed58e7be2c1899d853b1c6b327d Jun 08 21:12:09.306938 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:09.306844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd966fb6f-tq7f7" event={"ID":"393d4cdd-d97b-4700-801b-217eeba7129c","Type":"ContainerStarted","Data":"2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8"} Jun 08 21:12:09.306938 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:09.306903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd966fb6f-tq7f7" event={"ID":"393d4cdd-d97b-4700-801b-217eeba7129c","Type":"ContainerStarted","Data":"e69ab75053876aa3cbe0bf7f780c5814440a3ed58e7be2c1899d853b1c6b327d"} Jun 08 21:12:09.323566 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:09.323522 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd966fb6f-tq7f7" podStartSLOduration=1.32350799 podStartE2EDuration="1.32350799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:12:09.322348421 +0000 UTC m=+283.490362224" watchObservedRunningTime="2026-06-08 21:12:09.32350799 +0000 UTC m=+283.491521781" Jun 08 21:12:11.170943 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:11.170900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:12:11.173548 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:11.173519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27b38eb9-0c8a-4b0a-914d-8bdb328df801-metrics-tls\") pod \"dns-default-n4wmk\" (UID: \"27b38eb9-0c8a-4b0a-914d-8bdb328df801\") " pod="openshift-dns/dns-default-n4wmk" Jun 08 21:12:11.305346 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:11.305314 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r7ngx\"" Jun 08 21:12:11.313177 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:11.313153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4wmk" Jun 08 21:12:11.442874 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:11.442835 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4wmk"] Jun 08 21:12:11.445047 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:12:11.444975 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b38eb9_0c8a_4b0a_914d_8bdb328df801.slice/crio-6df1759e31fb4e0841b4b96806bafa5674875361a5e30a26190fa2dc2edf9c90 WatchSource:0}: Error finding container 6df1759e31fb4e0841b4b96806bafa5674875361a5e30a26190fa2dc2edf9c90: Status 404 returned error can't find the container with id 6df1759e31fb4e0841b4b96806bafa5674875361a5e30a26190fa2dc2edf9c90 Jun 08 21:12:12.238860 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:12.238827 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:12:12.239274 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:12.238879 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:12:12.320760 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:12.320721 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4wmk" event={"ID":"27b38eb9-0c8a-4b0a-914d-8bdb328df801","Type":"ContainerStarted","Data":"6df1759e31fb4e0841b4b96806bafa5674875361a5e30a26190fa2dc2edf9c90"} Jun 08 21:12:13.332180 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:13.332141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4wmk" event={"ID":"27b38eb9-0c8a-4b0a-914d-8bdb328df801","Type":"ContainerStarted","Data":"3ae8f590e7d34d9cc469e1a105f5f682c660e9aefbeccb942ef982753b3d00b8"} Jun 08 21:12:13.332556 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:13.332219 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4wmk" event={"ID":"27b38eb9-0c8a-4b0a-914d-8bdb328df801","Type":"ContainerStarted","Data":"94266784bd3d17571876a0dae823af4aed9a30667ac0e539f170d504b587e828"} Jun 08 21:12:13.332556 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:13.332290 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n4wmk" Jun 08 21:12:13.349225 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:13.349179 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n4wmk" podStartSLOduration=250.677944303 podStartE2EDuration="4m12.349163636s" totalImagesPullingTime="1.671219333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:12:13.347956337 +0000 UTC m=+287.515970151" watchObservedRunningTime="2026-06-08 21:12:13.349163636 +0000 UTC m=+287.517177428" Jun 08 21:12:14.041794 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:14.041751 2565 patch_prober.go:28] interesting pod/image-registry-54f4658f85-fbljc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:12:14.042188 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:14.041818 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" podUID="1500bf9f-4aad-4f5f-8e21-594bce1f3733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:12:14.480583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:14.480532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:17.250861 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:17.250828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:17.351057 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:17.351006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:17.412273 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:17.412239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:17.704184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:17.704149 2565 patch_prober.go:28] interesting pod/console-6b78f7f595-rsb77 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 08 21:12:17.704354 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:17.704202 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b78f7f595-rsb77" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 08 21:12:18.198560 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:18.198524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:18.253419 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:18.253373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:18.958515 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:18.958475 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:18.958728 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:18.958536 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:18.959965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:18.959943 2565 patch_prober.go:28] interesting pod/console-6fd966fb6f-tq7f7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 08 21:12:18.960079 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:18.959999 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6fd966fb6f-tq7f7" podUID="393d4cdd-d97b-4700-801b-217eeba7129c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 08 21:12:19.550067 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:19.550034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:20.644350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:20.644318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:22.239568 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:22.239534 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54f4658f85-fbljc" Jun 08 21:12:22.366134 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:22.366105 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:22.463075 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:22.463011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:22.563387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:22.563307 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:23.340315 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:23.340287 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n4wmk" Jun 08 21:12:24.358636 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:24.358596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:24.406321 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:24.406281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:26.256818 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:26.256793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:12:26.259090 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:26.259072 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:12:26.263924 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:26.263893 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 21:12:26.783508 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:26.783478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:26.832984 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:26.832936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:27.707224 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:27.707186 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:12:27.711130 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:27.711102 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:12:27.844892 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:27.844855 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:27.893042 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:27.893003 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:28.868438 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:28.868408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:28.963297 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:28.963269 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:28.967137 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:28.967104 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:12:28.969601 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:28.969562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:29.024311 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:29.024268 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b78f7f595-rsb77"] Jun 08 21:12:29.113241 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:29.113192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:29.168746 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:29.168661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:29.634605 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:29.634554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:29.736070 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:29.736004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:33.368521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.368480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:33.417071 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.417041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:33.630542 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.630452 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54ff4f4cc9-wsd8k" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" containerID="cri-o://a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede" gracePeriod=15 Jun 08 21:12:33.874613 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.874590 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:12:33.956933 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.956908 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-oauth-serving-cert\") pod \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " Jun 08 21:12:33.957123 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.956963 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-serving-cert\") pod \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " Jun 08 21:12:33.957123 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.956996 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-config\") pod \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " Jun 08 21:12:33.957209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.957165 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-oauth-config\") pod \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " Jun 08 21:12:33.957265 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.957226 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-service-ca\") pod \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " Jun 08 21:12:33.957308 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.957274 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6rfk\" (UniqueName: \"kubernetes.io/projected/1941313b-58aa-419f-a8e9-a6c6474cc1a3-kube-api-access-s6rfk\") pod \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\" (UID: \"1941313b-58aa-419f-a8e9-a6c6474cc1a3\") " Jun 08 21:12:33.957424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.957390 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1941313b-58aa-419f-a8e9-a6c6474cc1a3" (UID: "1941313b-58aa-419f-a8e9-a6c6474cc1a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:33.957424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.957397 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-config" (OuterVolumeSpecName: "console-config") pod "1941313b-58aa-419f-a8e9-a6c6474cc1a3" (UID: "1941313b-58aa-419f-a8e9-a6c6474cc1a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:33.957627 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.957609 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-oauth-serving-cert\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:33.957688 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.957633 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-config\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:33.957688 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.957654 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "1941313b-58aa-419f-a8e9-a6c6474cc1a3" (UID: "1941313b-58aa-419f-a8e9-a6c6474cc1a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:33.959507 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.959481 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1941313b-58aa-419f-a8e9-a6c6474cc1a3-kube-api-access-s6rfk" (OuterVolumeSpecName: "kube-api-access-s6rfk") pod "1941313b-58aa-419f-a8e9-a6c6474cc1a3" (UID: "1941313b-58aa-419f-a8e9-a6c6474cc1a3"). InnerVolumeSpecName "kube-api-access-s6rfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:12:33.959507 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.959486 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1941313b-58aa-419f-a8e9-a6c6474cc1a3" (UID: "1941313b-58aa-419f-a8e9-a6c6474cc1a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:33.959658 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:33.959566 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1941313b-58aa-419f-a8e9-a6c6474cc1a3" (UID: "1941313b-58aa-419f-a8e9-a6c6474cc1a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:34.058508 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.058473 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-serving-cert\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:34.058508 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.058501 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1941313b-58aa-419f-a8e9-a6c6474cc1a3-console-oauth-config\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:34.058508 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.058512 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1941313b-58aa-419f-a8e9-a6c6474cc1a3-service-ca\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:34.058744 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.058520 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6rfk\" (UniqueName: \"kubernetes.io/projected/1941313b-58aa-419f-a8e9-a6c6474cc1a3-kube-api-access-s6rfk\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:34.418787 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.418748 2565 generic.go:356] "Generic (PLEG): container finished" podID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerID="a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede" exitCode=0 Jun 08 21:12:34.419244 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.418801 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ff4f4cc9-wsd8k" Jun 08 21:12:34.419244 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.418814 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ff4f4cc9-wsd8k" event={"ID":"1941313b-58aa-419f-a8e9-a6c6474cc1a3","Type":"ContainerDied","Data":"a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede"} Jun 08 21:12:34.419244 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.418863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ff4f4cc9-wsd8k" event={"ID":"1941313b-58aa-419f-a8e9-a6c6474cc1a3","Type":"ContainerDied","Data":"bfdc19bfd85bfc48457e14ebdea6a4587ae0d0c586a1569ac6f52c1b680f91f2"} Jun 08 21:12:34.419244 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.418890 2565 scope.go:117] "RemoveContainer" containerID="a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede" Jun 08 21:12:34.427360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.427341 2565 scope.go:117] "RemoveContainer" containerID="a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede" Jun 08 21:12:34.427656 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:12:34.427637 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede\": container with ID starting with a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede not found: ID does not exist" containerID="a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede" Jun 08 21:12:34.427712 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.427665 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede"} err="failed to get container status \"a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede\": rpc error: code = NotFound desc = could not find container \"a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede\": container with ID starting with a22f7004b81bdd99f7d26785abea5092edda9091c682d3cc09d2f9e329c8aede not found: ID does not exist" Jun 08 21:12:34.434737 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.434711 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ff4f4cc9-wsd8k"] Jun 08 21:12:34.441213 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:34.441191 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54ff4f4cc9-wsd8k"] Jun 08 21:12:35.244049 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:35.243997 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:35.344393 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:35.344362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:36.312858 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:36.312817 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" path="/var/lib/kubelet/pods/1941313b-58aa-419f-a8e9-a6c6474cc1a3/volumes" Jun 08 21:12:41.782771 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:41.782734 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:41.885198 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:41.885161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:44.318346 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:44.318301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:44.419692 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:44.419652 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:54.417635 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.417585 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b78f7f595-rsb77" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" containerID="cri-o://033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d" gracePeriod=15 Jun 08 21:12:54.682144 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.682113 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:12:54.840012 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.839974 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-serving-cert\") pod \"4dd74a67-2de9-4523-acbc-d6e55d997605\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " Jun 08 21:12:54.840012 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840032 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-console-config\") pod \"4dd74a67-2de9-4523-acbc-d6e55d997605\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " Jun 08 21:12:54.840308 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840061 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5cw4\" (UniqueName: \"kubernetes.io/projected/4dd74a67-2de9-4523-acbc-d6e55d997605-kube-api-access-t5cw4\") pod \"4dd74a67-2de9-4523-acbc-d6e55d997605\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " Jun 08 21:12:54.840308 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840087 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-oauth-config\") pod \"4dd74a67-2de9-4523-acbc-d6e55d997605\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " Jun 08 21:12:54.840308 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840112 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-service-ca\") pod \"4dd74a67-2de9-4523-acbc-d6e55d997605\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " Jun 08 21:12:54.840308 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840141 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-oauth-serving-cert\") pod \"4dd74a67-2de9-4523-acbc-d6e55d997605\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " Jun 08 21:12:54.840308 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840194 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-trusted-ca-bundle\") pod \"4dd74a67-2de9-4523-acbc-d6e55d997605\" (UID: \"4dd74a67-2de9-4523-acbc-d6e55d997605\") " Jun 08 21:12:54.840659 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840624 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-service-ca" (OuterVolumeSpecName: "service-ca") pod "4dd74a67-2de9-4523-acbc-d6e55d997605" (UID: "4dd74a67-2de9-4523-acbc-d6e55d997605"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:54.840726 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840544 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4dd74a67-2de9-4523-acbc-d6e55d997605" (UID: "4dd74a67-2de9-4523-acbc-d6e55d997605"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:54.840726 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840646 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-console-config" (OuterVolumeSpecName: "console-config") pod "4dd74a67-2de9-4523-acbc-d6e55d997605" (UID: "4dd74a67-2de9-4523-acbc-d6e55d997605"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:54.840817 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.840736 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4dd74a67-2de9-4523-acbc-d6e55d997605" (UID: "4dd74a67-2de9-4523-acbc-d6e55d997605"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:12:54.842430 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.842406 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4dd74a67-2de9-4523-acbc-d6e55d997605" (UID: "4dd74a67-2de9-4523-acbc-d6e55d997605"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:54.842521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.842453 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4dd74a67-2de9-4523-acbc-d6e55d997605" (UID: "4dd74a67-2de9-4523-acbc-d6e55d997605"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:12:54.842521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.842467 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd74a67-2de9-4523-acbc-d6e55d997605-kube-api-access-t5cw4" (OuterVolumeSpecName: "kube-api-access-t5cw4") pod "4dd74a67-2de9-4523-acbc-d6e55d997605" (UID: "4dd74a67-2de9-4523-acbc-d6e55d997605"). InnerVolumeSpecName "kube-api-access-t5cw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:12:54.941679 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.941644 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-oauth-serving-cert\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:54.941679 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.941676 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-trusted-ca-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:54.941868 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.941687 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-serving-cert\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:54.941868 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.941696 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-console-config\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:54.941868 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.941706 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5cw4\" (UniqueName: \"kubernetes.io/projected/4dd74a67-2de9-4523-acbc-d6e55d997605-kube-api-access-t5cw4\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:54.941868 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.941714 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd74a67-2de9-4523-acbc-d6e55d997605-console-oauth-config\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:54.941868 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:54.941722 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd74a67-2de9-4523-acbc-d6e55d997605-service-ca\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:12:55.504698 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.504665 2565 generic.go:356] "Generic (PLEG): container finished" podID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerID="033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d" exitCode=0 Jun 08 21:12:55.505208 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.504707 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78f7f595-rsb77" Jun 08 21:12:55.505208 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.504717 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78f7f595-rsb77" event={"ID":"4dd74a67-2de9-4523-acbc-d6e55d997605","Type":"ContainerDied","Data":"033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d"} Jun 08 21:12:55.505208 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.504763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78f7f595-rsb77" event={"ID":"4dd74a67-2de9-4523-acbc-d6e55d997605","Type":"ContainerDied","Data":"b92b8e7ed7d8da1cc79d298bbddc77900fdcd1bb2aed528b82244269fc53ea77"} Jun 08 21:12:55.505208 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.504784 2565 scope.go:117] "RemoveContainer" containerID="033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d" Jun 08 21:12:55.513781 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.513757 2565 scope.go:117] "RemoveContainer" containerID="033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d" Jun 08 21:12:55.514102 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:12:55.514085 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d\": container with ID starting with 033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d not found: ID does not exist" containerID="033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d" Jun 08 21:12:55.514179 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.514118 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d"} err="failed to get container status \"033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d\": rpc error: code = NotFound desc = could not find container \"033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d\": container with ID starting with 033197d8e78a607354ae53b39188fce04a3dcb18eecf6bc73d148508009d722d not found: ID does not exist" Jun 08 21:12:55.525324 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.525293 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b78f7f595-rsb77"] Jun 08 21:12:55.528604 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:55.528577 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b78f7f595-rsb77"] Jun 08 21:12:56.307976 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:56.307935 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" path="/var/lib/kubelet/pods/4dd74a67-2de9-4523-acbc-d6e55d997605/volumes" Jun 08 21:12:56.795357 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:56.795328 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:12:56.892085 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:12:56.892046 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:13:19.326385 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:13:19.326298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:13:19.385070 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:13:19.385034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:14:33.310288 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.310253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:14:33.410574 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.410538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:14:33.844893 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.844859 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l"] Jun 08 21:14:33.845172 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.845160 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" Jun 08 21:14:33.845172 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.845173 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" Jun 08 21:14:33.845261 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.845181 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" Jun 08 21:14:33.845261 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.845187 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" Jun 08 21:14:33.845261 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.845259 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1941313b-58aa-419f-a8e9-a6c6474cc1a3" containerName="console" Jun 08 21:14:33.845393 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.845269 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dd74a67-2de9-4523-acbc-d6e55d997605" containerName="console" Jun 08 21:14:33.848240 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.848224 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:33.850735 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.850703 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k79cc\"" Jun 08 21:14:33.850735 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.850706 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:14:33.851662 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.851646 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:14:33.856879 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:33.856843 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l"] Jun 08 21:14:34.021931 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.021898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvdz\" (UniqueName: \"kubernetes.io/projected/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-kube-api-access-rlvdz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.022117 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.021960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.022117 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.022045 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.123471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.123390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.123471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.123428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.123471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.123467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvdz\" (UniqueName: \"kubernetes.io/projected/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-kube-api-access-rlvdz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.123775 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.123757 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.123832 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.123813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.131778 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.131753 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvdz\" (UniqueName: \"kubernetes.io/projected/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-kube-api-access-rlvdz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.157555 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.157525 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:34.285210 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.285177 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l"] Jun 08 21:14:34.288310 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:14:34.288284 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed3f6b8_bce3_4dc0_a8df_2edee9d2bc8e.slice/crio-e12334039d251aa8d2382ecf3313c983fec282c6ebc1f27c23883034fe3b9392 WatchSource:0}: Error finding container e12334039d251aa8d2382ecf3313c983fec282c6ebc1f27c23883034fe3b9392: Status 404 returned error can't find the container with id e12334039d251aa8d2382ecf3313c983fec282c6ebc1f27c23883034fe3b9392 Jun 08 21:14:34.290635 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.290621 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:14:34.888701 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:34.888662 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" event={"ID":"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e","Type":"ContainerStarted","Data":"e12334039d251aa8d2382ecf3313c983fec282c6ebc1f27c23883034fe3b9392"} Jun 08 21:14:38.851539 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:38.851502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:14:41.921865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:41.921828 2565 generic.go:356] "Generic (PLEG): container finished" podID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerID="5b48264483fa1bcb07c415bfccf8d429dcf387fcf050a0b6321113de99367451" exitCode=0 Jun 08 21:14:41.922265 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:41.921925 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" event={"ID":"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e","Type":"ContainerDied","Data":"5b48264483fa1bcb07c415bfccf8d429dcf387fcf050a0b6321113de99367451"} Jun 08 21:14:44.936915 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:44.936878 2565 generic.go:356] "Generic (PLEG): container finished" podID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerID="7e42af40cb9645e6f30f26250c03b5aee5a171607a823aab08df768c23a060a2" exitCode=0 Jun 08 21:14:44.937356 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:44.936945 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" event={"ID":"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e","Type":"ContainerDied","Data":"7e42af40cb9645e6f30f26250c03b5aee5a171607a823aab08df768c23a060a2"} Jun 08 21:14:51.978403 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:51.978364 2565 generic.go:356] "Generic (PLEG): container finished" podID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerID="e08ef39b9efab186fe4d875936e23c25eea2e6f8b56492282623e5ad257a85a5" exitCode=0 Jun 08 21:14:51.978810 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:51.978456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" event={"ID":"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e","Type":"ContainerDied","Data":"e08ef39b9efab186fe4d875936e23c25eea2e6f8b56492282623e5ad257a85a5"} Jun 08 21:14:53.114232 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.114199 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:53.183197 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.183157 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-bundle\") pod \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " Jun 08 21:14:53.183404 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.183256 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlvdz\" (UniqueName: \"kubernetes.io/projected/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-kube-api-access-rlvdz\") pod \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " Jun 08 21:14:53.183404 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.183280 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-util\") pod \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\" (UID: \"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e\") " Jun 08 21:14:53.183930 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.183903 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-bundle" (OuterVolumeSpecName: "bundle") pod "6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" (UID: "6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:14:53.185654 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.185618 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-kube-api-access-rlvdz" (OuterVolumeSpecName: "kube-api-access-rlvdz") pod "6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" (UID: "6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e"). InnerVolumeSpecName "kube-api-access-rlvdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:14:53.187349 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.187325 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-util" (OuterVolumeSpecName: "util") pod "6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" (UID: "6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:14:53.284724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.284613 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:14:53.284724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.284664 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlvdz\" (UniqueName: \"kubernetes.io/projected/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-kube-api-access-rlvdz\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:14:53.284724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.284676 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:14:53.988370 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.988334 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" event={"ID":"6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e","Type":"ContainerDied","Data":"e12334039d251aa8d2382ecf3313c983fec282c6ebc1f27c23883034fe3b9392"} Jun 08 21:14:53.988542 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.988386 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e12334039d251aa8d2382ecf3313c983fec282c6ebc1f27c23883034fe3b9392" Jun 08 21:14:53.988542 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:53.988344 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqx55l" Jun 08 21:14:59.671929 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:14:59.671881 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:01.010800 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:01.010760 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:03.235675 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:03.235637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:03.336155 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:03.336114 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:06.933668 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:06.933622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:07.034705 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:07.034668 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:07.351273 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:07.351181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:07.452855 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:07.452822 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:08.624798 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.624751 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:08.652596 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.652560 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx"] Jun 08 21:15:08.652863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.652851 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerName="pull" Jun 08 21:15:08.652908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.652864 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerName="pull" Jun 08 21:15:08.652908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.652873 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerName="extract" Jun 08 21:15:08.652908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.652878 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerName="extract" Jun 08 21:15:08.652908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.652897 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerName="util" Jun 08 21:15:08.652908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.652903 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerName="util" Jun 08 21:15:08.653077 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.652956 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed3f6b8-bce3-4dc0-a8df-2edee9d2bc8e" containerName="extract" Jun 08 21:15:08.658005 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.657983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:08.660588 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.660543 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 21:15:08.661597 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.661579 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 21:15:08.661712 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.661610 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5jxwv\"" Jun 08 21:15:08.667239 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.667213 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx"] Jun 08 21:15:08.718566 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.718522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:08.809728 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.809685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0dcc777-7b40-408f-8f1e-a9509dac24b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rmxsx\" (UID: \"d0dcc777-7b40-408f-8f1e-a9509dac24b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:08.809888 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.809738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bss8\" (UniqueName: \"kubernetes.io/projected/d0dcc777-7b40-408f-8f1e-a9509dac24b3-kube-api-access-8bss8\") pod \"cert-manager-webhook-7dc76cbb94-rmxsx\" (UID: \"d0dcc777-7b40-408f-8f1e-a9509dac24b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:08.836230 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.836190 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8"] Jun 08 21:15:08.838568 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.838549 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:08.841197 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.841173 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k79cc\"" Jun 08 21:15:08.841197 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.841196 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:15:08.841362 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.841217 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:15:08.847725 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.847698 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8"] Jun 08 21:15:08.911097 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.910981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:08.911097 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.911057 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bss8\" (UniqueName: \"kubernetes.io/projected/d0dcc777-7b40-408f-8f1e-a9509dac24b3-kube-api-access-8bss8\") pod \"cert-manager-webhook-7dc76cbb94-rmxsx\" (UID: \"d0dcc777-7b40-408f-8f1e-a9509dac24b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:08.911097 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.911098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzfkb\" (UniqueName: \"kubernetes.io/projected/de4b7748-da58-4120-a292-3fbfb96053a5-kube-api-access-fzfkb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:08.911375 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.911130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:08.911375 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.911184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0dcc777-7b40-408f-8f1e-a9509dac24b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rmxsx\" (UID: \"d0dcc777-7b40-408f-8f1e-a9509dac24b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:08.919524 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.919494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bss8\" (UniqueName: \"kubernetes.io/projected/d0dcc777-7b40-408f-8f1e-a9509dac24b3-kube-api-access-8bss8\") pod \"cert-manager-webhook-7dc76cbb94-rmxsx\" (UID: \"d0dcc777-7b40-408f-8f1e-a9509dac24b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:08.919661 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.919491 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0dcc777-7b40-408f-8f1e-a9509dac24b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rmxsx\" (UID: \"d0dcc777-7b40-408f-8f1e-a9509dac24b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:08.978755 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:08.978719 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:09.012383 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.012344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzfkb\" (UniqueName: \"kubernetes.io/projected/de4b7748-da58-4120-a292-3fbfb96053a5-kube-api-access-fzfkb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:09.012383 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.012398 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:09.012598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.012443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:09.012877 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.012856 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:09.012914 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.012871 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:09.021555 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.021521 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzfkb\" (UniqueName: \"kubernetes.io/projected/de4b7748-da58-4120-a292-3fbfb96053a5-kube-api-access-fzfkb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:09.111182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.111148 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx"] Jun 08 21:15:09.114318 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:15:09.114289 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0dcc777_7b40_408f_8f1e_a9509dac24b3.slice/crio-ffac319c75c5e08abca82182a4852f3c33ed3210987384d0c943b4ff9fe70b44 WatchSource:0}: Error finding container ffac319c75c5e08abca82182a4852f3c33ed3210987384d0c943b4ff9fe70b44: Status 404 returned error can't find the container with id ffac319c75c5e08abca82182a4852f3c33ed3210987384d0c943b4ff9fe70b44 Jun 08 21:15:09.147999 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.147956 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:09.284559 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:09.284515 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8"] Jun 08 21:15:09.286654 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:15:09.286626 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4b7748_da58_4120_a292_3fbfb96053a5.slice/crio-ebc2b4e22b28df0ae0321b3757200311c353f1ac29e7b8fb9e97db2fa816780f WatchSource:0}: Error finding container ebc2b4e22b28df0ae0321b3757200311c353f1ac29e7b8fb9e97db2fa816780f: Status 404 returned error can't find the container with id ebc2b4e22b28df0ae0321b3757200311c353f1ac29e7b8fb9e97db2fa816780f Jun 08 21:15:10.055324 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:10.055286 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" event={"ID":"d0dcc777-7b40-408f-8f1e-a9509dac24b3","Type":"ContainerStarted","Data":"ffac319c75c5e08abca82182a4852f3c33ed3210987384d0c943b4ff9fe70b44"} Jun 08 21:15:10.057177 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:10.057136 2565 generic.go:356] "Generic (PLEG): container finished" podID="de4b7748-da58-4120-a292-3fbfb96053a5" containerID="f64add4ad166ed8b0c60f04d77d1f4809b7027beeba419819ee890cf483dd9b2" exitCode=0 Jun 08 21:15:10.057310 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:10.057209 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" event={"ID":"de4b7748-da58-4120-a292-3fbfb96053a5","Type":"ContainerDied","Data":"f64add4ad166ed8b0c60f04d77d1f4809b7027beeba419819ee890cf483dd9b2"} Jun 08 21:15:10.057310 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:10.057251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" event={"ID":"de4b7748-da58-4120-a292-3fbfb96053a5","Type":"ContainerStarted","Data":"ebc2b4e22b28df0ae0321b3757200311c353f1ac29e7b8fb9e97db2fa816780f"} Jun 08 21:15:10.423625 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:10.423528 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:10.803203 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:10.803164 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:13.076271 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:13.076238 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" event={"ID":"d0dcc777-7b40-408f-8f1e-a9509dac24b3","Type":"ContainerStarted","Data":"577afb99883cc74378c6092237a985ead4e588f705d82baf1858358a2b7b2ef9"} Jun 08 21:15:13.076706 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:13.076298 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:13.078096 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:13.078071 2565 generic.go:356] "Generic (PLEG): container finished" podID="de4b7748-da58-4120-a292-3fbfb96053a5" containerID="dde71ff17ff693e1617687803978d75ef384e6dabdfd62b55c0043444029f783" exitCode=0 Jun 08 21:15:13.078228 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:13.078127 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" event={"ID":"de4b7748-da58-4120-a292-3fbfb96053a5","Type":"ContainerDied","Data":"dde71ff17ff693e1617687803978d75ef384e6dabdfd62b55c0043444029f783"} Jun 08 21:15:13.092840 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:13.092781 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" podStartSLOduration=1.5993607010000002 podStartE2EDuration="5.092760511s" totalImagesPullingTime="3.49339981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:15:13.092450793 +0000 UTC m=+467.260464588" watchObservedRunningTime="2026-06-08 21:15:13.092760511 +0000 UTC m=+467.260774304" Jun 08 21:15:14.084454 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:14.084424 2565 generic.go:356] "Generic (PLEG): container finished" podID="de4b7748-da58-4120-a292-3fbfb96053a5" containerID="7f17758cabef93e7597de8b5195bb1fffdb58ef91c21858883f39e5900464d0f" exitCode=0 Jun 08 21:15:14.084830 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:14.084508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" event={"ID":"de4b7748-da58-4120-a292-3fbfb96053a5","Type":"ContainerDied","Data":"7f17758cabef93e7597de8b5195bb1fffdb58ef91c21858883f39e5900464d0f"} Jun 08 21:15:15.225089 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.225062 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:15.367072 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.366947 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzfkb\" (UniqueName: \"kubernetes.io/projected/de4b7748-da58-4120-a292-3fbfb96053a5-kube-api-access-fzfkb\") pod \"de4b7748-da58-4120-a292-3fbfb96053a5\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " Jun 08 21:15:15.367072 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.367003 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-bundle\") pod \"de4b7748-da58-4120-a292-3fbfb96053a5\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " Jun 08 21:15:15.367304 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.367088 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-util\") pod \"de4b7748-da58-4120-a292-3fbfb96053a5\" (UID: \"de4b7748-da58-4120-a292-3fbfb96053a5\") " Jun 08 21:15:15.367395 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.367370 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-bundle" (OuterVolumeSpecName: "bundle") pod "de4b7748-da58-4120-a292-3fbfb96053a5" (UID: "de4b7748-da58-4120-a292-3fbfb96053a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:15:15.369205 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.369180 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de4b7748-da58-4120-a292-3fbfb96053a5-kube-api-access-fzfkb" (OuterVolumeSpecName: "kube-api-access-fzfkb") pod "de4b7748-da58-4120-a292-3fbfb96053a5" (UID: "de4b7748-da58-4120-a292-3fbfb96053a5"). InnerVolumeSpecName "kube-api-access-fzfkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:15:15.371437 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.371411 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-util" (OuterVolumeSpecName: "util") pod "de4b7748-da58-4120-a292-3fbfb96053a5" (UID: "de4b7748-da58-4120-a292-3fbfb96053a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:15:15.468252 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.468044 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:15:15.468252 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.468090 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4b7748-da58-4120-a292-3fbfb96053a5-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:15:15.468252 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:15.468105 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzfkb\" (UniqueName: \"kubernetes.io/projected/de4b7748-da58-4120-a292-3fbfb96053a5-kube-api-access-fzfkb\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:15:16.095250 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:16.095217 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" event={"ID":"de4b7748-da58-4120-a292-3fbfb96053a5","Type":"ContainerDied","Data":"ebc2b4e22b28df0ae0321b3757200311c353f1ac29e7b8fb9e97db2fa816780f"} Jun 08 21:15:16.095250 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:16.095240 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9gjk8" Jun 08 21:15:16.095458 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:16.095263 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebc2b4e22b28df0ae0321b3757200311c353f1ac29e7b8fb9e97db2fa816780f" Jun 08 21:15:16.285086 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:16.285050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:16.387308 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:16.387216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:17.808410 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:17.808377 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:19.086598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:19.086572 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rmxsx" Jun 08 21:15:20.108663 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.108625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:20.146801 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.146769 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2lzjt"] Jun 08 21:15:20.147137 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.147119 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4b7748-da58-4120-a292-3fbfb96053a5" containerName="util" Jun 08 21:15:20.147209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.147141 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4b7748-da58-4120-a292-3fbfb96053a5" containerName="util" Jun 08 21:15:20.147209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.147158 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4b7748-da58-4120-a292-3fbfb96053a5" containerName="extract" Jun 08 21:15:20.147209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.147164 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4b7748-da58-4120-a292-3fbfb96053a5" containerName="extract" Jun 08 21:15:20.147209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.147172 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4b7748-da58-4120-a292-3fbfb96053a5" containerName="pull" Jun 08 21:15:20.147209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.147177 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4b7748-da58-4120-a292-3fbfb96053a5" containerName="pull" Jun 08 21:15:20.147355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.147249 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4b7748-da58-4120-a292-3fbfb96053a5" containerName="extract" Jun 08 21:15:20.150374 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.150357 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2lzjt" Jun 08 21:15:20.152575 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.152556 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ztsmw\"" Jun 08 21:15:20.159286 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.159262 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2lzjt"] Jun 08 21:15:20.175713 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.175680 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:20.310517 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.310486 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b642e23f-5dbf-4803-92fb-511899c71ceb-bound-sa-token\") pod \"cert-manager-59c77684cc-2lzjt\" (UID: \"b642e23f-5dbf-4803-92fb-511899c71ceb\") " pod="cert-manager/cert-manager-59c77684cc-2lzjt" Jun 08 21:15:20.310682 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.310526 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r7kq\" (UniqueName: \"kubernetes.io/projected/b642e23f-5dbf-4803-92fb-511899c71ceb-kube-api-access-2r7kq\") pod \"cert-manager-59c77684cc-2lzjt\" (UID: \"b642e23f-5dbf-4803-92fb-511899c71ceb\") " pod="cert-manager/cert-manager-59c77684cc-2lzjt" Jun 08 21:15:20.411856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.411767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b642e23f-5dbf-4803-92fb-511899c71ceb-bound-sa-token\") pod \"cert-manager-59c77684cc-2lzjt\" (UID: \"b642e23f-5dbf-4803-92fb-511899c71ceb\") " pod="cert-manager/cert-manager-59c77684cc-2lzjt" Jun 08 21:15:20.411856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.411813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7kq\" (UniqueName: \"kubernetes.io/projected/b642e23f-5dbf-4803-92fb-511899c71ceb-kube-api-access-2r7kq\") pod \"cert-manager-59c77684cc-2lzjt\" (UID: \"b642e23f-5dbf-4803-92fb-511899c71ceb\") " pod="cert-manager/cert-manager-59c77684cc-2lzjt" Jun 08 21:15:20.420132 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.420098 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b642e23f-5dbf-4803-92fb-511899c71ceb-bound-sa-token\") pod \"cert-manager-59c77684cc-2lzjt\" (UID: \"b642e23f-5dbf-4803-92fb-511899c71ceb\") " pod="cert-manager/cert-manager-59c77684cc-2lzjt" Jun 08 21:15:20.420253 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.420213 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r7kq\" (UniqueName: \"kubernetes.io/projected/b642e23f-5dbf-4803-92fb-511899c71ceb-kube-api-access-2r7kq\") pod \"cert-manager-59c77684cc-2lzjt\" (UID: \"b642e23f-5dbf-4803-92fb-511899c71ceb\") " pod="cert-manager/cert-manager-59c77684cc-2lzjt" Jun 08 21:15:20.460106 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.460068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2lzjt" Jun 08 21:15:20.594668 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:20.594618 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2lzjt"] Jun 08 21:15:20.596824 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:15:20.596790 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb642e23f_5dbf_4803_92fb_511899c71ceb.slice/crio-8fd5e6ec512989ff99ccf849b091f7216cee8683e0fd64d5bca8d3ce71cf772a WatchSource:0}: Error finding container 8fd5e6ec512989ff99ccf849b091f7216cee8683e0fd64d5bca8d3ce71cf772a: Status 404 returned error can't find the container with id 8fd5e6ec512989ff99ccf849b091f7216cee8683e0fd64d5bca8d3ce71cf772a Jun 08 21:15:21.121434 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:21.121403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2lzjt" event={"ID":"b642e23f-5dbf-4803-92fb-511899c71ceb","Type":"ContainerStarted","Data":"968b331e0e09954d3d2c369460a5983f3ebf76eb494c641155ffaa72c81813c1"} Jun 08 21:15:21.121434 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:21.121440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2lzjt" event={"ID":"b642e23f-5dbf-4803-92fb-511899c71ceb","Type":"ContainerStarted","Data":"8fd5e6ec512989ff99ccf849b091f7216cee8683e0fd64d5bca8d3ce71cf772a"} Jun 08 21:15:21.135916 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:21.135865 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2lzjt" podStartSLOduration=1.135849666 podStartE2EDuration="1.135849666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:15:21.135481117 +0000 UTC m=+475.303494906" watchObservedRunningTime="2026-06-08 21:15:21.135849666 +0000 UTC m=+475.303863457" Jun 08 21:15:25.704356 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:25.704323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:25.804426 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:25.804384 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:27.721587 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.721554 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87"] Jun 08 21:15:27.724166 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.724142 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.726576 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.726553 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:15:27.727534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.727516 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:15:27.727617 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.727533 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k79cc\"" Jun 08 21:15:27.732997 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.732963 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87"] Jun 08 21:15:27.773766 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.773729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.773766 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.773769 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.773988 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.773839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsr5x\" (UniqueName: \"kubernetes.io/projected/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-kube-api-access-jsr5x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.874450 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.874413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsr5x\" (UniqueName: \"kubernetes.io/projected/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-kube-api-access-jsr5x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.874594 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.874475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.874594 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.874495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.874879 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.874864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.874912 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.874861 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.882764 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.882730 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsr5x\" (UniqueName: \"kubernetes.io/projected/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-kube-api-access-jsr5x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:27.953339 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:27.953311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:28.034407 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:28.034314 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:28.170837 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:28.170813 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87"] Jun 08 21:15:28.173437 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:15:28.173405 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2d2ef9_9dd7_4a49_b437_4fbc8448bdce.slice/crio-0931088e97c51cdbb3f599b0d1f724906a9046a05b270653d0574148f0a73036 WatchSource:0}: Error finding container 0931088e97c51cdbb3f599b0d1f724906a9046a05b270653d0574148f0a73036: Status 404 returned error can't find the container with id 0931088e97c51cdbb3f599b0d1f724906a9046a05b270653d0574148f0a73036 Jun 08 21:15:29.158343 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:29.158252 2565 generic.go:356] "Generic (PLEG): container finished" podID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerID="f37c8d5b145b73c68d4057332290b0064677f683361a822981de877f4033e53a" exitCode=0 Jun 08 21:15:29.158343 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:29.158292 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" event={"ID":"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce","Type":"ContainerDied","Data":"f37c8d5b145b73c68d4057332290b0064677f683361a822981de877f4033e53a"} Jun 08 21:15:29.158835 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:29.158347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" event={"ID":"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce","Type":"ContainerStarted","Data":"0931088e97c51cdbb3f599b0d1f724906a9046a05b270653d0574148f0a73036"} Jun 08 21:15:30.164611 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:30.164511 2565 generic.go:356] "Generic (PLEG): container finished" podID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerID="431c144ea5fd60efbb2cc98c28a975404696a64b1091c153b51f0527c164cbb0" exitCode=0 Jun 08 21:15:30.164969 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:30.164602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" event={"ID":"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce","Type":"ContainerDied","Data":"431c144ea5fd60efbb2cc98c28a975404696a64b1091c153b51f0527c164cbb0"} Jun 08 21:15:31.172299 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:31.172256 2565 generic.go:356] "Generic (PLEG): container finished" podID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerID="f0d206380f77eb17deef442244f43e73c521a12f748347bb22503b95503e917a" exitCode=0 Jun 08 21:15:31.172677 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:31.172347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" event={"ID":"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce","Type":"ContainerDied","Data":"f0d206380f77eb17deef442244f43e73c521a12f748347bb22503b95503e917a"} Jun 08 21:15:32.308728 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.308700 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:32.409463 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.409423 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-bundle\") pod \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " Jun 08 21:15:32.409463 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.409463 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-util\") pod \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " Jun 08 21:15:32.409731 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.409501 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsr5x\" (UniqueName: \"kubernetes.io/projected/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-kube-api-access-jsr5x\") pod \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\" (UID: \"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce\") " Jun 08 21:15:32.410238 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.410211 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-bundle" (OuterVolumeSpecName: "bundle") pod "9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" (UID: "9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:15:32.411769 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.411743 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-kube-api-access-jsr5x" (OuterVolumeSpecName: "kube-api-access-jsr5x") pod "9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" (UID: "9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce"). InnerVolumeSpecName "kube-api-access-jsr5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:15:32.415060 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.414998 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-util" (OuterVolumeSpecName: "util") pod "9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" (UID: "9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:15:32.510908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.510864 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsr5x\" (UniqueName: \"kubernetes.io/projected/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-kube-api-access-jsr5x\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:15:32.510908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.510901 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:15:32.510908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:32.510912 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:15:33.183348 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:33.183318 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" Jun 08 21:15:33.183523 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:33.183347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtlz87" event={"ID":"9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce","Type":"ContainerDied","Data":"0931088e97c51cdbb3f599b0d1f724906a9046a05b270653d0574148f0a73036"} Jun 08 21:15:33.183523 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:33.183396 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0931088e97c51cdbb3f599b0d1f724906a9046a05b270653d0574148f0a73036" Jun 08 21:15:34.370328 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:34.370293 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:34.471165 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:34.471126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:40.172658 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.172622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:40.235235 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.235204 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz"] Jun 08 21:15:40.235534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.235522 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerName="pull" Jun 08 21:15:40.235583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.235536 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerName="pull" Jun 08 21:15:40.235583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.235546 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerName="util" Jun 08 21:15:40.235583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.235551 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerName="util" Jun 08 21:15:40.235583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.235563 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerName="extract" Jun 08 21:15:40.235583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.235568 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerName="extract" Jun 08 21:15:40.235751 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.235622 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2d2ef9-9dd7-4a49-b437-4fbc8448bdce" containerName="extract" Jun 08 21:15:40.237593 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.237579 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.241794 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.241765 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 21:15:40.241951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.241814 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 21:15:40.241951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.241836 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:15:40.241951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.241856 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 21:15:40.241951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.241856 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h79ql\"" Jun 08 21:15:40.241951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.241896 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 21:15:40.250675 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.250650 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz"] Jun 08 21:15:40.253840 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.253812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:40.278781 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.278743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9131756-c2fd-43df-a4d6-5eea31159c79-cert\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.278945 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.278795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9131756-c2fd-43df-a4d6-5eea31159c79-manager-config\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.278945 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.278891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dktk4\" (UniqueName: \"kubernetes.io/projected/e9131756-c2fd-43df-a4d6-5eea31159c79-kube-api-access-dktk4\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.278945 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.278925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9131756-c2fd-43df-a4d6-5eea31159c79-metrics-cert\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.380191 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.380158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktk4\" (UniqueName: \"kubernetes.io/projected/e9131756-c2fd-43df-a4d6-5eea31159c79-kube-api-access-dktk4\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.380191 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.380199 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9131756-c2fd-43df-a4d6-5eea31159c79-metrics-cert\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.380449 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.380246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9131756-c2fd-43df-a4d6-5eea31159c79-cert\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.380449 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.380270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9131756-c2fd-43df-a4d6-5eea31159c79-manager-config\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.381000 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.380972 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9131756-c2fd-43df-a4d6-5eea31159c79-manager-config\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.382936 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.382908 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9131756-c2fd-43df-a4d6-5eea31159c79-metrics-cert\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.383055 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.382979 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9131756-c2fd-43df-a4d6-5eea31159c79-cert\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.397926 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.397899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dktk4\" (UniqueName: \"kubernetes.io/projected/e9131756-c2fd-43df-a4d6-5eea31159c79-kube-api-access-dktk4\") pod \"lws-controller-manager-6d787bb96d-zj2nz\" (UID: \"e9131756-c2fd-43df-a4d6-5eea31159c79\") " pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.547007 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.546976 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:40.690384 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:40.690349 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz"] Jun 08 21:15:40.693352 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:15:40.693326 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9131756_c2fd_43df_a4d6_5eea31159c79.slice/crio-120e005fc7d8c14eddbde07a2d4cfe48165a3b0e11a64c8ffebb562a28874f5f WatchSource:0}: Error finding container 120e005fc7d8c14eddbde07a2d4cfe48165a3b0e11a64c8ffebb562a28874f5f: Status 404 returned error can't find the container with id 120e005fc7d8c14eddbde07a2d4cfe48165a3b0e11a64c8ffebb562a28874f5f Jun 08 21:15:41.219787 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:41.219754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" event={"ID":"e9131756-c2fd-43df-a4d6-5eea31159c79","Type":"ContainerStarted","Data":"120e005fc7d8c14eddbde07a2d4cfe48165a3b0e11a64c8ffebb562a28874f5f"} Jun 08 21:15:42.664218 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:42.664133 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:42.770708 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:42.770661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:43.231693 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.231659 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" event={"ID":"e9131756-c2fd-43df-a4d6-5eea31159c79","Type":"ContainerStarted","Data":"85efc5518b77647bdfadee758408b0bc2874aea0f2695440c30a44e5dca1c50f"} Jun 08 21:15:43.231869 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.231775 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:15:43.255931 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.255871 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" podStartSLOduration=1.671316333 podStartE2EDuration="3.255853117s" totalImagesPullingTime="1.584536784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:15:43.253740375 +0000 UTC m=+497.421754170" watchObservedRunningTime="2026-06-08 21:15:43.255853117 +0000 UTC m=+497.423866908" Jun 08 21:15:43.296125 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.296092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:43.499900 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.499791 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:43.603561 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.603526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:43.646100 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.646066 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp"] Jun 08 21:15:43.654064 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.654033 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.656958 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.656935 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 21:15:43.657274 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.657259 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 21:15:43.657839 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.657817 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 21:15:43.657932 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.657899 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-c2vnm\"" Jun 08 21:15:43.658009 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.657996 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 21:15:43.664454 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.664432 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp"] Jun 08 21:15:43.710371 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.710332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e093d31-99c6-4867-900c-584663afe490-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.710371 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.710370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e093d31-99c6-4867-900c-584663afe490-manifests\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.710598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.710393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sjkp\" (UniqueName: \"kubernetes.io/projected/0e093d31-99c6-4867-900c-584663afe490-kube-api-access-7sjkp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.710598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.710450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e093d31-99c6-4867-900c-584663afe490-tmp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.710598 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.710514 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e093d31-99c6-4867-900c-584663afe490-webhook-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.750989 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.750896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:43.811587 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.811555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e093d31-99c6-4867-900c-584663afe490-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.811587 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.811587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e093d31-99c6-4867-900c-584663afe490-manifests\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.811788 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.811607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sjkp\" (UniqueName: \"kubernetes.io/projected/0e093d31-99c6-4867-900c-584663afe490-kube-api-access-7sjkp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.811788 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.811743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e093d31-99c6-4867-900c-584663afe490-tmp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.811788 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.811782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e093d31-99c6-4867-900c-584663afe490-webhook-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.812042 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.811996 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e093d31-99c6-4867-900c-584663afe490-manifests\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.814147 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.814125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e093d31-99c6-4867-900c-584663afe490-tmp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.814343 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.814327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e093d31-99c6-4867-900c-584663afe490-webhook-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.814387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.814361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e093d31-99c6-4867-900c-584663afe490-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.821601 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.821579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sjkp\" (UniqueName: \"kubernetes.io/projected/0e093d31-99c6-4867-900c-584663afe490-kube-api-access-7sjkp\") pod \"opendatahub-operator-controller-manager-598c8c4df5-c55jp\" (UID: \"0e093d31-99c6-4867-900c-584663afe490\") " pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:43.864254 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.864221 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:43.961169 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.961136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:43.964979 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:43.964960 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:44.057345 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:44.057298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:44.131292 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:44.131269 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp"] Jun 08 21:15:44.132900 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:44.132873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:44.133744 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:15:44.133717 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e093d31_99c6_4867_900c_584663afe490.slice/crio-467d09a055834ce0acdafb13b8d8d82d85c7c3936ee9fa97b365d1bc319fcd83 WatchSource:0}: Error finding container 467d09a055834ce0acdafb13b8d8d82d85c7c3936ee9fa97b365d1bc319fcd83: Status 404 returned error can't find the container with id 467d09a055834ce0acdafb13b8d8d82d85c7c3936ee9fa97b365d1bc319fcd83 Jun 08 21:15:44.238010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:44.237973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" event={"ID":"0e093d31-99c6-4867-900c-584663afe490","Type":"ContainerStarted","Data":"467d09a055834ce0acdafb13b8d8d82d85c7c3936ee9fa97b365d1bc319fcd83"} Jun 08 21:15:47.254330 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:47.254294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" event={"ID":"0e093d31-99c6-4867-900c-584663afe490","Type":"ContainerStarted","Data":"8812d3f9bf5258a3a15caa612202f7e7bf28c8d24c38af7293b1608a5a574c6a"} Jun 08 21:15:48.260946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:48.260912 2565 generic.go:356] "Generic (PLEG): container finished" podID="0e093d31-99c6-4867-900c-584663afe490" containerID="8812d3f9bf5258a3a15caa612202f7e7bf28c8d24c38af7293b1608a5a574c6a" exitCode=0 Jun 08 21:15:48.261357 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:48.261000 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" event={"ID":"0e093d31-99c6-4867-900c-584663afe490","Type":"ContainerDied","Data":"8812d3f9bf5258a3a15caa612202f7e7bf28c8d24c38af7293b1608a5a574c6a"} Jun 08 21:15:49.267544 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:49.267511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" event={"ID":"0e093d31-99c6-4867-900c-584663afe490","Type":"ContainerStarted","Data":"2c6d27f9e3c9ab038689a23e0bc3531a06efd7cf3ea561a1e9ba9b81f9aca411"} Jun 08 21:15:49.267974 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:49.267645 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:15:49.290860 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:49.290808 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" podStartSLOduration=2.248184581 podStartE2EDuration="6.290790963s" totalImagesPullingTime="3.125227139s" totalInitContainerRuntime="917.379243ms" isStatefulPod=false podCreationTimestamp="2026-06-08 21:15:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:15:49.28979018 +0000 UTC m=+503.457803972" watchObservedRunningTime="2026-06-08 21:15:49.290790963 +0000 UTC m=+503.458804755" Jun 08 21:15:53.300327 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:53.300286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:53.348878 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:53.348840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:15:54.240514 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:15:54.240481 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d787bb96d-zj2nz" Jun 08 21:16:00.274724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:00.274683 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-598c8c4df5-c55jp" Jun 08 21:16:01.885220 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:01.885187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:02.010568 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:02.010540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:04.474356 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:04.474317 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:05.003486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.003459 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:05.104351 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.104313 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:05.177782 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.177750 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:05.178762 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.178742 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp"] Jun 08 21:16:05.184526 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.184505 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.186985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.186964 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:16:05.187111 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.186998 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:16:05.188037 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.187994 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k79cc\"" Jun 08 21:16:05.191482 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.191457 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp"] Jun 08 21:16:05.295456 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.295355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.295456 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.295403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.295657 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.295499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbm7r\" (UniqueName: \"kubernetes.io/projected/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-kube-api-access-qbm7r\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.396187 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.396152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.396375 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.396194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.396375 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.396241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbm7r\" (UniqueName: \"kubernetes.io/projected/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-kube-api-access-qbm7r\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.396632 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.396605 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.396756 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.396610 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.417844 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.417813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbm7r\" (UniqueName: \"kubernetes.io/projected/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-kube-api-access-qbm7r\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.426475 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.426434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:05.495554 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.495519 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:05.524080 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.524044 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:05.624812 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.624773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:05.639829 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.639796 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp"] Jun 08 21:16:05.643187 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:16:05.643159 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716d0985_5c1a_4673_8bcb_5e9fe8d382dc.slice/crio-1344e04838600346842f16bebe1d20f95685c07f44986042e7067dbd96ee8041 WatchSource:0}: Error finding container 1344e04838600346842f16bebe1d20f95685c07f44986042e7067dbd96ee8041: Status 404 returned error can't find the container with id 1344e04838600346842f16bebe1d20f95685c07f44986042e7067dbd96ee8041 Jun 08 21:16:05.723812 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.723774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:05.906968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:05.906886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:06.356528 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:06.356491 2565 generic.go:356] "Generic (PLEG): container finished" podID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerID="2ad24ef256f83c0dc145cb97a3e3ebf31d75b57dda07a5d406f84717bf09f9a9" exitCode=0 Jun 08 21:16:06.356713 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:06.356568 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" event={"ID":"716d0985-5c1a-4673-8bcb-5e9fe8d382dc","Type":"ContainerDied","Data":"2ad24ef256f83c0dc145cb97a3e3ebf31d75b57dda07a5d406f84717bf09f9a9"} Jun 08 21:16:06.356713 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:06.356614 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" event={"ID":"716d0985-5c1a-4673-8bcb-5e9fe8d382dc","Type":"ContainerStarted","Data":"1344e04838600346842f16bebe1d20f95685c07f44986042e7067dbd96ee8041"} Jun 08 21:16:06.502399 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:06.502360 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:07.363114 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:07.363081 2565 generic.go:356] "Generic (PLEG): container finished" podID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerID="75ecb75e9bda633ec25da94924d274c30a28902754c84f038e4af5679916ba58" exitCode=0 Jun 08 21:16:07.363114 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:07.363118 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" event={"ID":"716d0985-5c1a-4673-8bcb-5e9fe8d382dc","Type":"ContainerDied","Data":"75ecb75e9bda633ec25da94924d274c30a28902754c84f038e4af5679916ba58"} Jun 08 21:16:08.369414 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:08.369380 2565 generic.go:356] "Generic (PLEG): container finished" podID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerID="b0239914fdb596804a07eac4eca699c682f51f9d667b83fb5ddc61f0b98375ac" exitCode=0 Jun 08 21:16:08.369799 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:08.369462 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" event={"ID":"716d0985-5c1a-4673-8bcb-5e9fe8d382dc","Type":"ContainerDied","Data":"b0239914fdb596804a07eac4eca699c682f51f9d667b83fb5ddc61f0b98375ac"} Jun 08 21:16:09.499260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.499236 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:09.632411 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.632318 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-bundle\") pod \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " Jun 08 21:16:09.632411 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.632407 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbm7r\" (UniqueName: \"kubernetes.io/projected/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-kube-api-access-qbm7r\") pod \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " Jun 08 21:16:09.632632 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.632449 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-util\") pod \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\" (UID: \"716d0985-5c1a-4673-8bcb-5e9fe8d382dc\") " Jun 08 21:16:09.633254 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.633220 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-bundle" (OuterVolumeSpecName: "bundle") pod "716d0985-5c1a-4673-8bcb-5e9fe8d382dc" (UID: "716d0985-5c1a-4673-8bcb-5e9fe8d382dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:16:09.634730 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.634707 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-kube-api-access-qbm7r" (OuterVolumeSpecName: "kube-api-access-qbm7r") pod "716d0985-5c1a-4673-8bcb-5e9fe8d382dc" (UID: "716d0985-5c1a-4673-8bcb-5e9fe8d382dc"). InnerVolumeSpecName "kube-api-access-qbm7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:16:09.637635 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.637603 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-util" (OuterVolumeSpecName: "util") pod "716d0985-5c1a-4673-8bcb-5e9fe8d382dc" (UID: "716d0985-5c1a-4673-8bcb-5e9fe8d382dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:16:09.733802 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.733764 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:09.733802 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.733797 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbm7r\" (UniqueName: \"kubernetes.io/projected/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-kube-api-access-qbm7r\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:09.733802 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:09.733808 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716d0985-5c1a-4673-8bcb-5e9fe8d382dc-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:10.381117 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:10.381087 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" Jun 08 21:16:10.381277 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:10.381087 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bz6qp" event={"ID":"716d0985-5c1a-4673-8bcb-5e9fe8d382dc","Type":"ContainerDied","Data":"1344e04838600346842f16bebe1d20f95685c07f44986042e7067dbd96ee8041"} Jun 08 21:16:10.381277 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:10.381214 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1344e04838600346842f16bebe1d20f95685c07f44986042e7067dbd96ee8041" Jun 08 21:16:14.438115 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.438079 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5479557688-295cq"] Jun 08 21:16:14.438459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.438405 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerName="pull" Jun 08 21:16:14.438459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.438417 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerName="pull" Jun 08 21:16:14.438459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.438430 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerName="extract" Jun 08 21:16:14.438459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.438436 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerName="extract" Jun 08 21:16:14.438459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.438453 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerName="util" Jun 08 21:16:14.438459 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.438459 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerName="util" Jun 08 21:16:14.438672 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.438509 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="716d0985-5c1a-4673-8bcb-5e9fe8d382dc" containerName="extract" Jun 08 21:16:14.440740 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.440719 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.461326 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.461296 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5479557688-295cq"] Jun 08 21:16:14.555276 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.555245 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:14.579466 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.579427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-oauth-config\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.579466 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.579471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-service-ca\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.579684 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.579495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-trusted-ca-bundle\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.579684 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.579597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpttd\" (UniqueName: \"kubernetes.io/projected/e01c725c-94ba-43d2-8ffd-b9148ae749ee-kube-api-access-lpttd\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.579684 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.579630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-oauth-serving-cert\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.579684 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.579677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-serving-cert\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.579821 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.579701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-config\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.657265 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.657225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:14.680390 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.680351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpttd\" (UniqueName: \"kubernetes.io/projected/e01c725c-94ba-43d2-8ffd-b9148ae749ee-kube-api-access-lpttd\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.680390 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.680390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-oauth-serving-cert\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.680582 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.680505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-serving-cert\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.680693 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.680671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-config\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.680738 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.680716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-oauth-config\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.680772 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.680749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-service-ca\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.680819 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.680773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-trusted-ca-bundle\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.681320 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.681294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-oauth-serving-cert\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.681455 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.681296 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-config\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.681583 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.681564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-trusted-ca-bundle\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.681670 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.681638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e01c725c-94ba-43d2-8ffd-b9148ae749ee-service-ca\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.683059 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.683042 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-serving-cert\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.683151 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.683132 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e01c725c-94ba-43d2-8ffd-b9148ae749ee-console-oauth-config\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.689386 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.689326 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpttd\" (UniqueName: \"kubernetes.io/projected/e01c725c-94ba-43d2-8ffd-b9148ae749ee-kube-api-access-lpttd\") pod \"console-5479557688-295cq\" (UID: \"e01c725c-94ba-43d2-8ffd-b9148ae749ee\") " pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.749954 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.749912 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:14.762301 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.762271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:14.908149 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:14.908125 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5479557688-295cq"] Jun 08 21:16:14.909867 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:16:14.909838 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01c725c_94ba_43d2_8ffd_b9148ae749ee.slice/crio-74fbec760484f5970e8f1df611302f0efab8efacd7cd1f86407928fe92030283 WatchSource:0}: Error finding container 74fbec760484f5970e8f1df611302f0efab8efacd7cd1f86407928fe92030283: Status 404 returned error can't find the container with id 74fbec760484f5970e8f1df611302f0efab8efacd7cd1f86407928fe92030283 Jun 08 21:16:15.302460 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.302380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:15.416254 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.416218 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5479557688-295cq" event={"ID":"e01c725c-94ba-43d2-8ffd-b9148ae749ee","Type":"ContainerStarted","Data":"098010995b8d6df967fba98de835897149ff27e776e48ae8ff5b12cba2c17afb"} Jun 08 21:16:15.416456 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.416279 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5479557688-295cq" event={"ID":"e01c725c-94ba-43d2-8ffd-b9148ae749ee","Type":"ContainerStarted","Data":"74fbec760484f5970e8f1df611302f0efab8efacd7cd1f86407928fe92030283"} Jun 08 21:16:15.427548 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.427512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:15.457040 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.456968 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5479557688-295cq" podStartSLOduration=1.456946985 podStartE2EDuration="1.456946985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:15.455317165 +0000 UTC m=+529.623330956" watchObservedRunningTime="2026-06-08 21:16:15.456946985 +0000 UTC m=+529.624960778" Jun 08 21:16:15.654106 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.653997 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:15.773260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.773172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:15.887546 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.887516 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:15.996075 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:15.996006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:16.085655 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:16.085609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:16.256891 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:16.256802 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:18.023329 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:18.023294 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:18.119543 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:18.119498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:19.607813 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.607774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:19.639443 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.639412 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85"] Jun 08 21:16:19.646315 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.646291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.654381 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.654359 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:16:19.654498 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.654437 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:16:19.656107 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.656090 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k79cc\"" Jun 08 21:16:19.669934 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.669907 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85"] Jun 08 21:16:19.724749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.724714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:19.727755 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.727731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4w7\" (UniqueName: \"kubernetes.io/projected/29bdef05-5fc5-4032-991b-ce4066a43558-kube-api-access-7q4w7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.727881 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.727817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.727942 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.727891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.828695 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.828654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.828881 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.828720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.828881 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.828751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4w7\" (UniqueName: \"kubernetes.io/projected/29bdef05-5fc5-4032-991b-ce4066a43558-kube-api-access-7q4w7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.829067 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.829044 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.829141 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.829076 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.845088 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.845050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4w7\" (UniqueName: \"kubernetes.io/projected/29bdef05-5fc5-4032-991b-ce4066a43558-kube-api-access-7q4w7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:19.899637 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.899543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:19.955606 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:19.955574 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:20.054588 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:20.054553 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:20.098833 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:20.098798 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85"] Jun 08 21:16:20.101750 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:16:20.101725 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bdef05_5fc5_4032_991b_ce4066a43558.slice/crio-ecf24faea77dd39a82c855267b4714083f4bfb1c157999f5e09c66b287564703 WatchSource:0}: Error finding container ecf24faea77dd39a82c855267b4714083f4bfb1c157999f5e09c66b287564703: Status 404 returned error can't find the container with id ecf24faea77dd39a82c855267b4714083f4bfb1c157999f5e09c66b287564703 Jun 08 21:16:20.444192 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:20.444154 2565 generic.go:356] "Generic (PLEG): container finished" podID="29bdef05-5fc5-4032-991b-ce4066a43558" containerID="a904bba006a25a84cecf5197ab19c8cf4fb7c82a1818e2f6099c27c5d2bd8e01" exitCode=0 Jun 08 21:16:20.444360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:20.444244 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" event={"ID":"29bdef05-5fc5-4032-991b-ce4066a43558","Type":"ContainerDied","Data":"a904bba006a25a84cecf5197ab19c8cf4fb7c82a1818e2f6099c27c5d2bd8e01"} Jun 08 21:16:20.444360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:20.444297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" event={"ID":"29bdef05-5fc5-4032-991b-ce4066a43558","Type":"ContainerStarted","Data":"ecf24faea77dd39a82c855267b4714083f4bfb1c157999f5e09c66b287564703"} Jun 08 21:16:20.676567 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:20.676536 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:21.450773 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.450742 2565 generic.go:356] "Generic (PLEG): container finished" podID="29bdef05-5fc5-4032-991b-ce4066a43558" containerID="8ad2f29090e529def0938705a870faaf04a34bd793f9c82143a8b787be33bf1e" exitCode=0 Jun 08 21:16:21.450929 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.450797 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" event={"ID":"29bdef05-5fc5-4032-991b-ce4066a43558","Type":"ContainerDied","Data":"8ad2f29090e529def0938705a870faaf04a34bd793f9c82143a8b787be33bf1e"} Jun 08 21:16:21.759834 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.759795 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5878f5f596-kpmms"] Jun 08 21:16:21.763230 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.763209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" Jun 08 21:16:21.767355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.767335 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-c5ghc\"" Jun 08 21:16:21.767478 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.767335 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 21:16:21.770376 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.770355 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5878f5f596-kpmms"] Jun 08 21:16:21.779242 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.779220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:21.845726 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.845696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65n2p\" (UniqueName: \"kubernetes.io/projected/4f74e1e0-31b2-4144-8846-5225410e748b-kube-api-access-65n2p\") pod \"dashboard-redirect-5878f5f596-kpmms\" (UID: \"4f74e1e0-31b2-4144-8846-5225410e748b\") " pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" Jun 08 21:16:21.845896 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.845738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4f74e1e0-31b2-4144-8846-5225410e748b-redirect-config\") pod \"dashboard-redirect-5878f5f596-kpmms\" (UID: \"4f74e1e0-31b2-4144-8846-5225410e748b\") " pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" Jun 08 21:16:21.947138 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.947102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65n2p\" (UniqueName: \"kubernetes.io/projected/4f74e1e0-31b2-4144-8846-5225410e748b-kube-api-access-65n2p\") pod \"dashboard-redirect-5878f5f596-kpmms\" (UID: \"4f74e1e0-31b2-4144-8846-5225410e748b\") " pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" Jun 08 21:16:21.947315 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.947162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4f74e1e0-31b2-4144-8846-5225410e748b-redirect-config\") pod \"dashboard-redirect-5878f5f596-kpmms\" (UID: \"4f74e1e0-31b2-4144-8846-5225410e748b\") " pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" Jun 08 21:16:21.947782 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.947761 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4f74e1e0-31b2-4144-8846-5225410e748b-redirect-config\") pod \"dashboard-redirect-5878f5f596-kpmms\" (UID: \"4f74e1e0-31b2-4144-8846-5225410e748b\") " pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" Jun 08 21:16:21.956294 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:21.956271 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65n2p\" (UniqueName: \"kubernetes.io/projected/4f74e1e0-31b2-4144-8846-5225410e748b-kube-api-access-65n2p\") pod \"dashboard-redirect-5878f5f596-kpmms\" (UID: \"4f74e1e0-31b2-4144-8846-5225410e748b\") " pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" Jun 08 21:16:22.073973 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:22.073931 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" Jun 08 21:16:22.208593 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:22.208567 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5878f5f596-kpmms"] Jun 08 21:16:22.210539 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:16:22.210512 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f74e1e0_31b2_4144_8846_5225410e748b.slice/crio-d993825dfd161641462a180accb16ec2d071b1e64f4eaaf5d3b143c38eaa06f7 WatchSource:0}: Error finding container d993825dfd161641462a180accb16ec2d071b1e64f4eaaf5d3b143c38eaa06f7: Status 404 returned error can't find the container with id d993825dfd161641462a180accb16ec2d071b1e64f4eaaf5d3b143c38eaa06f7 Jun 08 21:16:22.456454 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:22.456419 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" event={"ID":"4f74e1e0-31b2-4144-8846-5225410e748b","Type":"ContainerStarted","Data":"d993825dfd161641462a180accb16ec2d071b1e64f4eaaf5d3b143c38eaa06f7"} Jun 08 21:16:22.458533 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:22.458460 2565 generic.go:356] "Generic (PLEG): container finished" podID="29bdef05-5fc5-4032-991b-ce4066a43558" containerID="7efc4d2cd5f5e73403b74d3556861380fbf29ad62841f65904144f40a2ec6265" exitCode=0 Jun 08 21:16:22.458533 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:22.458488 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" event={"ID":"29bdef05-5fc5-4032-991b-ce4066a43558","Type":"ContainerDied","Data":"7efc4d2cd5f5e73403b74d3556861380fbf29ad62841f65904144f40a2ec6265"} Jun 08 21:16:23.615258 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.615234 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:23.657982 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.657940 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-bundle\") pod \"29bdef05-5fc5-4032-991b-ce4066a43558\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " Jun 08 21:16:23.658185 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.658053 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-util\") pod \"29bdef05-5fc5-4032-991b-ce4066a43558\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " Jun 08 21:16:23.658185 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.658123 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q4w7\" (UniqueName: \"kubernetes.io/projected/29bdef05-5fc5-4032-991b-ce4066a43558-kube-api-access-7q4w7\") pod \"29bdef05-5fc5-4032-991b-ce4066a43558\" (UID: \"29bdef05-5fc5-4032-991b-ce4066a43558\") " Jun 08 21:16:23.659195 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.659138 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-bundle" (OuterVolumeSpecName: "bundle") pod "29bdef05-5fc5-4032-991b-ce4066a43558" (UID: "29bdef05-5fc5-4032-991b-ce4066a43558"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:16:23.661091 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.661058 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29bdef05-5fc5-4032-991b-ce4066a43558-kube-api-access-7q4w7" (OuterVolumeSpecName: "kube-api-access-7q4w7") pod "29bdef05-5fc5-4032-991b-ce4066a43558" (UID: "29bdef05-5fc5-4032-991b-ce4066a43558"). InnerVolumeSpecName "kube-api-access-7q4w7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:16:23.664333 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.664288 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-util" (OuterVolumeSpecName: "util") pod "29bdef05-5fc5-4032-991b-ce4066a43558" (UID: "29bdef05-5fc5-4032-991b-ce4066a43558"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:16:23.758933 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.758847 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:23.758933 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.758886 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q4w7\" (UniqueName: \"kubernetes.io/projected/29bdef05-5fc5-4032-991b-ce4066a43558-kube-api-access-7q4w7\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:23.758933 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:23.758901 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29bdef05-5fc5-4032-991b-ce4066a43558-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:24.470197 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:24.470158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" event={"ID":"4f74e1e0-31b2-4144-8846-5225410e748b","Type":"ContainerStarted","Data":"b0fdde7c4b34b203e840b4a62cd7c89a178923c42b4dc1e1183062747b4b5fa1"} Jun 08 21:16:24.471909 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:24.471886 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" event={"ID":"29bdef05-5fc5-4032-991b-ce4066a43558","Type":"ContainerDied","Data":"ecf24faea77dd39a82c855267b4714083f4bfb1c157999f5e09c66b287564703"} Jun 08 21:16:24.471909 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:24.471905 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afhq85" Jun 08 21:16:24.472117 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:24.471925 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecf24faea77dd39a82c855267b4714083f4bfb1c157999f5e09c66b287564703" Jun 08 21:16:24.488404 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:24.488358 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5878f5f596-kpmms" podStartSLOduration=1.320980903 podStartE2EDuration="3.488344873s" totalImagesPullingTime="2.16736397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:24.486924283 +0000 UTC m=+538.654938086" watchObservedRunningTime="2026-06-08 21:16:24.488344873 +0000 UTC m=+538.656358663" Jun 08 21:16:24.750268 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:24.750233 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:24.750747 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:24.750295 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:24.755329 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:24.755307 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:25.480094 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:25.480069 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5479557688-295cq" Jun 08 21:16:25.529269 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:25.529232 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd966fb6f-tq7f7"] Jun 08 21:16:25.636039 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:25.635999 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:25.736429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:25.736337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:25.886145 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:25.886099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:25.986367 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:25.986331 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:30.448532 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:30.448491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:30.550247 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:30.550208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:36.549454 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:36.549418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:36.639378 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:36.639323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:37.070415 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:37.070385 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:40.780077 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:40.780045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:40.881861 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:40.881825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:41.052504 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.052423 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4"] Jun 08 21:16:41.052790 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.052776 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bdef05-5fc5-4032-991b-ce4066a43558" containerName="extract" Jun 08 21:16:41.052856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.052791 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bdef05-5fc5-4032-991b-ce4066a43558" containerName="extract" Jun 08 21:16:41.052856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.052810 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bdef05-5fc5-4032-991b-ce4066a43558" containerName="pull" Jun 08 21:16:41.052856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.052815 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bdef05-5fc5-4032-991b-ce4066a43558" containerName="pull" Jun 08 21:16:41.052856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.052823 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bdef05-5fc5-4032-991b-ce4066a43558" containerName="util" Jun 08 21:16:41.052856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.052828 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bdef05-5fc5-4032-991b-ce4066a43558" containerName="util" Jun 08 21:16:41.053127 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.052891 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29bdef05-5fc5-4032-991b-ce4066a43558" containerName="extract" Jun 08 21:16:41.054816 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.054797 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.057636 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.057615 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 21:16:41.057765 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.057679 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 21:16:41.057935 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.057920 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6b8td\"" Jun 08 21:16:41.058111 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.058091 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 21:16:41.080518 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.080495 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4"] Jun 08 21:16:41.087451 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.087424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:41.104221 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.104336 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.104336 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.104437 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.104437 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mw2\" (UniqueName: \"kubernetes.io/projected/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-kube-api-access-v7mw2\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.104437 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.104558 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.104558 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.104646 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.104552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.205940 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.205900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206137 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.205961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206137 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.205995 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206137 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206137 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mw2\" (UniqueName: \"kubernetes.io/projected/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-kube-api-access-v7mw2\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206580 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206388 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206580 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206400 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206580 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206677 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.206860 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.206837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.208776 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.208751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.208913 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.208894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.223922 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.223884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:41.228213 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.228191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mw2\" (UniqueName: \"kubernetes.io/projected/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-kube-api-access-v7mw2\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.228293 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.228228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba558b9e-9bfe-43cd-b7a4-67fe2ad64658-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97956zpp4\" (UID: \"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.365164 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.365077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:41.489058 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.488983 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:41.510163 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.510131 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4"] Jun 08 21:16:41.513238 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:16:41.513211 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba558b9e_9bfe_43cd_b7a4_67fe2ad64658.slice/crio-6ef996fddda4fa3549b2b32c73a5de40ec462eb52e25fbe73852225a48794df2 WatchSource:0}: Error finding container 6ef996fddda4fa3549b2b32c73a5de40ec462eb52e25fbe73852225a48794df2: Status 404 returned error can't find the container with id 6ef996fddda4fa3549b2b32c73a5de40ec462eb52e25fbe73852225a48794df2 Jun 08 21:16:41.552974 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.552935 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" event={"ID":"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658","Type":"ContainerStarted","Data":"6ef996fddda4fa3549b2b32c73a5de40ec462eb52e25fbe73852225a48794df2"} Jun 08 21:16:41.589559 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:41.589528 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:16:44.184260 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:44.184223 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:16:44.184491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:44.184295 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:16:44.184491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:44.184323 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:16:44.571336 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:44.571240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" event={"ID":"ba558b9e-9bfe-43cd-b7a4-67fe2ad64658","Type":"ContainerStarted","Data":"b6f38686617740421e129398ed7bbe9f0b1827b29430fc7c3b944da4a8723774"} Jun 08 21:16:44.592600 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:44.592549 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" podStartSLOduration=0.923823959 podStartE2EDuration="3.592532416s" totalImagesPullingTime="2.668708457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:16:44.590206778 +0000 UTC m=+558.758220570" watchObservedRunningTime="2026-06-08 21:16:44.592532416 +0000 UTC m=+558.760546208" Jun 08 21:16:45.365852 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:45.365811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:45.370581 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:45.370558 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:45.576264 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:45.576224 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:45.577140 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:45.577120 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956zpp4" Jun 08 21:16:50.555251 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.555189 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fd966fb6f-tq7f7" podUID="393d4cdd-d97b-4700-801b-217eeba7129c" containerName="console" containerID="cri-o://2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8" gracePeriod=15 Jun 08 21:16:50.814899 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.814837 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:16:50.899089 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899041 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-trusted-ca-bundle\") pod \"393d4cdd-d97b-4700-801b-217eeba7129c\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " Jun 08 21:16:50.899424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899154 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-serving-cert\") pod \"393d4cdd-d97b-4700-801b-217eeba7129c\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " Jun 08 21:16:50.899424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899223 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-oauth-config\") pod \"393d4cdd-d97b-4700-801b-217eeba7129c\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " Jun 08 21:16:50.899424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899241 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-console-config\") pod \"393d4cdd-d97b-4700-801b-217eeba7129c\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " Jun 08 21:16:50.899424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899258 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-oauth-serving-cert\") pod \"393d4cdd-d97b-4700-801b-217eeba7129c\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " Jun 08 21:16:50.899424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899299 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-service-ca\") pod \"393d4cdd-d97b-4700-801b-217eeba7129c\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " Jun 08 21:16:50.899424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899329 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd5mh\" (UniqueName: \"kubernetes.io/projected/393d4cdd-d97b-4700-801b-217eeba7129c-kube-api-access-dd5mh\") pod \"393d4cdd-d97b-4700-801b-217eeba7129c\" (UID: \"393d4cdd-d97b-4700-801b-217eeba7129c\") " Jun 08 21:16:50.899762 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899456 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "393d4cdd-d97b-4700-801b-217eeba7129c" (UID: "393d4cdd-d97b-4700-801b-217eeba7129c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:16:50.899762 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899734 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "393d4cdd-d97b-4700-801b-217eeba7129c" (UID: "393d4cdd-d97b-4700-801b-217eeba7129c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:16:50.899856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899795 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-service-ca" (OuterVolumeSpecName: "service-ca") pod "393d4cdd-d97b-4700-801b-217eeba7129c" (UID: "393d4cdd-d97b-4700-801b-217eeba7129c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:16:50.899856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.899806 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-console-config" (OuterVolumeSpecName: "console-config") pod "393d4cdd-d97b-4700-801b-217eeba7129c" (UID: "393d4cdd-d97b-4700-801b-217eeba7129c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:16:50.900121 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.900103 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-service-ca\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:50.900184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.900127 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-trusted-ca-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:50.900184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.900144 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-console-config\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:50.900184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.900157 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/393d4cdd-d97b-4700-801b-217eeba7129c-oauth-serving-cert\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:50.901916 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.901883 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393d4cdd-d97b-4700-801b-217eeba7129c-kube-api-access-dd5mh" (OuterVolumeSpecName: "kube-api-access-dd5mh") pod "393d4cdd-d97b-4700-801b-217eeba7129c" (UID: "393d4cdd-d97b-4700-801b-217eeba7129c"). InnerVolumeSpecName "kube-api-access-dd5mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:16:50.902139 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.902120 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "393d4cdd-d97b-4700-801b-217eeba7129c" (UID: "393d4cdd-d97b-4700-801b-217eeba7129c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:16:50.902210 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:50.902144 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "393d4cdd-d97b-4700-801b-217eeba7129c" (UID: "393d4cdd-d97b-4700-801b-217eeba7129c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:16:51.000908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.000867 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-serving-cert\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:51.000908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.000902 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/393d4cdd-d97b-4700-801b-217eeba7129c-console-oauth-config\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:51.000908 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.000913 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd5mh\" (UniqueName: \"kubernetes.io/projected/393d4cdd-d97b-4700-801b-217eeba7129c-kube-api-access-dd5mh\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:16:51.606341 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.606306 2565 generic.go:356] "Generic (PLEG): container finished" podID="393d4cdd-d97b-4700-801b-217eeba7129c" containerID="2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8" exitCode=0 Jun 08 21:16:51.606735 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.606356 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd966fb6f-tq7f7" Jun 08 21:16:51.606735 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.606391 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd966fb6f-tq7f7" event={"ID":"393d4cdd-d97b-4700-801b-217eeba7129c","Type":"ContainerDied","Data":"2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8"} Jun 08 21:16:51.606735 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.606442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd966fb6f-tq7f7" event={"ID":"393d4cdd-d97b-4700-801b-217eeba7129c","Type":"ContainerDied","Data":"e69ab75053876aa3cbe0bf7f780c5814440a3ed58e7be2c1899d853b1c6b327d"} Jun 08 21:16:51.606735 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.606462 2565 scope.go:117] "RemoveContainer" containerID="2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8" Jun 08 21:16:51.615876 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.615859 2565 scope.go:117] "RemoveContainer" containerID="2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8" Jun 08 21:16:51.616208 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:16:51.616186 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8\": container with ID starting with 2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8 not found: ID does not exist" containerID="2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8" Jun 08 21:16:51.616289 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.616216 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8"} err="failed to get container status \"2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8\": rpc error: code = NotFound desc = could not find container \"2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8\": container with ID starting with 2224ff0b1fbe292694acf2399cd2f90407b8f1e4d99bee62a8a9faff945ed8e8 not found: ID does not exist" Jun 08 21:16:51.627551 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.627518 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd966fb6f-tq7f7"] Jun 08 21:16:51.629379 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:51.629357 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fd966fb6f-tq7f7"] Jun 08 21:16:52.309923 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:16:52.309892 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="393d4cdd-d97b-4700-801b-217eeba7129c" path="/var/lib/kubelet/pods/393d4cdd-d97b-4700-801b-217eeba7129c/volumes" Jun 08 21:17:03.411604 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.411551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:03.543481 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.543445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:03.557805 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.557760 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp642"] Jun 08 21:17:03.558241 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.558222 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393d4cdd-d97b-4700-801b-217eeba7129c" containerName="console" Jun 08 21:17:03.558342 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.558243 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="393d4cdd-d97b-4700-801b-217eeba7129c" containerName="console" Jun 08 21:17:03.558342 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.558339 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="393d4cdd-d97b-4700-801b-217eeba7129c" containerName="console" Jun 08 21:17:03.570950 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.570911 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp642"] Jun 08 21:17:03.571128 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.571069 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hp642" Jun 08 21:17:03.574172 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.574142 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 21:17:03.575146 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.575120 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 21:17:03.575263 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.575146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-nvbxh\"" Jun 08 21:17:03.643966 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.643931 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:03.716774 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.716734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6kl\" (UniqueName: \"kubernetes.io/projected/da6043a6-9d07-4336-88b6-feb9393ae641-kube-api-access-pv6kl\") pod \"kuadrant-operator-catalog-hp642\" (UID: \"da6043a6-9d07-4336-88b6-feb9393ae641\") " pod="kuadrant-system/kuadrant-operator-catalog-hp642" Jun 08 21:17:03.817792 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.817755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv6kl\" (UniqueName: \"kubernetes.io/projected/da6043a6-9d07-4336-88b6-feb9393ae641-kube-api-access-pv6kl\") pod \"kuadrant-operator-catalog-hp642\" (UID: \"da6043a6-9d07-4336-88b6-feb9393ae641\") " pod="kuadrant-system/kuadrant-operator-catalog-hp642" Jun 08 21:17:03.825709 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.825674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv6kl\" (UniqueName: \"kubernetes.io/projected/da6043a6-9d07-4336-88b6-feb9393ae641-kube-api-access-pv6kl\") pod \"kuadrant-operator-catalog-hp642\" (UID: \"da6043a6-9d07-4336-88b6-feb9393ae641\") " pod="kuadrant-system/kuadrant-operator-catalog-hp642" Jun 08 21:17:03.883304 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.883251 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hp642" Jun 08 21:17:03.892410 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:03.892371 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp642"] Jun 08 21:17:04.024039 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.023999 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp642"] Jun 08 21:17:04.026216 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:04.026186 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6043a6_9d07_4336_88b6_feb9393ae641.slice/crio-70ff84cf60b0fabd1d2f5cc5e56cb5f0af6db99d71c3db2bf348f6a599887f25 WatchSource:0}: Error finding container 70ff84cf60b0fabd1d2f5cc5e56cb5f0af6db99d71c3db2bf348f6a599887f25: Status 404 returned error can't find the container with id 70ff84cf60b0fabd1d2f5cc5e56cb5f0af6db99d71c3db2bf348f6a599887f25 Jun 08 21:17:04.102259 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.102217 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gfk5"] Jun 08 21:17:04.107038 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.106997 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:04.112663 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.112634 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gfk5"] Jun 08 21:17:04.221309 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.221203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd7qj\" (UniqueName: \"kubernetes.io/projected/3c9d1b92-2c54-464a-a7dd-a1f8f5841164-kube-api-access-gd7qj\") pod \"kuadrant-operator-catalog-9gfk5\" (UID: \"3c9d1b92-2c54-464a-a7dd-a1f8f5841164\") " pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:04.322367 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.322334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd7qj\" (UniqueName: \"kubernetes.io/projected/3c9d1b92-2c54-464a-a7dd-a1f8f5841164-kube-api-access-gd7qj\") pod \"kuadrant-operator-catalog-9gfk5\" (UID: \"3c9d1b92-2c54-464a-a7dd-a1f8f5841164\") " pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:04.328321 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.328292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:04.331457 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.331421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd7qj\" (UniqueName: \"kubernetes.io/projected/3c9d1b92-2c54-464a-a7dd-a1f8f5841164-kube-api-access-gd7qj\") pod \"kuadrant-operator-catalog-9gfk5\" (UID: \"3c9d1b92-2c54-464a-a7dd-a1f8f5841164\") " pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:04.417514 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.417477 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:04.526228 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.526185 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:04.561875 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.561842 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9gfk5"] Jun 08 21:17:04.563754 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:04.563723 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9d1b92_2c54_464a_a7dd_a1f8f5841164.slice/crio-bb54bf621c02d1e43ba9d32741c81c260f4881131d0a9247201fc2970ae08d8b WatchSource:0}: Error finding container bb54bf621c02d1e43ba9d32741c81c260f4881131d0a9247201fc2970ae08d8b: Status 404 returned error can't find the container with id bb54bf621c02d1e43ba9d32741c81c260f4881131d0a9247201fc2970ae08d8b Jun 08 21:17:04.678462 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.678429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" event={"ID":"3c9d1b92-2c54-464a-a7dd-a1f8f5841164","Type":"ContainerStarted","Data":"bb54bf621c02d1e43ba9d32741c81c260f4881131d0a9247201fc2970ae08d8b"} Jun 08 21:17:04.679745 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:04.679709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hp642" event={"ID":"da6043a6-9d07-4336-88b6-feb9393ae641","Type":"ContainerStarted","Data":"70ff84cf60b0fabd1d2f5cc5e56cb5f0af6db99d71c3db2bf348f6a599887f25"} Jun 08 21:17:06.692678 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:06.692644 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" event={"ID":"3c9d1b92-2c54-464a-a7dd-a1f8f5841164","Type":"ContainerStarted","Data":"c44fb3b289099ee9f660329ddae46799bccccabbfbcd9cb52fa09332866bc7a2"} Jun 08 21:17:06.694279 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:06.694256 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hp642" event={"ID":"da6043a6-9d07-4336-88b6-feb9393ae641","Type":"ContainerStarted","Data":"5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4"} Jun 08 21:17:06.694382 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:06.694283 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hp642" podUID="da6043a6-9d07-4336-88b6-feb9393ae641" containerName="registry-server" containerID="cri-o://5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4" gracePeriod=2 Jun 08 21:17:06.711536 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:06.711490 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" podStartSLOduration=0.889109404 podStartE2EDuration="2.711470196s" totalImagesPullingTime="1.822360792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:06.709139982 +0000 UTC m=+580.877153800" watchObservedRunningTime="2026-06-08 21:17:06.711470196 +0000 UTC m=+580.879483982" Jun 08 21:17:06.724886 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:06.724834 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hp642" podStartSLOduration=1.367313547 podStartE2EDuration="3.724816319s" totalImagesPullingTime="2.357502772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:06.723550976 +0000 UTC m=+580.891564764" watchObservedRunningTime="2026-06-08 21:17:06.724816319 +0000 UTC m=+580.892830108" Jun 08 21:17:06.942429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:06.942403 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hp642" Jun 08 21:17:07.050256 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.050168 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv6kl\" (UniqueName: \"kubernetes.io/projected/da6043a6-9d07-4336-88b6-feb9393ae641-kube-api-access-pv6kl\") pod \"da6043a6-9d07-4336-88b6-feb9393ae641\" (UID: \"da6043a6-9d07-4336-88b6-feb9393ae641\") " Jun 08 21:17:07.052479 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.052447 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6043a6-9d07-4336-88b6-feb9393ae641-kube-api-access-pv6kl" (OuterVolumeSpecName: "kube-api-access-pv6kl") pod "da6043a6-9d07-4336-88b6-feb9393ae641" (UID: "da6043a6-9d07-4336-88b6-feb9393ae641"). InnerVolumeSpecName "kube-api-access-pv6kl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:17:07.151179 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.151136 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv6kl\" (UniqueName: \"kubernetes.io/projected/da6043a6-9d07-4336-88b6-feb9393ae641-kube-api-access-pv6kl\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:07.700501 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.700459 2565 generic.go:356] "Generic (PLEG): container finished" podID="da6043a6-9d07-4336-88b6-feb9393ae641" containerID="5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4" exitCode=0 Jun 08 21:17:07.700915 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.700525 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hp642" Jun 08 21:17:07.700915 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.700545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hp642" event={"ID":"da6043a6-9d07-4336-88b6-feb9393ae641","Type":"ContainerDied","Data":"5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4"} Jun 08 21:17:07.700915 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.700621 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hp642" event={"ID":"da6043a6-9d07-4336-88b6-feb9393ae641","Type":"ContainerDied","Data":"70ff84cf60b0fabd1d2f5cc5e56cb5f0af6db99d71c3db2bf348f6a599887f25"} Jun 08 21:17:07.700915 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.700641 2565 scope.go:117] "RemoveContainer" containerID="5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4" Jun 08 21:17:07.710332 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.710312 2565 scope.go:117] "RemoveContainer" containerID="5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4" Jun 08 21:17:07.710627 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:07.710607 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4\": container with ID starting with 5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4 not found: ID does not exist" containerID="5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4" Jun 08 21:17:07.710689 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.710641 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4"} err="failed to get container status \"5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4\": rpc error: code = NotFound desc = could not find container \"5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4\": container with ID starting with 5045f47154dc2b486064694c7a6e753bbec3f83c1301408069fa91e9ee73e6e4 not found: ID does not exist" Jun 08 21:17:07.721998 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.721967 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp642"] Jun 08 21:17:07.727709 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:07.727679 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp642"] Jun 08 21:17:08.309133 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:08.309103 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6043a6-9d07-4336-88b6-feb9393ae641" path="/var/lib/kubelet/pods/da6043a6-9d07-4336-88b6-feb9393ae641/volumes" Jun 08 21:17:14.417817 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:14.417779 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:14.418340 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:14.417861 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:14.440534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:14.440501 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:14.758226 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:14.758196 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9gfk5" Jun 08 21:17:15.441768 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:15.441736 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:18.939697 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:18.939662 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv"] Jun 08 21:17:18.940105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:18.940010 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6043a6-9d07-4336-88b6-feb9393ae641" containerName="registry-server" Jun 08 21:17:18.940105 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:18.940040 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6043a6-9d07-4336-88b6-feb9393ae641" containerName="registry-server" Jun 08 21:17:18.940183 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:18.940121 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6043a6-9d07-4336-88b6-feb9393ae641" containerName="registry-server" Jun 08 21:17:18.950155 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:18.950117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:18.952790 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:18.952752 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv"] Jun 08 21:17:18.952968 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:18.952767 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ggf4g\"" Jun 08 21:17:19.058918 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.058880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.059117 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.058936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.059117 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.058956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmcnl\" (UniqueName: \"kubernetes.io/projected/0b3637e8-70cc-4028-b2fa-ace3debf7836-kube-api-access-kmcnl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.159630 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.159590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.159812 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.159653 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.159812 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.159676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmcnl\" (UniqueName: \"kubernetes.io/projected/0b3637e8-70cc-4028-b2fa-ace3debf7836-kube-api-access-kmcnl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.160047 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.159997 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.160100 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.160062 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.170629 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.170598 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmcnl\" (UniqueName: \"kubernetes.io/projected/0b3637e8-70cc-4028-b2fa-ace3debf7836-kube-api-access-kmcnl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.261612 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.261517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:19.404327 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.404302 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv"] Jun 08 21:17:19.406387 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:19.406360 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3637e8_70cc_4028_b2fa_ace3debf7836.slice/crio-28377dcf1d4a07ec4b7a0d618370587461fbed0092ac12cc501c08127ec67e00 WatchSource:0}: Error finding container 28377dcf1d4a07ec4b7a0d618370587461fbed0092ac12cc501c08127ec67e00: Status 404 returned error can't find the container with id 28377dcf1d4a07ec4b7a0d618370587461fbed0092ac12cc501c08127ec67e00 Jun 08 21:17:19.546556 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.546524 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt"] Jun 08 21:17:19.550172 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.550149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.558002 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.557972 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt"] Jun 08 21:17:19.663783 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.663737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.663978 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.663827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6tnz\" (UniqueName: \"kubernetes.io/projected/7395b14f-439e-4619-852e-4a2adf7d6a0a-kube-api-access-w6tnz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.663978 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.663868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.764385 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.764343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.764591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.764440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6tnz\" (UniqueName: \"kubernetes.io/projected/7395b14f-439e-4619-852e-4a2adf7d6a0a-kube-api-access-w6tnz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.764591 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.764481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.764769 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.764747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.764825 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.764795 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.765394 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.765364 2565 generic.go:356] "Generic (PLEG): container finished" podID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerID="7b7aa811a74d2750fda86b738963a8b34dd273b8c78c629d5d471aeb8214569b" exitCode=0 Jun 08 21:17:19.765483 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.765462 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" event={"ID":"0b3637e8-70cc-4028-b2fa-ace3debf7836","Type":"ContainerDied","Data":"7b7aa811a74d2750fda86b738963a8b34dd273b8c78c629d5d471aeb8214569b"} Jun 08 21:17:19.765529 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.765506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" event={"ID":"0b3637e8-70cc-4028-b2fa-ace3debf7836","Type":"ContainerStarted","Data":"28377dcf1d4a07ec4b7a0d618370587461fbed0092ac12cc501c08127ec67e00"} Jun 08 21:17:19.776150 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.776073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6tnz\" (UniqueName: \"kubernetes.io/projected/7395b14f-439e-4619-852e-4a2adf7d6a0a-kube-api-access-w6tnz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:19.905445 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:19.905404 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:20.057077 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.057049 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt"] Jun 08 21:17:20.058963 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:20.058936 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7395b14f_439e_4619_852e_4a2adf7d6a0a.slice/crio-ac828c763c550f703944abe9213bbb184340b705f39307d30d8935df05c4b6ce WatchSource:0}: Error finding container ac828c763c550f703944abe9213bbb184340b705f39307d30d8935df05c4b6ce: Status 404 returned error can't find the container with id ac828c763c550f703944abe9213bbb184340b705f39307d30d8935df05c4b6ce Jun 08 21:17:20.141031 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.140986 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq"] Jun 08 21:17:20.144731 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.144711 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.154276 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.154248 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq"] Jun 08 21:17:20.268274 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.268234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.268274 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.268271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv2l6\" (UniqueName: \"kubernetes.io/projected/a05787fa-b84b-4097-9580-9d5adb1ae8a7-kube-api-access-cv2l6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.268502 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.268404 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.369725 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.369623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.369725 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.369674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv2l6\" (UniqueName: \"kubernetes.io/projected/a05787fa-b84b-4097-9580-9d5adb1ae8a7-kube-api-access-cv2l6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.369931 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.369738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.370085 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.370059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.370136 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.370121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.379265 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.379234 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv2l6\" (UniqueName: \"kubernetes.io/projected/a05787fa-b84b-4097-9580-9d5adb1ae8a7-kube-api-access-cv2l6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.456053 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.455998 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:20.725762 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.725737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq"] Jun 08 21:17:20.727306 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:20.727279 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05787fa_b84b_4097_9580_9d5adb1ae8a7.slice/crio-c71d8412c7dd01ac81f2bd83f1fb6ac822520dcfc5c453d2e81578199cc799b5 WatchSource:0}: Error finding container c71d8412c7dd01ac81f2bd83f1fb6ac822520dcfc5c453d2e81578199cc799b5: Status 404 returned error can't find the container with id c71d8412c7dd01ac81f2bd83f1fb6ac822520dcfc5c453d2e81578199cc799b5 Jun 08 21:17:20.745080 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.745053 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz"] Jun 08 21:17:20.750147 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.750119 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.761803 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.761776 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz"] Jun 08 21:17:20.773153 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.773107 2565 generic.go:356] "Generic (PLEG): container finished" podID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerID="5fb810a4fc7585846ce32456e8ee51401810865c9e77ae15da492a26ee8d9c6f" exitCode=0 Jun 08 21:17:20.773358 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.773204 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" event={"ID":"7395b14f-439e-4619-852e-4a2adf7d6a0a","Type":"ContainerDied","Data":"5fb810a4fc7585846ce32456e8ee51401810865c9e77ae15da492a26ee8d9c6f"} Jun 08 21:17:20.773358 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.773267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" event={"ID":"7395b14f-439e-4619-852e-4a2adf7d6a0a","Type":"ContainerStarted","Data":"ac828c763c550f703944abe9213bbb184340b705f39307d30d8935df05c4b6ce"} Jun 08 21:17:20.776232 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.776203 2565 generic.go:356] "Generic (PLEG): container finished" podID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerID="398abc2ba69ad5dbaada21e6b28d39bd2d02d6180eb4d4d3005f942ab7f978f4" exitCode=0 Jun 08 21:17:20.776355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.776287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" event={"ID":"0b3637e8-70cc-4028-b2fa-ace3debf7836","Type":"ContainerDied","Data":"398abc2ba69ad5dbaada21e6b28d39bd2d02d6180eb4d4d3005f942ab7f978f4"} Jun 08 21:17:20.777919 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.777832 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" event={"ID":"a05787fa-b84b-4097-9580-9d5adb1ae8a7","Type":"ContainerStarted","Data":"c71d8412c7dd01ac81f2bd83f1fb6ac822520dcfc5c453d2e81578199cc799b5"} Jun 08 21:17:20.874980 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.874892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.875145 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.875047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.875145 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.875079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7rbz\" (UniqueName: \"kubernetes.io/projected/a6671bb8-7784-43f4-b4aa-2261d1fb2811-kube-api-access-d7rbz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.975623 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.975580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.975796 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.975631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7rbz\" (UniqueName: \"kubernetes.io/projected/a6671bb8-7784-43f4-b4aa-2261d1fb2811-kube-api-access-d7rbz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.975796 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.975721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.976119 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.976095 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.976213 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.976104 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:20.985825 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:20.985787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7rbz\" (UniqueName: \"kubernetes.io/projected/a6671bb8-7784-43f4-b4aa-2261d1fb2811-kube-api-access-d7rbz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:21.122755 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.122708 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:21.265827 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.265796 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz"] Jun 08 21:17:21.267799 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:21.267766 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6671bb8_7784_43f4_b4aa_2261d1fb2811.slice/crio-b45c9bcaefa627cc1dae9875973b002449f3190c301d4ab8562b07ad92e3cbe4 WatchSource:0}: Error finding container b45c9bcaefa627cc1dae9875973b002449f3190c301d4ab8562b07ad92e3cbe4: Status 404 returned error can't find the container with id b45c9bcaefa627cc1dae9875973b002449f3190c301d4ab8562b07ad92e3cbe4 Jun 08 21:17:21.785090 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.785051 2565 generic.go:356] "Generic (PLEG): container finished" podID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerID="e43b4913a1530f05f3b07c81f7f3333bec5fa2a33666f8dda1c7087d9051d158" exitCode=0 Jun 08 21:17:21.785291 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.785134 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" event={"ID":"0b3637e8-70cc-4028-b2fa-ace3debf7836","Type":"ContainerDied","Data":"e43b4913a1530f05f3b07c81f7f3333bec5fa2a33666f8dda1c7087d9051d158"} Jun 08 21:17:21.786566 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.786543 2565 generic.go:356] "Generic (PLEG): container finished" podID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerID="6d1e1e30b3af4c10fdba22ec021a5a65c510491296cc40873890f9118c563803" exitCode=0 Jun 08 21:17:21.786681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.786605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" event={"ID":"a05787fa-b84b-4097-9580-9d5adb1ae8a7","Type":"ContainerDied","Data":"6d1e1e30b3af4c10fdba22ec021a5a65c510491296cc40873890f9118c563803"} Jun 08 21:17:21.795282 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.795248 2565 generic.go:356] "Generic (PLEG): container finished" podID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerID="824b164fbae7ea8d5dd2fec96ab110441d150abdbf976de7fba65d6b4d5a2363" exitCode=0 Jun 08 21:17:21.795528 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.795296 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" event={"ID":"a6671bb8-7784-43f4-b4aa-2261d1fb2811","Type":"ContainerDied","Data":"824b164fbae7ea8d5dd2fec96ab110441d150abdbf976de7fba65d6b4d5a2363"} Jun 08 21:17:21.795634 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.795608 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" event={"ID":"a6671bb8-7784-43f4-b4aa-2261d1fb2811","Type":"ContainerStarted","Data":"b45c9bcaefa627cc1dae9875973b002449f3190c301d4ab8562b07ad92e3cbe4"} Jun 08 21:17:21.797888 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.797842 2565 generic.go:356] "Generic (PLEG): container finished" podID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerID="c29cb4914f8ffe9efdd0a060d1ec58e84193815efd23acd32507bd9ca50f4345" exitCode=0 Jun 08 21:17:21.797964 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:21.797919 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" event={"ID":"7395b14f-439e-4619-852e-4a2adf7d6a0a","Type":"ContainerDied","Data":"c29cb4914f8ffe9efdd0a060d1ec58e84193815efd23acd32507bd9ca50f4345"} Jun 08 21:17:22.805734 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:22.805699 2565 generic.go:356] "Generic (PLEG): container finished" podID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerID="f381d80785d84d129463d23fc3da08d90b2c3e85164ca22bff021cafc92d66e2" exitCode=0 Jun 08 21:17:22.806218 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:22.805802 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" event={"ID":"a05787fa-b84b-4097-9580-9d5adb1ae8a7","Type":"ContainerDied","Data":"f381d80785d84d129463d23fc3da08d90b2c3e85164ca22bff021cafc92d66e2"} Jun 08 21:17:22.807889 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:22.807862 2565 generic.go:356] "Generic (PLEG): container finished" podID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerID="174a6251a60c4d836f601f8277631ea1de8e1b9d6992897e78209b5ee4d5f158" exitCode=0 Jun 08 21:17:22.808085 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:22.807999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" event={"ID":"a6671bb8-7784-43f4-b4aa-2261d1fb2811","Type":"ContainerDied","Data":"174a6251a60c4d836f601f8277631ea1de8e1b9d6992897e78209b5ee4d5f158"} Jun 08 21:17:22.810512 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:22.810489 2565 generic.go:356] "Generic (PLEG): container finished" podID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerID="30a6fac465d960ef985d37f831f31c671c47359a2cc094e9b9bddfdefcf2fea6" exitCode=0 Jun 08 21:17:22.810615 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:22.810564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" event={"ID":"7395b14f-439e-4619-852e-4a2adf7d6a0a","Type":"ContainerDied","Data":"30a6fac465d960ef985d37f831f31c671c47359a2cc094e9b9bddfdefcf2fea6"} Jun 08 21:17:22.961302 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:22.961272 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:23.094043 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.093974 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-bundle\") pod \"0b3637e8-70cc-4028-b2fa-ace3debf7836\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " Jun 08 21:17:23.094043 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.094042 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmcnl\" (UniqueName: \"kubernetes.io/projected/0b3637e8-70cc-4028-b2fa-ace3debf7836-kube-api-access-kmcnl\") pod \"0b3637e8-70cc-4028-b2fa-ace3debf7836\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " Jun 08 21:17:23.094289 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.094063 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-util\") pod \"0b3637e8-70cc-4028-b2fa-ace3debf7836\" (UID: \"0b3637e8-70cc-4028-b2fa-ace3debf7836\") " Jun 08 21:17:23.094545 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.094513 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-bundle" (OuterVolumeSpecName: "bundle") pod "0b3637e8-70cc-4028-b2fa-ace3debf7836" (UID: "0b3637e8-70cc-4028-b2fa-ace3debf7836"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:23.096390 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.096368 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b3637e8-70cc-4028-b2fa-ace3debf7836-kube-api-access-kmcnl" (OuterVolumeSpecName: "kube-api-access-kmcnl") pod "0b3637e8-70cc-4028-b2fa-ace3debf7836" (UID: "0b3637e8-70cc-4028-b2fa-ace3debf7836"). InnerVolumeSpecName "kube-api-access-kmcnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:17:23.099231 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.099199 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-util" (OuterVolumeSpecName: "util") pod "0b3637e8-70cc-4028-b2fa-ace3debf7836" (UID: "0b3637e8-70cc-4028-b2fa-ace3debf7836"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:23.195671 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.195629 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:23.195671 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.195664 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b3637e8-70cc-4028-b2fa-ace3debf7836-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:23.195671 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.195676 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmcnl\" (UniqueName: \"kubernetes.io/projected/0b3637e8-70cc-4028-b2fa-ace3debf7836-kube-api-access-kmcnl\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:23.817715 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.817684 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" Jun 08 21:17:23.818184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.817678 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv" event={"ID":"0b3637e8-70cc-4028-b2fa-ace3debf7836","Type":"ContainerDied","Data":"28377dcf1d4a07ec4b7a0d618370587461fbed0092ac12cc501c08127ec67e00"} Jun 08 21:17:23.818184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.817817 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28377dcf1d4a07ec4b7a0d618370587461fbed0092ac12cc501c08127ec67e00" Jun 08 21:17:23.819973 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.819946 2565 generic.go:356] "Generic (PLEG): container finished" podID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerID="082a1fd7dac681aa95852ff18938199975995647a1667839c42ad3b3eca5a433" exitCode=0 Jun 08 21:17:23.820123 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.820040 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" event={"ID":"a05787fa-b84b-4097-9580-9d5adb1ae8a7","Type":"ContainerDied","Data":"082a1fd7dac681aa95852ff18938199975995647a1667839c42ad3b3eca5a433"} Jun 08 21:17:23.822267 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.822238 2565 generic.go:356] "Generic (PLEG): container finished" podID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerID="535a304bf881a0ee3257561397c59c2ac6dae72a77f99cffe7a7824bf0683310" exitCode=0 Jun 08 21:17:23.822419 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.822303 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" event={"ID":"a6671bb8-7784-43f4-b4aa-2261d1fb2811","Type":"ContainerDied","Data":"535a304bf881a0ee3257561397c59c2ac6dae72a77f99cffe7a7824bf0683310"} Jun 08 21:17:23.962077 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:23.962045 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:24.001572 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.001532 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-bundle\") pod \"7395b14f-439e-4619-852e-4a2adf7d6a0a\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " Jun 08 21:17:24.001739 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.001623 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6tnz\" (UniqueName: \"kubernetes.io/projected/7395b14f-439e-4619-852e-4a2adf7d6a0a-kube-api-access-w6tnz\") pod \"7395b14f-439e-4619-852e-4a2adf7d6a0a\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " Jun 08 21:17:24.001739 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.001682 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-util\") pod \"7395b14f-439e-4619-852e-4a2adf7d6a0a\" (UID: \"7395b14f-439e-4619-852e-4a2adf7d6a0a\") " Jun 08 21:17:24.002300 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.002274 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-bundle" (OuterVolumeSpecName: "bundle") pod "7395b14f-439e-4619-852e-4a2adf7d6a0a" (UID: "7395b14f-439e-4619-852e-4a2adf7d6a0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:24.004001 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.003953 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7395b14f-439e-4619-852e-4a2adf7d6a0a-kube-api-access-w6tnz" (OuterVolumeSpecName: "kube-api-access-w6tnz") pod "7395b14f-439e-4619-852e-4a2adf7d6a0a" (UID: "7395b14f-439e-4619-852e-4a2adf7d6a0a"). InnerVolumeSpecName "kube-api-access-w6tnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:17:24.008129 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.008078 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-util" (OuterVolumeSpecName: "util") pod "7395b14f-439e-4619-852e-4a2adf7d6a0a" (UID: "7395b14f-439e-4619-852e-4a2adf7d6a0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:24.102845 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.102748 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6tnz\" (UniqueName: \"kubernetes.io/projected/7395b14f-439e-4619-852e-4a2adf7d6a0a-kube-api-access-w6tnz\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:24.102845 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.102783 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:24.102845 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.102794 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7395b14f-439e-4619-852e-4a2adf7d6a0a-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:24.830200 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.830171 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" Jun 08 21:17:24.830663 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.830202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt" event={"ID":"7395b14f-439e-4619-852e-4a2adf7d6a0a","Type":"ContainerDied","Data":"ac828c763c550f703944abe9213bbb184340b705f39307d30d8935df05c4b6ce"} Jun 08 21:17:24.830663 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.830249 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac828c763c550f703944abe9213bbb184340b705f39307d30d8935df05c4b6ce" Jun 08 21:17:24.983525 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:24.983497 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:25.014182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.014142 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:25.111828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.111721 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv2l6\" (UniqueName: \"kubernetes.io/projected/a05787fa-b84b-4097-9580-9d5adb1ae8a7-kube-api-access-cv2l6\") pod \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " Jun 08 21:17:25.111828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.111759 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7rbz\" (UniqueName: \"kubernetes.io/projected/a6671bb8-7784-43f4-b4aa-2261d1fb2811-kube-api-access-d7rbz\") pod \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " Jun 08 21:17:25.111828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.111786 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-util\") pod \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " Jun 08 21:17:25.111828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.111817 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-bundle\") pod \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " Jun 08 21:17:25.112132 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.111993 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-util\") pod \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\" (UID: \"a05787fa-b84b-4097-9580-9d5adb1ae8a7\") " Jun 08 21:17:25.112132 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.112092 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-bundle\") pod \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\" (UID: \"a6671bb8-7784-43f4-b4aa-2261d1fb2811\") " Jun 08 21:17:25.112651 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.112535 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-bundle" (OuterVolumeSpecName: "bundle") pod "a05787fa-b84b-4097-9580-9d5adb1ae8a7" (UID: "a05787fa-b84b-4097-9580-9d5adb1ae8a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:25.112764 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.112665 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-bundle" (OuterVolumeSpecName: "bundle") pod "a6671bb8-7784-43f4-b4aa-2261d1fb2811" (UID: "a6671bb8-7784-43f4-b4aa-2261d1fb2811"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:25.114360 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.114331 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6671bb8-7784-43f4-b4aa-2261d1fb2811-kube-api-access-d7rbz" (OuterVolumeSpecName: "kube-api-access-d7rbz") pod "a6671bb8-7784-43f4-b4aa-2261d1fb2811" (UID: "a6671bb8-7784-43f4-b4aa-2261d1fb2811"). InnerVolumeSpecName "kube-api-access-d7rbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:17:25.114563 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.114541 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a05787fa-b84b-4097-9580-9d5adb1ae8a7-kube-api-access-cv2l6" (OuterVolumeSpecName: "kube-api-access-cv2l6") pod "a05787fa-b84b-4097-9580-9d5adb1ae8a7" (UID: "a05787fa-b84b-4097-9580-9d5adb1ae8a7"). InnerVolumeSpecName "kube-api-access-cv2l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:17:25.118069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.118006 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-util" (OuterVolumeSpecName: "util") pod "a6671bb8-7784-43f4-b4aa-2261d1fb2811" (UID: "a6671bb8-7784-43f4-b4aa-2261d1fb2811"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:25.118976 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.118942 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-util" (OuterVolumeSpecName: "util") pod "a05787fa-b84b-4097-9580-9d5adb1ae8a7" (UID: "a05787fa-b84b-4097-9580-9d5adb1ae8a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:25.213736 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.213692 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv2l6\" (UniqueName: \"kubernetes.io/projected/a05787fa-b84b-4097-9580-9d5adb1ae8a7-kube-api-access-cv2l6\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:25.213736 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.213726 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7rbz\" (UniqueName: \"kubernetes.io/projected/a6671bb8-7784-43f4-b4aa-2261d1fb2811-kube-api-access-d7rbz\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:25.213736 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.213735 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:25.213736 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.213748 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:25.214052 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.213756 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a05787fa-b84b-4097-9580-9d5adb1ae8a7-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:25.214052 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.213763 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6671bb8-7784-43f4-b4aa-2261d1fb2811-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:25.837402 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.837363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" event={"ID":"a05787fa-b84b-4097-9580-9d5adb1ae8a7","Type":"ContainerDied","Data":"c71d8412c7dd01ac81f2bd83f1fb6ac822520dcfc5c453d2e81578199cc799b5"} Jun 08 21:17:25.837844 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.837430 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c71d8412c7dd01ac81f2bd83f1fb6ac822520dcfc5c453d2e81578199cc799b5" Jun 08 21:17:25.837844 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.837376 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq" Jun 08 21:17:25.839455 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.839419 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" event={"ID":"a6671bb8-7784-43f4-b4aa-2261d1fb2811","Type":"ContainerDied","Data":"b45c9bcaefa627cc1dae9875973b002449f3190c301d4ab8562b07ad92e3cbe4"} Jun 08 21:17:25.839561 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.839478 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b45c9bcaefa627cc1dae9875973b002449f3190c301d4ab8562b07ad92e3cbe4" Jun 08 21:17:25.839561 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:25.839436 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz" Jun 08 21:17:26.303189 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:26.303165 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:17:26.303619 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:26.303598 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:17:27.044534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:27.044495 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:30.855637 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:30.855606 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:31.975497 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975458 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk"] Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975805 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerName="extract" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975817 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerName="extract" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975831 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerName="util" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975837 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerName="util" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975843 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerName="util" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975849 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerName="util" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975857 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerName="util" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975862 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerName="util" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975870 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerName="extract" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975875 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerName="extract" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975883 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerName="pull" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975887 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerName="pull" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975892 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerName="extract" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975897 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerName="extract" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975905 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerName="extract" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975909 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerName="extract" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975915 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerName="pull" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975919 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerName="pull" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975928 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerName="util" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975932 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerName="util" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975940 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerName="pull" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975944 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerName="pull" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975950 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerName="pull" Jun 08 21:17:31.975951 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.975954 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerName="pull" Jun 08 21:17:31.977001 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.976005 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b3637e8-70cc-4028-b2fa-ace3debf7836" containerName="extract" Jun 08 21:17:31.977001 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.976028 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7395b14f-439e-4619-852e-4a2adf7d6a0a" containerName="extract" Jun 08 21:17:31.977001 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.976039 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a05787fa-b84b-4097-9580-9d5adb1ae8a7" containerName="extract" Jun 08 21:17:31.977001 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.976044 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6671bb8-7784-43f4-b4aa-2261d1fb2811" containerName="extract" Jun 08 21:17:31.979078 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.979062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:31.981683 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.981662 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5rz7g\"" Jun 08 21:17:31.989881 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:31.989852 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk"] Jun 08 21:17:32.079322 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.079286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztrt4\" (UniqueName: \"kubernetes.io/projected/2881f77d-6080-4648-b270-285acae902bd-kube-api-access-ztrt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" (UID: \"2881f77d-6080-4648-b270-285acae902bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:32.079504 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.079351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2881f77d-6080-4648-b270-285acae902bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" (UID: \"2881f77d-6080-4648-b270-285acae902bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:32.180815 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.180769 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztrt4\" (UniqueName: \"kubernetes.io/projected/2881f77d-6080-4648-b270-285acae902bd-kube-api-access-ztrt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" (UID: \"2881f77d-6080-4648-b270-285acae902bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:32.180981 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.180840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2881f77d-6080-4648-b270-285acae902bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" (UID: \"2881f77d-6080-4648-b270-285acae902bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:32.181222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.181205 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2881f77d-6080-4648-b270-285acae902bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" (UID: \"2881f77d-6080-4648-b270-285acae902bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:32.212824 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.212791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztrt4\" (UniqueName: \"kubernetes.io/projected/2881f77d-6080-4648-b270-285acae902bd-kube-api-access-ztrt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" (UID: \"2881f77d-6080-4648-b270-285acae902bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:32.289682 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.289590 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:32.437795 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.434791 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk"] Jun 08 21:17:32.602278 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.602194 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:32.877159 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:32.877070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" event={"ID":"2881f77d-6080-4648-b270-285acae902bd","Type":"ContainerStarted","Data":"0556f78b748a2c42ea3455df927a5426b76f0daa602740049557ffb9be5e9156"} Jun 08 21:17:33.891401 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:33.891367 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4"] Jun 08 21:17:33.894835 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:33.894818 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" Jun 08 21:17:33.897487 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:33.897467 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 21:17:33.897567 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:33.897524 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vsg8r\"" Jun 08 21:17:33.904254 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:33.904234 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4"] Jun 08 21:17:34.002776 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:34.002736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwllf\" (UniqueName: \"kubernetes.io/projected/d9813419-4172-4195-91cb-19c7a5c7249f-kube-api-access-hwllf\") pod \"dns-operator-controller-manager-864dd78c4c-857d4\" (UID: \"d9813419-4172-4195-91cb-19c7a5c7249f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" Jun 08 21:17:34.104171 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:34.104131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwllf\" (UniqueName: \"kubernetes.io/projected/d9813419-4172-4195-91cb-19c7a5c7249f-kube-api-access-hwllf\") pod \"dns-operator-controller-manager-864dd78c4c-857d4\" (UID: \"d9813419-4172-4195-91cb-19c7a5c7249f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" Jun 08 21:17:34.115731 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:34.115694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwllf\" (UniqueName: \"kubernetes.io/projected/d9813419-4172-4195-91cb-19c7a5c7249f-kube-api-access-hwllf\") pod \"dns-operator-controller-manager-864dd78c4c-857d4\" (UID: \"d9813419-4172-4195-91cb-19c7a5c7249f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" Jun 08 21:17:34.205635 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:34.205595 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" Jun 08 21:17:34.357098 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:34.357053 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4"] Jun 08 21:17:34.358450 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:34.358420 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9813419_4172_4195_91cb_19c7a5c7249f.slice/crio-20a6f18e5bc0a717ed60e0639fbf919a41af5c6ad5e38efc71ce8b09e9a38c75 WatchSource:0}: Error finding container 20a6f18e5bc0a717ed60e0639fbf919a41af5c6ad5e38efc71ce8b09e9a38c75: Status 404 returned error can't find the container with id 20a6f18e5bc0a717ed60e0639fbf919a41af5c6ad5e38efc71ce8b09e9a38c75 Jun 08 21:17:34.445844 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:34.445815 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:34.602526 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:34.602427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:34.889695 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:34.889604 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" event={"ID":"d9813419-4172-4195-91cb-19c7a5c7249f","Type":"ContainerStarted","Data":"20a6f18e5bc0a717ed60e0639fbf919a41af5c6ad5e38efc71ce8b09e9a38c75"} Jun 08 21:17:36.859539 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.859495 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6"] Jun 08 21:17:36.863184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.863160 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:36.866405 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.866380 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hpwlp\"" Jun 08 21:17:36.880729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.880699 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6"] Jun 08 21:17:36.890959 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.890928 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:36.902036 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.901983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" event={"ID":"d9813419-4172-4195-91cb-19c7a5c7249f","Type":"ContainerStarted","Data":"504f7d55fe161d2714e8c514dc4e3971db73395dc9076aa5e66ba6b518c2c5fc"} Jun 08 21:17:36.902175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.902053 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" Jun 08 21:17:36.925544 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.925420 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" podStartSLOduration=1.62758696 podStartE2EDuration="3.925400334s" totalImagesPullingTime="2.297813374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:36.921647047 +0000 UTC m=+611.089660821" watchObservedRunningTime="2026-06-08 21:17:36.925400334 +0000 UTC m=+611.093414127" Jun 08 21:17:36.990148 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:36.990114 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:37.034191 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:37.034145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qwnl\" (UniqueName: \"kubernetes.io/projected/4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5-kube-api-access-4qwnl\") pod \"limitador-operator-controller-manager-859d7b78bd-krwm6\" (UID: \"4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:37.135513 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:37.135474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qwnl\" (UniqueName: \"kubernetes.io/projected/4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5-kube-api-access-4qwnl\") pod \"limitador-operator-controller-manager-859d7b78bd-krwm6\" (UID: \"4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:37.146947 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:37.146913 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qwnl\" (UniqueName: \"kubernetes.io/projected/4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5-kube-api-access-4qwnl\") pod \"limitador-operator-controller-manager-859d7b78bd-krwm6\" (UID: \"4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:37.172848 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:37.172808 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:37.311707 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:37.311685 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6"] Jun 08 21:17:37.313735 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:37.313701 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef2ffe0_202b_4dd9_842b_1ca7fe15efa5.slice/crio-9ea0de17b449d0111e626686758a581a700b82dfc54b7d830bfa63c2d89cc1e7 WatchSource:0}: Error finding container 9ea0de17b449d0111e626686758a581a700b82dfc54b7d830bfa63c2d89cc1e7: Status 404 returned error can't find the container with id 9ea0de17b449d0111e626686758a581a700b82dfc54b7d830bfa63c2d89cc1e7 Jun 08 21:17:37.796831 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:37.796793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:37.911395 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:37.911349 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" event={"ID":"4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5","Type":"ContainerStarted","Data":"9ea0de17b449d0111e626686758a581a700b82dfc54b7d830bfa63c2d89cc1e7"} Jun 08 21:17:39.283195 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:39.283159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:39.383737 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:39.383703 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:39.925882 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:39.925849 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" event={"ID":"2881f77d-6080-4648-b270-285acae902bd","Type":"ContainerStarted","Data":"f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da"} Jun 08 21:17:39.926131 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:39.925943 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:39.927468 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:39.927437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" event={"ID":"4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5","Type":"ContainerStarted","Data":"31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da"} Jun 08 21:17:39.927577 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:39.927492 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:39.945138 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:39.945087 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" podStartSLOduration=1.631752494 podStartE2EDuration="8.945070871s" totalImagesPullingTime="7.313318377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:39.943910456 +0000 UTC m=+614.111924248" watchObservedRunningTime="2026-06-08 21:17:39.945070871 +0000 UTC m=+614.113084660" Jun 08 21:17:39.971691 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:39.971639 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" podStartSLOduration=1.482965233 podStartE2EDuration="3.971621692s" totalImagesPullingTime="2.488656459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:39.969861495 +0000 UTC m=+614.137875310" watchObservedRunningTime="2026-06-08 21:17:39.971621692 +0000 UTC m=+614.139635535" Jun 08 21:17:42.209543 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:42.209510 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:42.271309 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:42.271277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:42.597191 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:42.597089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:42.981138 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:42.981100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:47.914442 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:47.914410 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-857d4" Jun 08 21:17:49.934478 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:49.934438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:50.034108 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:50.034074 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:50.935156 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:50.935123 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:50.935536 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:50.935195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:52.712182 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.712142 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk"] Jun 08 21:17:52.712604 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.712323 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" podUID="2881f77d-6080-4648-b270-285acae902bd" containerName="manager" containerID="cri-o://f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da" gracePeriod=2 Jun 08 21:17:52.725119 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.725091 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk"] Jun 08 21:17:52.732069 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:52.732007 2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2881f77d-6080-4648-b270-285acae902bd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-clrpk\": pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:52.739254 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.739224 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2"] Jun 08 21:17:52.739594 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.739583 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2881f77d-6080-4648-b270-285acae902bd" containerName="manager" Jun 08 21:17:52.739638 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.739597 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2881f77d-6080-4648-b270-285acae902bd" containerName="manager" Jun 08 21:17:52.739673 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.739661 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2881f77d-6080-4648-b270-285acae902bd" containerName="manager" Jun 08 21:17:52.742928 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.742906 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:52.747305 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.747276 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6"] Jun 08 21:17:52.747471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.747451 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" containerName="manager" containerID="cri-o://31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da" gracePeriod=2 Jun 08 21:17:52.760229 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.760196 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6"] Jun 08 21:17:52.763909 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.763880 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2"] Jun 08 21:17:52.776602 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.776556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fed5430b-da16-4b6e-91f1-80ea8378016d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5zg2\" (UID: \"fed5430b-da16-4b6e-91f1-80ea8378016d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:52.776764 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.776669 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkfpq\" (UniqueName: \"kubernetes.io/projected/fed5430b-da16-4b6e-91f1-80ea8378016d-kube-api-access-hkfpq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5zg2\" (UID: \"fed5430b-da16-4b6e-91f1-80ea8378016d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:52.779532 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.779504 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk"] Jun 08 21:17:52.780010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.779990 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" containerName="manager" Jun 08 21:17:52.780010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.780030 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" containerName="manager" Jun 08 21:17:52.780162 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.780119 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" containerName="manager" Jun 08 21:17:52.783730 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.783702 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" Jun 08 21:17:52.785919 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:52.785888 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:52.797609 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.797574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk"] Jun 08 21:17:52.807752 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:52.807710 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:52.809760 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:52.809719 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-krwm6\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:52.877561 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.877524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkfpq\" (UniqueName: \"kubernetes.io/projected/fed5430b-da16-4b6e-91f1-80ea8378016d-kube-api-access-hkfpq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5zg2\" (UID: \"fed5430b-da16-4b6e-91f1-80ea8378016d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:52.877758 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.877609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fed5430b-da16-4b6e-91f1-80ea8378016d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5zg2\" (UID: \"fed5430b-da16-4b6e-91f1-80ea8378016d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:52.877758 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.877649 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfh4b\" (UniqueName: \"kubernetes.io/projected/aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81-kube-api-access-nfh4b\") pod \"limitador-operator-controller-manager-859d7b78bd-n7njk\" (UID: \"aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" Jun 08 21:17:52.878146 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.878117 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fed5430b-da16-4b6e-91f1-80ea8378016d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5zg2\" (UID: \"fed5430b-da16-4b6e-91f1-80ea8378016d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:52.893933 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.893904 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkfpq\" (UniqueName: \"kubernetes.io/projected/fed5430b-da16-4b6e-91f1-80ea8378016d-kube-api-access-hkfpq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5zg2\" (UID: \"fed5430b-da16-4b6e-91f1-80ea8378016d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:52.978426 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.978369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfh4b\" (UniqueName: \"kubernetes.io/projected/aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81-kube-api-access-nfh4b\") pod \"limitador-operator-controller-manager-859d7b78bd-n7njk\" (UID: \"aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" Jun 08 21:17:52.989093 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.989067 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:52.989492 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.989464 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfh4b\" (UniqueName: \"kubernetes.io/projected/aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81-kube-api-access-nfh4b\") pod \"limitador-operator-controller-manager-859d7b78bd-n7njk\" (UID: \"aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" Jun 08 21:17:52.991991 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:52.991963 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:52.993553 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:52.993538 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:52.999147 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:52.999106 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-krwm6\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:53.001719 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.001686 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-krwm6\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:53.002084 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.002064 2565 generic.go:356] "Generic (PLEG): container finished" podID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" containerID="31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da" exitCode=0 Jun 08 21:17:53.002169 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.002099 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:53.002229 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.002172 2565 scope.go:117] "RemoveContainer" containerID="31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da" Jun 08 21:17:53.003828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.003807 2565 generic.go:356] "Generic (PLEG): container finished" podID="2881f77d-6080-4648-b270-285acae902bd" containerID="f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da" exitCode=0 Jun 08 21:17:53.003918 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.003847 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:53.004408 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.004389 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:53.006374 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.006354 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:53.008305 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.008283 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-krwm6\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:53.011617 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.011595 2565 scope.go:117] "RemoveContainer" containerID="31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da" Jun 08 21:17:53.011874 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.011858 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da\": container with ID starting with 31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da not found: ID does not exist" containerID="31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da" Jun 08 21:17:53.011931 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.011883 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da"} err="failed to get container status \"31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da\": rpc error: code = NotFound desc = could not find container \"31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da\": container with ID starting with 31b267288231a3f50c460838960dd37c544dc8e8f2c41138c0f97dd55509b2da not found: ID does not exist" Jun 08 21:17:53.011931 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.011899 2565 scope.go:117] "RemoveContainer" containerID="f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da" Jun 08 21:17:53.020782 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.020760 2565 scope.go:117] "RemoveContainer" containerID="f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da" Jun 08 21:17:53.021067 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.021049 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da\": container with ID starting with f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da not found: ID does not exist" containerID="f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da" Jun 08 21:17:53.021131 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.021076 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da"} err="failed to get container status \"f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da\": rpc error: code = NotFound desc = could not find container \"f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da\": container with ID starting with f0e6bb743902ab52fe7b2c4d91c6f96502048f54adfa3bb60963bc7ce9a5f2da not found: ID does not exist" Jun 08 21:17:53.078987 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.078954 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztrt4\" (UniqueName: \"kubernetes.io/projected/2881f77d-6080-4648-b270-285acae902bd-kube-api-access-ztrt4\") pod \"2881f77d-6080-4648-b270-285acae902bd\" (UID: \"2881f77d-6080-4648-b270-285acae902bd\") " Jun 08 21:17:53.079164 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.079031 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2881f77d-6080-4648-b270-285acae902bd-extensions-socket-volume\") pod \"2881f77d-6080-4648-b270-285acae902bd\" (UID: \"2881f77d-6080-4648-b270-285acae902bd\") " Jun 08 21:17:53.079164 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.079061 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qwnl\" (UniqueName: \"kubernetes.io/projected/4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5-kube-api-access-4qwnl\") pod \"4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5\" (UID: \"4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5\") " Jun 08 21:17:53.079536 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.079511 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2881f77d-6080-4648-b270-285acae902bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2881f77d-6080-4648-b270-285acae902bd" (UID: "2881f77d-6080-4648-b270-285acae902bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:17:53.081286 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.081265 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2881f77d-6080-4648-b270-285acae902bd-kube-api-access-ztrt4" (OuterVolumeSpecName: "kube-api-access-ztrt4") pod "2881f77d-6080-4648-b270-285acae902bd" (UID: "2881f77d-6080-4648-b270-285acae902bd"). InnerVolumeSpecName "kube-api-access-ztrt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:17:53.081286 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.081282 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5-kube-api-access-4qwnl" (OuterVolumeSpecName: "kube-api-access-4qwnl") pod "4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" (UID: "4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5"). InnerVolumeSpecName "kube-api-access-4qwnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:17:53.159069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.159003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:53.166721 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.166690 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" Jun 08 21:17:53.179793 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.179771 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2881f77d-6080-4648-b270-285acae902bd-extensions-socket-volume\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:53.179863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.179797 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qwnl\" (UniqueName: \"kubernetes.io/projected/4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5-kube-api-access-4qwnl\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:53.179863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.179808 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztrt4\" (UniqueName: \"kubernetes.io/projected/2881f77d-6080-4648-b270-285acae902bd-kube-api-access-ztrt4\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:17:53.318028 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.315519 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2"] Jun 08 21:17:53.326316 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.326287 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:53.328489 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.328439 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-krwm6\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:53.330634 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.330609 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:53.331313 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:53.331290 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk"] Jun 08 21:17:53.331985 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:17:53.331963 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaeca6dc_15fd_4a69_9a79_2a1e0e09ac81.slice/crio-0be7e8c2bdbd3bdc831f3c46ccdeca85d281779962f9b5624f6b8814560dc8d8 WatchSource:0}: Error finding container 0be7e8c2bdbd3bdc831f3c46ccdeca85d281779962f9b5624f6b8814560dc8d8: Status 404 returned error can't find the container with id 0be7e8c2bdbd3bdc831f3c46ccdeca85d281779962f9b5624f6b8814560dc8d8 Jun 08 21:17:53.335058 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:53.335030 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-krwm6\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:54.012936 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.012837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" event={"ID":"aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81","Type":"ContainerStarted","Data":"b14201afea5c9eebae90071b33eb5e6870cc81b16dd5c0574088edc8c38b4608"} Jun 08 21:17:54.012936 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.012896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" event={"ID":"aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81","Type":"ContainerStarted","Data":"0be7e8c2bdbd3bdc831f3c46ccdeca85d281779962f9b5624f6b8814560dc8d8"} Jun 08 21:17:54.012936 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.012923 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" Jun 08 21:17:54.015292 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.015268 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" event={"ID":"fed5430b-da16-4b6e-91f1-80ea8378016d","Type":"ContainerStarted","Data":"dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5"} Jun 08 21:17:54.015430 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.015313 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" event={"ID":"fed5430b-da16-4b6e-91f1-80ea8378016d","Type":"ContainerStarted","Data":"59e59fb506a951f16016080dc9536d2a7097baf5751bac9e5c0489c23dcc7805"} Jun 08 21:17:54.015430 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.015360 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:17:54.035542 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.035487 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" podStartSLOduration=2.035472435 podStartE2EDuration="2.035472435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:54.034250266 +0000 UTC m=+628.202264069" watchObservedRunningTime="2026-06-08 21:17:54.035472435 +0000 UTC m=+628.203486226" Jun 08 21:17:54.036389 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:54.036354 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:54.038428 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:54.038390 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-krwm6\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:54.062816 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:54.062772 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clrpk\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="2881f77d-6080-4648-b270-285acae902bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clrpk" Jun 08 21:17:54.063222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.063183 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" podStartSLOduration=2.063168802 podStartE2EDuration="2.063168802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:54.060669145 +0000 UTC m=+628.228682937" watchObservedRunningTime="2026-06-08 21:17:54.063168802 +0000 UTC m=+628.231182644" Jun 08 21:17:54.064557 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:17:54.064532 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-krwm6\" is forbidden: User \"system:node:ip-10-0-140-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-214.ec2.internal' and this object" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krwm6" Jun 08 21:17:54.310007 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.309926 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2881f77d-6080-4648-b270-285acae902bd" path="/var/lib/kubelet/pods/2881f77d-6080-4648-b270-285acae902bd/volumes" Jun 08 21:17:54.310295 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.310281 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5" path="/var/lib/kubelet/pods/4ef2ffe0-202b-4dd9-842b-1ca7fe15efa5/volumes" Jun 08 21:17:54.700503 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.700475 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:54.824673 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:54.824630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:59.428075 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:59.428001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:59.527563 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:59.527524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:59.734869 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:59.734834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:17:59.834985 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:17:59.834943 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:03.415048 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:03.414989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:03.517090 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:03.517056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:05.023330 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:05.023299 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:18:05.023882 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:05.023369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7njk" Jun 08 21:18:11.211887 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:11.211848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:11.315245 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:11.315214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:11.474426 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:11.474336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:11.574761 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:11.574727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:15.029810 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:15.029778 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:15.192486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:15.192442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:19.854117 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:19.854074 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:19.942491 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:19.942457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:24.895286 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:24.895248 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2"] Jun 08 21:18:24.895694 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:24.895448 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" podUID="fed5430b-da16-4b6e-91f1-80ea8378016d" containerName="manager" containerID="cri-o://dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5" gracePeriod=10 Jun 08 21:18:25.021625 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.021581 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" podUID="fed5430b-da16-4b6e-91f1-80ea8378016d" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.46:8081/readyz\": dial tcp 10.134.0.46:8081: connect: connection refused" Jun 08 21:18:25.157871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.157802 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:18:25.174334 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.174300 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl"] Jun 08 21:18:25.174667 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.174655 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fed5430b-da16-4b6e-91f1-80ea8378016d" containerName="manager" Jun 08 21:18:25.174710 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.174669 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fed5430b-da16-4b6e-91f1-80ea8378016d" containerName="manager" Jun 08 21:18:25.174748 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.174727 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fed5430b-da16-4b6e-91f1-80ea8378016d" containerName="manager" Jun 08 21:18:25.176610 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.176593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:25.191224 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.191195 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl"] Jun 08 21:18:25.194387 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.194357 2565 generic.go:356] "Generic (PLEG): container finished" podID="fed5430b-da16-4b6e-91f1-80ea8378016d" containerID="dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5" exitCode=0 Jun 08 21:18:25.194530 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.194401 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" Jun 08 21:18:25.194530 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.194442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" event={"ID":"fed5430b-da16-4b6e-91f1-80ea8378016d","Type":"ContainerDied","Data":"dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5"} Jun 08 21:18:25.194530 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.194493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2" event={"ID":"fed5430b-da16-4b6e-91f1-80ea8378016d","Type":"ContainerDied","Data":"59e59fb506a951f16016080dc9536d2a7097baf5751bac9e5c0489c23dcc7805"} Jun 08 21:18:25.194530 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.194517 2565 scope.go:117] "RemoveContainer" containerID="dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5" Jun 08 21:18:25.206388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.206364 2565 scope.go:117] "RemoveContainer" containerID="dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5" Jun 08 21:18:25.206728 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:18:25.206708 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5\": container with ID starting with dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5 not found: ID does not exist" containerID="dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5" Jun 08 21:18:25.206785 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.206743 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5"} err="failed to get container status \"dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5\": rpc error: code = NotFound desc = could not find container \"dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5\": container with ID starting with dd6d5593f9b60a38f74ba8f370205dceb788ca292749538231174657508ea6b5 not found: ID does not exist" Jun 08 21:18:25.249230 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.249197 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fed5430b-da16-4b6e-91f1-80ea8378016d-extensions-socket-volume\") pod \"fed5430b-da16-4b6e-91f1-80ea8378016d\" (UID: \"fed5430b-da16-4b6e-91f1-80ea8378016d\") " Jun 08 21:18:25.249423 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.249272 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkfpq\" (UniqueName: \"kubernetes.io/projected/fed5430b-da16-4b6e-91f1-80ea8378016d-kube-api-access-hkfpq\") pod \"fed5430b-da16-4b6e-91f1-80ea8378016d\" (UID: \"fed5430b-da16-4b6e-91f1-80ea8378016d\") " Jun 08 21:18:25.249526 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.249507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/039b6fe3-33e8-4d07-aa92-937007516f2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lr5hl\" (UID: \"039b6fe3-33e8-4d07-aa92-937007516f2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:25.249595 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.249570 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fed5430b-da16-4b6e-91f1-80ea8378016d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fed5430b-da16-4b6e-91f1-80ea8378016d" (UID: "fed5430b-da16-4b6e-91f1-80ea8378016d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:18:25.249662 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.249597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2c44\" (UniqueName: \"kubernetes.io/projected/039b6fe3-33e8-4d07-aa92-937007516f2a-kube-api-access-f2c44\") pod \"kuadrant-operator-controller-manager-86878c769f-lr5hl\" (UID: \"039b6fe3-33e8-4d07-aa92-937007516f2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:25.249662 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.249651 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fed5430b-da16-4b6e-91f1-80ea8378016d-extensions-socket-volume\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:18:25.251519 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.251498 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fed5430b-da16-4b6e-91f1-80ea8378016d-kube-api-access-hkfpq" (OuterVolumeSpecName: "kube-api-access-hkfpq") pod "fed5430b-da16-4b6e-91f1-80ea8378016d" (UID: "fed5430b-da16-4b6e-91f1-80ea8378016d"). InnerVolumeSpecName "kube-api-access-hkfpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:18:25.350615 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.350568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/039b6fe3-33e8-4d07-aa92-937007516f2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lr5hl\" (UID: \"039b6fe3-33e8-4d07-aa92-937007516f2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:25.350796 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.350637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2c44\" (UniqueName: \"kubernetes.io/projected/039b6fe3-33e8-4d07-aa92-937007516f2a-kube-api-access-f2c44\") pod \"kuadrant-operator-controller-manager-86878c769f-lr5hl\" (UID: \"039b6fe3-33e8-4d07-aa92-937007516f2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:25.350796 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.350688 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkfpq\" (UniqueName: \"kubernetes.io/projected/fed5430b-da16-4b6e-91f1-80ea8378016d-kube-api-access-hkfpq\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:18:25.350965 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.350944 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/039b6fe3-33e8-4d07-aa92-937007516f2a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lr5hl\" (UID: \"039b6fe3-33e8-4d07-aa92-937007516f2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:25.358991 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.358958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2c44\" (UniqueName: \"kubernetes.io/projected/039b6fe3-33e8-4d07-aa92-937007516f2a-kube-api-access-f2c44\") pod \"kuadrant-operator-controller-manager-86878c769f-lr5hl\" (UID: \"039b6fe3-33e8-4d07-aa92-937007516f2a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:25.487912 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.487864 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:25.528009 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.527960 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2"] Jun 08 21:18:25.533869 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.533831 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5zg2"] Jun 08 21:18:25.634138 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:25.634109 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl"] Jun 08 21:18:25.636230 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:18:25.636201 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039b6fe3_33e8_4d07_aa92_937007516f2a.slice/crio-01d36e21878bdced01dcf27577e4ce9dbd258ce9eddffa5d30c86ec679b6c3d5 WatchSource:0}: Error finding container 01d36e21878bdced01dcf27577e4ce9dbd258ce9eddffa5d30c86ec679b6c3d5: Status 404 returned error can't find the container with id 01d36e21878bdced01dcf27577e4ce9dbd258ce9eddffa5d30c86ec679b6c3d5 Jun 08 21:18:26.208516 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:26.208480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" event={"ID":"039b6fe3-33e8-4d07-aa92-937007516f2a","Type":"ContainerStarted","Data":"d579898709b9e87b08aa0bf41dce8222ba78476eea62962bddb0750e409e39b3"} Jun 08 21:18:26.208904 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:26.208558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" event={"ID":"039b6fe3-33e8-4d07-aa92-937007516f2a","Type":"ContainerStarted","Data":"01d36e21878bdced01dcf27577e4ce9dbd258ce9eddffa5d30c86ec679b6c3d5"} Jun 08 21:18:26.208904 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:26.208613 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:26.238455 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:26.238396 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" podStartSLOduration=1.238377433 podStartE2EDuration="1.238377433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:26.234682165 +0000 UTC m=+660.402695972" watchObservedRunningTime="2026-06-08 21:18:26.238377433 +0000 UTC m=+660.406391226" Jun 08 21:18:26.309957 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:26.309922 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fed5430b-da16-4b6e-91f1-80ea8378016d" path="/var/lib/kubelet/pods/fed5430b-da16-4b6e-91f1-80ea8378016d/volumes" Jun 08 21:18:30.976775 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:30.976734 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:37.216764 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:37.216721 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lr5hl" Jun 08 21:18:41.215095 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.215054 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8"] Jun 08 21:18:41.218169 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.218144 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.220636 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.220616 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v5nrn\"" Jun 08 21:18:41.228516 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.228486 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8"] Jun 08 21:18:41.247565 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.247532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:41.301414 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.301383 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:41.396281 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgkvk\" (UniqueName: \"kubernetes.io/projected/d6e79356-1df5-43fb-9954-2f0269c9afec-kube-api-access-lgkvk\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.396281 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.396521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e79356-1df5-43fb-9954-2f0269c9afec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.396521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.396521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.396521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.396521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.396742 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.396742 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.396608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498059 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.497920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e79356-1df5-43fb-9954-2f0269c9afec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498059 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498304 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498304 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498304 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498304 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498304 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498545 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgkvk\" (UniqueName: \"kubernetes.io/projected/d6e79356-1df5-43fb-9954-2f0269c9afec-kube-api-access-lgkvk\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498545 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498372 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498664 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498787 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498736 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498907 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498907 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e79356-1df5-43fb-9954-2f0269c9afec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.498991 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.498920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.500653 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.500631 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.500979 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.500958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.506879 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.506845 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e79356-1df5-43fb-9954-2f0269c9afec-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.506984 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.506913 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgkvk\" (UniqueName: \"kubernetes.io/projected/d6e79356-1df5-43fb-9954-2f0269c9afec-kube-api-access-lgkvk\") pod \"maas-default-gateway-openshift-default-687ff6996-m8vb8\" (UID: \"d6e79356-1df5-43fb-9954-2f0269c9afec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.530974 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.530931 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:41.672404 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.672374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8"] Jun 08 21:18:41.674331 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:18:41.674302 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e79356_1df5_43fb_9954_2f0269c9afec.slice/crio-5478e09bef8247388fe73f134eb29389ba51926953c8c8f4d6b57158a3af69d2 WatchSource:0}: Error finding container 5478e09bef8247388fe73f134eb29389ba51926953c8c8f4d6b57158a3af69d2: Status 404 returned error can't find the container with id 5478e09bef8247388fe73f134eb29389ba51926953c8c8f4d6b57158a3af69d2 Jun 08 21:18:41.676989 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.676951 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:18:41.677120 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.677071 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:18:41.677187 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:41.677125 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:18:42.297269 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:42.297224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" event={"ID":"d6e79356-1df5-43fb-9954-2f0269c9afec","Type":"ContainerStarted","Data":"fc239b8b6bc626de7b296a40c24fc14918541ede772122798273e36f0336d03d"} Jun 08 21:18:42.297762 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:42.297297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" event={"ID":"d6e79356-1df5-43fb-9954-2f0269c9afec","Type":"ContainerStarted","Data":"5478e09bef8247388fe73f134eb29389ba51926953c8c8f4d6b57158a3af69d2"} Jun 08 21:18:42.319950 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:42.319893 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" podStartSLOduration=1.319873947 podStartE2EDuration="1.319873947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:42.317087129 +0000 UTC m=+676.485100921" watchObservedRunningTime="2026-06-08 21:18:42.319873947 +0000 UTC m=+676.487887738" Jun 08 21:18:42.532104 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:42.532063 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:42.536931 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:42.536901 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:43.302373 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:43.302336 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:43.303429 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:43.303411 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:18:44.904950 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:44.904907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:45.255349 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:45.255300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:45.365353 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:45.365306 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:45.464139 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:45.464103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:46.042269 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.042234 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6l6wp"] Jun 08 21:18:46.044816 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.044794 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6l6wp" Jun 08 21:18:46.047232 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.047206 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tdxzl\"" Jun 08 21:18:46.053934 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.053910 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6l6wp"] Jun 08 21:18:46.072359 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.072330 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:46.125936 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.125901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:18:46.138150 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.138119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhlmv\" (UniqueName: \"kubernetes.io/projected/54aaa249-99b7-42fe-80b5-7130e05ee133-kube-api-access-fhlmv\") pod \"authorino-58cd955675-6l6wp\" (UID: \"54aaa249-99b7-42fe-80b5-7130e05ee133\") " pod="kuadrant-system/authorino-58cd955675-6l6wp" Jun 08 21:18:46.239588 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.239545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhlmv\" (UniqueName: \"kubernetes.io/projected/54aaa249-99b7-42fe-80b5-7130e05ee133-kube-api-access-fhlmv\") pod \"authorino-58cd955675-6l6wp\" (UID: \"54aaa249-99b7-42fe-80b5-7130e05ee133\") " pod="kuadrant-system/authorino-58cd955675-6l6wp" Jun 08 21:18:46.247909 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.247876 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhlmv\" (UniqueName: \"kubernetes.io/projected/54aaa249-99b7-42fe-80b5-7130e05ee133-kube-api-access-fhlmv\") pod \"authorino-58cd955675-6l6wp\" (UID: \"54aaa249-99b7-42fe-80b5-7130e05ee133\") " pod="kuadrant-system/authorino-58cd955675-6l6wp" Jun 08 21:18:46.356143 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.356062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6l6wp" Jun 08 21:18:46.499029 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:46.498984 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6l6wp"] Jun 08 21:18:46.500509 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:18:46.500473 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54aaa249_99b7_42fe_80b5_7130e05ee133.slice/crio-8326dce7ea6a76b3d70d5eca3f592aab706036dbf4627674feeafcbee0382299 WatchSource:0}: Error finding container 8326dce7ea6a76b3d70d5eca3f592aab706036dbf4627674feeafcbee0382299: Status 404 returned error can't find the container with id 8326dce7ea6a76b3d70d5eca3f592aab706036dbf4627674feeafcbee0382299 Jun 08 21:18:47.326724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:47.326681 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6l6wp" event={"ID":"54aaa249-99b7-42fe-80b5-7130e05ee133","Type":"ContainerStarted","Data":"8326dce7ea6a76b3d70d5eca3f592aab706036dbf4627674feeafcbee0382299"} Jun 08 21:18:50.349060 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:50.349003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6l6wp" event={"ID":"54aaa249-99b7-42fe-80b5-7130e05ee133","Type":"ContainerStarted","Data":"83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572"} Jun 08 21:18:50.363930 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:50.363881 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6l6wp" podStartSLOduration=1.086011267 podStartE2EDuration="4.363865306s" totalImagesPullingTime="3.277854039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:50.363436578 +0000 UTC m=+684.531450368" watchObservedRunningTime="2026-06-08 21:18:50.363865306 +0000 UTC m=+684.531879117" Jun 08 21:18:51.069528 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:51.069482 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6l6wp"] Jun 08 21:18:52.359526 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:52.359488 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6l6wp" podUID="54aaa249-99b7-42fe-80b5-7130e05ee133" containerName="authorino" containerID="cri-o://83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572" gracePeriod=30 Jun 08 21:18:52.615444 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:52.615380 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6l6wp" Jun 08 21:18:52.699525 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:52.699486 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhlmv\" (UniqueName: \"kubernetes.io/projected/54aaa249-99b7-42fe-80b5-7130e05ee133-kube-api-access-fhlmv\") pod \"54aaa249-99b7-42fe-80b5-7130e05ee133\" (UID: \"54aaa249-99b7-42fe-80b5-7130e05ee133\") " Jun 08 21:18:52.701720 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:52.701695 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54aaa249-99b7-42fe-80b5-7130e05ee133-kube-api-access-fhlmv" (OuterVolumeSpecName: "kube-api-access-fhlmv") pod "54aaa249-99b7-42fe-80b5-7130e05ee133" (UID: "54aaa249-99b7-42fe-80b5-7130e05ee133"). InnerVolumeSpecName "kube-api-access-fhlmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:18:52.801114 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:52.801070 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhlmv\" (UniqueName: \"kubernetes.io/projected/54aaa249-99b7-42fe-80b5-7130e05ee133-kube-api-access-fhlmv\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:18:53.365293 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.365256 2565 generic.go:356] "Generic (PLEG): container finished" podID="54aaa249-99b7-42fe-80b5-7130e05ee133" containerID="83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572" exitCode=0 Jun 08 21:18:53.365780 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.365300 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6l6wp" Jun 08 21:18:53.365780 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.365334 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6l6wp" event={"ID":"54aaa249-99b7-42fe-80b5-7130e05ee133","Type":"ContainerDied","Data":"83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572"} Jun 08 21:18:53.365780 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.365375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6l6wp" event={"ID":"54aaa249-99b7-42fe-80b5-7130e05ee133","Type":"ContainerDied","Data":"8326dce7ea6a76b3d70d5eca3f592aab706036dbf4627674feeafcbee0382299"} Jun 08 21:18:53.365780 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.365393 2565 scope.go:117] "RemoveContainer" containerID="83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572" Jun 08 21:18:53.374909 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.374884 2565 scope.go:117] "RemoveContainer" containerID="83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572" Jun 08 21:18:53.375283 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:18:53.375257 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572\": container with ID starting with 83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572 not found: ID does not exist" containerID="83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572" Jun 08 21:18:53.375340 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.375293 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572"} err="failed to get container status \"83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572\": rpc error: code = NotFound desc = could not find container \"83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572\": container with ID starting with 83be15131706197a8abf91510b734b9eeba7232159f7525b65ddc1cf5ec79572 not found: ID does not exist" Jun 08 21:18:53.386516 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.386480 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6l6wp"] Jun 08 21:18:53.389114 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:53.389085 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6l6wp"] Jun 08 21:18:54.309168 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:18:54.309126 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54aaa249-99b7-42fe-80b5-7130e05ee133" path="/var/lib/kubelet/pods/54aaa249-99b7-42fe-80b5-7130e05ee133/volumes" Jun 08 21:19:01.382175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:01.382144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:19:01.482910 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:01.482872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:19:01.901524 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:01.901487 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:19:11.409073 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:11.408968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:19:11.509362 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:11.509326 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:19:11.664184 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:11.664078 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:19:12.503729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.503692 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn"] Jun 08 21:19:12.504143 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.504078 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54aaa249-99b7-42fe-80b5-7130e05ee133" containerName="authorino" Jun 08 21:19:12.504143 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.504090 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="54aaa249-99b7-42fe-80b5-7130e05ee133" containerName="authorino" Jun 08 21:19:12.504221 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.504161 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="54aaa249-99b7-42fe-80b5-7130e05ee133" containerName="authorino" Jun 08 21:19:12.507348 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.507328 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.510512 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.510488 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:19:12.510666 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.510493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:19:12.510666 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.510539 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k79cc\"" Jun 08 21:19:12.517009 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.516984 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn"] Jun 08 21:19:12.585204 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.585161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.585204 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.585206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlhdm\" (UniqueName: \"kubernetes.io/projected/3c26bd8d-c615-43e1-8eff-4e46fc877717-kube-api-access-zlhdm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.585430 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.585330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.686158 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.686116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.686339 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.686189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.686339 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.686220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlhdm\" (UniqueName: \"kubernetes.io/projected/3c26bd8d-c615-43e1-8eff-4e46fc877717-kube-api-access-zlhdm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.686597 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.686575 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.686637 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.686581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.699302 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.699262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlhdm\" (UniqueName: \"kubernetes.io/projected/3c26bd8d-c615-43e1-8eff-4e46fc877717-kube-api-access-zlhdm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.818268 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.818169 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:12.963299 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:12.963264 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn"] Jun 08 21:19:12.964315 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:19:12.964287 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c26bd8d_c615_43e1_8eff_4e46fc877717.slice/crio-c60798aece43f5f894551f9f05d8f8332b479f36c04156196cbb5da9ef7bd930 WatchSource:0}: Error finding container c60798aece43f5f894551f9f05d8f8332b479f36c04156196cbb5da9ef7bd930: Status 404 returned error can't find the container with id c60798aece43f5f894551f9f05d8f8332b479f36c04156196cbb5da9ef7bd930 Jun 08 21:19:13.476397 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:13.476363 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerID="b802893b974643aa56693e076068cdbf04c6b04022be1344e83c18de555db514" exitCode=0 Jun 08 21:19:13.476580 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:13.476414 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" event={"ID":"3c26bd8d-c615-43e1-8eff-4e46fc877717","Type":"ContainerDied","Data":"b802893b974643aa56693e076068cdbf04c6b04022be1344e83c18de555db514"} Jun 08 21:19:13.476580 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:13.476458 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" event={"ID":"3c26bd8d-c615-43e1-8eff-4e46fc877717","Type":"ContainerStarted","Data":"c60798aece43f5f894551f9f05d8f8332b479f36c04156196cbb5da9ef7bd930"} Jun 08 21:19:14.484257 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:14.484217 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerID="896a6a1a0c2d3b5c975428951f5ae10db6cc45679ee89e8604a5c5693adc69d8" exitCode=0 Jun 08 21:19:14.484652 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:14.484307 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" event={"ID":"3c26bd8d-c615-43e1-8eff-4e46fc877717","Type":"ContainerDied","Data":"896a6a1a0c2d3b5c975428951f5ae10db6cc45679ee89e8604a5c5693adc69d8"} Jun 08 21:19:15.492628 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:15.492586 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerID="de38083ce7528bb8a60d7534ef0127a6781ca8cdbb8b4d9c000d0ae3cddb667d" exitCode=0 Jun 08 21:19:15.493065 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:15.492667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" event={"ID":"3c26bd8d-c615-43e1-8eff-4e46fc877717","Type":"ContainerDied","Data":"de38083ce7528bb8a60d7534ef0127a6781ca8cdbb8b4d9c000d0ae3cddb667d"} Jun 08 21:19:16.631757 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.631726 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:16.724952 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.724917 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-bundle\") pod \"3c26bd8d-c615-43e1-8eff-4e46fc877717\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " Jun 08 21:19:16.725171 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.724995 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-util\") pod \"3c26bd8d-c615-43e1-8eff-4e46fc877717\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " Jun 08 21:19:16.725171 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.725045 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlhdm\" (UniqueName: \"kubernetes.io/projected/3c26bd8d-c615-43e1-8eff-4e46fc877717-kube-api-access-zlhdm\") pod \"3c26bd8d-c615-43e1-8eff-4e46fc877717\" (UID: \"3c26bd8d-c615-43e1-8eff-4e46fc877717\") " Jun 08 21:19:16.725521 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.725497 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-bundle" (OuterVolumeSpecName: "bundle") pod "3c26bd8d-c615-43e1-8eff-4e46fc877717" (UID: "3c26bd8d-c615-43e1-8eff-4e46fc877717"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:19:16.727255 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.727232 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c26bd8d-c615-43e1-8eff-4e46fc877717-kube-api-access-zlhdm" (OuterVolumeSpecName: "kube-api-access-zlhdm") pod "3c26bd8d-c615-43e1-8eff-4e46fc877717" (UID: "3c26bd8d-c615-43e1-8eff-4e46fc877717"). InnerVolumeSpecName "kube-api-access-zlhdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:19:16.732898 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.732875 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-util" (OuterVolumeSpecName: "util") pod "3c26bd8d-c615-43e1-8eff-4e46fc877717" (UID: "3c26bd8d-c615-43e1-8eff-4e46fc877717"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:19:16.825849 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.825756 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-util\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:19:16.825849 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.825781 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlhdm\" (UniqueName: \"kubernetes.io/projected/3c26bd8d-c615-43e1-8eff-4e46fc877717-kube-api-access-zlhdm\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:19:16.825849 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:16.825792 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c26bd8d-c615-43e1-8eff-4e46fc877717-bundle\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:19:17.505586 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:17.505554 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" event={"ID":"3c26bd8d-c615-43e1-8eff-4e46fc877717","Type":"ContainerDied","Data":"c60798aece43f5f894551f9f05d8f8332b479f36c04156196cbb5da9ef7bd930"} Jun 08 21:19:17.505847 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:17.505608 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c60798aece43f5f894551f9f05d8f8332b479f36c04156196cbb5da9ef7bd930" Jun 08 21:19:17.505847 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:17.505570 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485p5bn" Jun 08 21:19:35.276358 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.276319 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:19:35.377807 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.377775 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:19:35.767780 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.767741 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:19:35.768168 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.768153 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerName="util" Jun 08 21:19:35.768217 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.768170 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerName="util" Jun 08 21:19:35.768217 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.768183 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerName="extract" Jun 08 21:19:35.768217 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.768189 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerName="extract" Jun 08 21:19:35.768217 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.768209 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerName="pull" Jun 08 21:19:35.768217 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.768214 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerName="pull" Jun 08 21:19:35.768372 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.768284 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c26bd8d-c615-43e1-8eff-4e46fc877717" containerName="extract" Jun 08 21:19:35.772926 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.772901 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:19:35.776620 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.776592 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 21:19:35.776620 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.776612 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2ln4v\"" Jun 08 21:19:35.776831 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.776602 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 21:19:35.776831 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.776602 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 21:19:35.782817 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.782788 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:19:35.797193 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.797151 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8cdn\" (UniqueName: \"kubernetes.io/projected/56528794-4864-42fa-8745-6c44432e0346-kube-api-access-s8cdn\") pod \"maas-keycloak-0\" (UID: \"56528794-4864-42fa-8745-6c44432e0346\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:19:35.897870 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.897829 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8cdn\" (UniqueName: \"kubernetes.io/projected/56528794-4864-42fa-8745-6c44432e0346-kube-api-access-s8cdn\") pod \"maas-keycloak-0\" (UID: \"56528794-4864-42fa-8745-6c44432e0346\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:19:35.906246 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:35.906213 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8cdn\" (UniqueName: \"kubernetes.io/projected/56528794-4864-42fa-8745-6c44432e0346-kube-api-access-s8cdn\") pod \"maas-keycloak-0\" (UID: \"56528794-4864-42fa-8745-6c44432e0346\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:19:36.083801 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:36.083708 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:19:36.229724 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:36.229694 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:19:36.231861 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:19:36.231828 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56528794_4864_42fa_8745_6c44432e0346.slice/crio-afef98478f6a3049f980c1c94651fea12619a0e90d6a8c04bcbf75890e54200c WatchSource:0}: Error finding container afef98478f6a3049f980c1c94651fea12619a0e90d6a8c04bcbf75890e54200c: Status 404 returned error can't find the container with id afef98478f6a3049f980c1c94651fea12619a0e90d6a8c04bcbf75890e54200c Jun 08 21:19:36.233088 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:36.233070 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:19:36.623587 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:36.623551 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"56528794-4864-42fa-8745-6c44432e0346","Type":"ContainerStarted","Data":"afef98478f6a3049f980c1c94651fea12619a0e90d6a8c04bcbf75890e54200c"} Jun 08 21:19:42.667102 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:42.667057 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"56528794-4864-42fa-8745-6c44432e0346","Type":"ContainerStarted","Data":"b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589"} Jun 08 21:19:42.686595 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:42.686529 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.841070618 podStartE2EDuration="7.686509165s" totalImagesPullingTime="5.845438547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:19:42.683261197 +0000 UTC m=+736.851275017" watchObservedRunningTime="2026-06-08 21:19:42.686509165 +0000 UTC m=+736.854522958" Jun 08 21:19:43.084198 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:43.084160 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 21:19:43.086253 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:43.086217 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:44.084486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:44.084449 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:45.085243 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:45.085184 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:46.084679 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:46.084613 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 21:19:46.085133 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:46.085093 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:47.084295 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:47.084243 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:48.084550 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:48.084504 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:49.085159 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:49.085105 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:50.084699 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:50.084644 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:51.084713 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:51.084669 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:52.084199 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:52.084150 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:53.095248 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:53.095190 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:54.084248 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:54.084160 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:55.084261 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:55.084142 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 08 21:19:56.207856 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:56.207819 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 21:19:56.226213 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:56.226162 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:19:56.259441 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:19:56.259393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:06.213738 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:06.213700 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 21:20:06.880321 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:06.880251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:07.164037 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.163927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:07.487470 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.487436 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67b8db4fd9-vmzpp"] Jun 08 21:20:07.500383 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.500351 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67b8db4fd9-vmzpp"] Jun 08 21:20:07.500534 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.500482 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:20:07.503166 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.503141 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tdxzl\"" Jun 08 21:20:07.504249 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.504226 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 21:20:07.513988 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.513952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/847c0b44-9027-44e9-946b-38b1886ae4b9-tls-cert\") pod \"authorino-67b8db4fd9-vmzpp\" (UID: \"847c0b44-9027-44e9-946b-38b1886ae4b9\") " pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:20:07.514113 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.514095 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9j92\" (UniqueName: \"kubernetes.io/projected/847c0b44-9027-44e9-946b-38b1886ae4b9-kube-api-access-x9j92\") pod \"authorino-67b8db4fd9-vmzpp\" (UID: \"847c0b44-9027-44e9-946b-38b1886ae4b9\") " pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:20:07.615034 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.614987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/847c0b44-9027-44e9-946b-38b1886ae4b9-tls-cert\") pod \"authorino-67b8db4fd9-vmzpp\" (UID: \"847c0b44-9027-44e9-946b-38b1886ae4b9\") " pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:20:07.615216 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.615121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9j92\" (UniqueName: \"kubernetes.io/projected/847c0b44-9027-44e9-946b-38b1886ae4b9-kube-api-access-x9j92\") pod \"authorino-67b8db4fd9-vmzpp\" (UID: \"847c0b44-9027-44e9-946b-38b1886ae4b9\") " pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:20:07.617551 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.617520 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/847c0b44-9027-44e9-946b-38b1886ae4b9-tls-cert\") pod \"authorino-67b8db4fd9-vmzpp\" (UID: \"847c0b44-9027-44e9-946b-38b1886ae4b9\") " pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:20:07.622728 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.622704 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9j92\" (UniqueName: \"kubernetes.io/projected/847c0b44-9027-44e9-946b-38b1886ae4b9-kube-api-access-x9j92\") pod \"authorino-67b8db4fd9-vmzpp\" (UID: \"847c0b44-9027-44e9-946b-38b1886ae4b9\") " pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:20:07.810052 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.809952 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:20:07.943676 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:07.943649 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67b8db4fd9-vmzpp"] Jun 08 21:20:07.945464 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:20:07.945438 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod847c0b44_9027_44e9_946b_38b1886ae4b9.slice/crio-78c4a0be17e30e27a6805149b89b41058fd3d9c630e94dddb09dbbd98cac9019 WatchSource:0}: Error finding container 78c4a0be17e30e27a6805149b89b41058fd3d9c630e94dddb09dbbd98cac9019: Status 404 returned error can't find the container with id 78c4a0be17e30e27a6805149b89b41058fd3d9c630e94dddb09dbbd98cac9019 Jun 08 21:20:08.859207 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:08.859164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" event={"ID":"847c0b44-9027-44e9-946b-38b1886ae4b9","Type":"ContainerStarted","Data":"b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de"} Jun 08 21:20:08.859588 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:08.859217 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" event={"ID":"847c0b44-9027-44e9-946b-38b1886ae4b9","Type":"ContainerStarted","Data":"78c4a0be17e30e27a6805149b89b41058fd3d9c630e94dddb09dbbd98cac9019"} Jun 08 21:20:08.874316 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:08.874266 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" podStartSLOduration=1.520405928 podStartE2EDuration="1.874251669s" totalImagesPullingTime="353.845741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:20:08.873428656 +0000 UTC m=+763.041442449" watchObservedRunningTime="2026-06-08 21:20:08.874251669 +0000 UTC m=+763.042265503" Jun 08 21:20:12.435081 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.435047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:12.445863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.445830 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df9f47f5d-jp76f"] Jun 08 21:20:12.450051 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.450004 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:12.452593 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.452572 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 21:20:12.453607 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.453583 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qpgg9\"" Jun 08 21:20:12.453778 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.453632 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 21:20:12.456223 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.456197 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df9f47f5d-jp76f"] Jun 08 21:20:12.531201 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.531161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:12.559344 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.559304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert\") pod \"maas-controller-5df9f47f5d-jp76f\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:12.559545 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.559370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c9sw\" (UniqueName: \"kubernetes.io/projected/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-kube-api-access-6c9sw\") pod \"maas-controller-5df9f47f5d-jp76f\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:12.582400 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.582365 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:12.620301 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.620264 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dccdbd7b5-ljp29"] Jun 08 21:20:12.623774 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.623758 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:12.634964 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.634924 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dccdbd7b5-ljp29"] Jun 08 21:20:12.660460 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.660422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-webhook-cert\") pod \"maas-controller-6dccdbd7b5-ljp29\" (UID: \"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d\") " pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:12.660662 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.660473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert\") pod \"maas-controller-5df9f47f5d-jp76f\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:12.660662 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:20:12.660572 2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 21:20:12.660662 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.660589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c9sw\" (UniqueName: \"kubernetes.io/projected/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-kube-api-access-6c9sw\") pod \"maas-controller-5df9f47f5d-jp76f\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:12.660662 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:20:12.660627 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert podName:b0ddcfdb-0e17-4867-9471-38e0f9c132e4 nodeName:}" failed. No retries permitted until 2026-06-08 21:20:13.160610532 +0000 UTC m=+767.328624302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert") pod "maas-controller-5df9f47f5d-jp76f" (UID: "b0ddcfdb-0e17-4867-9471-38e0f9c132e4") : secret "maas-controller-webhook-cert" not found Jun 08 21:20:12.660662 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.660658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhsb\" (UniqueName: \"kubernetes.io/projected/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-kube-api-access-5hhsb\") pod \"maas-controller-6dccdbd7b5-ljp29\" (UID: \"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d\") " pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:12.669332 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.669305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c9sw\" (UniqueName: \"kubernetes.io/projected/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-kube-api-access-6c9sw\") pod \"maas-controller-5df9f47f5d-jp76f\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:12.761849 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.761739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhsb\" (UniqueName: \"kubernetes.io/projected/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-kube-api-access-5hhsb\") pod \"maas-controller-6dccdbd7b5-ljp29\" (UID: \"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d\") " pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:12.762076 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.761858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-webhook-cert\") pod \"maas-controller-6dccdbd7b5-ljp29\" (UID: \"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d\") " pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:12.762076 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:20:12.761992 2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 21:20:12.762076 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:20:12.762076 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-webhook-cert podName:5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d nodeName:}" failed. No retries permitted until 2026-06-08 21:20:13.262061289 +0000 UTC m=+767.430075081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-webhook-cert") pod "maas-controller-6dccdbd7b5-ljp29" (UID: "5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d") : secret "maas-controller-webhook-cert" not found Jun 08 21:20:12.770995 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.770958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhsb\" (UniqueName: \"kubernetes.io/projected/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-kube-api-access-5hhsb\") pod \"maas-controller-6dccdbd7b5-ljp29\" (UID: \"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d\") " pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:12.817141 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:12.817110 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:13.166547 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.166458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert\") pod \"maas-controller-5df9f47f5d-jp76f\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:13.169080 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.169050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert\") pod \"maas-controller-5df9f47f5d-jp76f\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:13.267651 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.267596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-webhook-cert\") pod \"maas-controller-6dccdbd7b5-ljp29\" (UID: \"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d\") " pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:13.270202 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.270172 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d-webhook-cert\") pod \"maas-controller-6dccdbd7b5-ljp29\" (UID: \"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d\") " pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:13.363040 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.362982 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:13.499995 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.499965 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df9f47f5d-jp76f"] Jun 08 21:20:13.501390 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:20:13.501369 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ddcfdb_0e17_4867_9471_38e0f9c132e4.slice/crio-2ceeb59f94d9b1ea8d11d3e260dbd880479ce079aab67c19b28c4fa43b96a3c2 WatchSource:0}: Error finding container 2ceeb59f94d9b1ea8d11d3e260dbd880479ce079aab67c19b28c4fa43b96a3c2: Status 404 returned error can't find the container with id 2ceeb59f94d9b1ea8d11d3e260dbd880479ce079aab67c19b28c4fa43b96a3c2 Jun 08 21:20:13.538980 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.538946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:13.673960 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.673935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dccdbd7b5-ljp29"] Jun 08 21:20:13.675552 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:20:13.675522 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5344b0c8_13c3_47b6_ac59_eb94c2ec9e3d.slice/crio-1e9b9efd7b8aa99bd71db1cedb00f68bd1a3eb477987f61303b44e6e9b04a45c WatchSource:0}: Error finding container 1e9b9efd7b8aa99bd71db1cedb00f68bd1a3eb477987f61303b44e6e9b04a45c: Status 404 returned error can't find the container with id 1e9b9efd7b8aa99bd71db1cedb00f68bd1a3eb477987f61303b44e6e9b04a45c Jun 08 21:20:13.888542 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.888456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" event={"ID":"b0ddcfdb-0e17-4867-9471-38e0f9c132e4","Type":"ContainerStarted","Data":"2ceeb59f94d9b1ea8d11d3e260dbd880479ce079aab67c19b28c4fa43b96a3c2"} Jun 08 21:20:13.889658 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:13.889634 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" event={"ID":"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d","Type":"ContainerStarted","Data":"1e9b9efd7b8aa99bd71db1cedb00f68bd1a3eb477987f61303b44e6e9b04a45c"} Jun 08 21:20:16.427237 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:16.427206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:16.526427 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:16.526334 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:16.915854 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:16.915751 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" event={"ID":"5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d","Type":"ContainerStarted","Data":"97d4feacfb1551d98bfddc63673db9a3a78a36c02f7b5462c0d43c282bd03c7d"} Jun 08 21:20:16.916064 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:16.915943 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:16.917545 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:16.917519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" event={"ID":"b0ddcfdb-0e17-4867-9471-38e0f9c132e4","Type":"ContainerStarted","Data":"b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426"} Jun 08 21:20:16.917660 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:16.917640 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:16.932099 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:16.932052 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" podStartSLOduration=2.382448081 podStartE2EDuration="4.932007683s" totalImagesPullingTime="2.549559602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:20:16.931393575 +0000 UTC m=+771.099407390" watchObservedRunningTime="2026-06-08 21:20:16.932007683 +0000 UTC m=+771.100021475" Jun 08 21:20:16.948701 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:16.948653 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" podStartSLOduration=2.236606995 podStartE2EDuration="4.948637807s" totalImagesPullingTime="2.712030812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:20:16.946448042 +0000 UTC m=+771.114461853" watchObservedRunningTime="2026-06-08 21:20:16.948637807 +0000 UTC m=+771.116651599" Jun 08 21:20:27.928391 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:27.928357 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dccdbd7b5-ljp29" Jun 08 21:20:27.928879 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:27.928651 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:27.988252 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:27.988211 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df9f47f5d-jp76f"] Jun 08 21:20:27.988465 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:27.988438 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" podUID="b0ddcfdb-0e17-4867-9471-38e0f9c132e4" containerName="manager" containerID="cri-o://b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426" gracePeriod=30 Jun 08 21:20:28.238671 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.238647 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:28.310545 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.310508 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c9sw\" (UniqueName: \"kubernetes.io/projected/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-kube-api-access-6c9sw\") pod \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " Jun 08 21:20:28.311183 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.311155 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert\") pod \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\" (UID: \"b0ddcfdb-0e17-4867-9471-38e0f9c132e4\") " Jun 08 21:20:28.313357 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.313329 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b0ddcfdb-0e17-4867-9471-38e0f9c132e4" (UID: "b0ddcfdb-0e17-4867-9471-38e0f9c132e4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:20:28.313555 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.313532 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-kube-api-access-6c9sw" (OuterVolumeSpecName: "kube-api-access-6c9sw") pod "b0ddcfdb-0e17-4867-9471-38e0f9c132e4" (UID: "b0ddcfdb-0e17-4867-9471-38e0f9c132e4"). InnerVolumeSpecName "kube-api-access-6c9sw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:20:28.412424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.412387 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c9sw\" (UniqueName: \"kubernetes.io/projected/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-kube-api-access-6c9sw\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:20:28.412424 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.412425 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ddcfdb-0e17-4867-9471-38e0f9c132e4-webhook-cert\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:20:28.989298 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.989260 2565 generic.go:356] "Generic (PLEG): container finished" podID="b0ddcfdb-0e17-4867-9471-38e0f9c132e4" containerID="b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426" exitCode=0 Jun 08 21:20:28.989755 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.989319 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" Jun 08 21:20:28.989755 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.989348 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" event={"ID":"b0ddcfdb-0e17-4867-9471-38e0f9c132e4","Type":"ContainerDied","Data":"b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426"} Jun 08 21:20:28.989755 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.989402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df9f47f5d-jp76f" event={"ID":"b0ddcfdb-0e17-4867-9471-38e0f9c132e4","Type":"ContainerDied","Data":"2ceeb59f94d9b1ea8d11d3e260dbd880479ce079aab67c19b28c4fa43b96a3c2"} Jun 08 21:20:28.989755 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.989424 2565 scope.go:117] "RemoveContainer" containerID="b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426" Jun 08 21:20:28.999070 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.999051 2565 scope.go:117] "RemoveContainer" containerID="b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426" Jun 08 21:20:28.999336 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:20:28.999318 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426\": container with ID starting with b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426 not found: ID does not exist" containerID="b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426" Jun 08 21:20:28.999400 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:28.999343 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426"} err="failed to get container status \"b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426\": rpc error: code = NotFound desc = could not find container \"b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426\": container with ID starting with b3f5822203ab022cee5fc4e45b7eb8a82795f0f93d4c54262937fbabc8dec426 not found: ID does not exist" Jun 08 21:20:29.008418 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:29.008397 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df9f47f5d-jp76f"] Jun 08 21:20:29.010808 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:29.010789 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5df9f47f5d-jp76f"] Jun 08 21:20:30.309865 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:30.309831 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ddcfdb-0e17-4867-9471-38e0f9c132e4" path="/var/lib/kubelet/pods/b0ddcfdb-0e17-4867-9471-38e0f9c132e4/volumes" Jun 08 21:20:47.466446 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.466343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:47.512838 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.512804 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r"] Jun 08 21:20:47.513280 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.513266 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ddcfdb-0e17-4867-9471-38e0f9c132e4" containerName="manager" Jun 08 21:20:47.513334 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.513283 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ddcfdb-0e17-4867-9471-38e0f9c132e4" containerName="manager" Jun 08 21:20:47.513393 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.513382 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ddcfdb-0e17-4867-9471-38e0f9c132e4" containerName="manager" Jun 08 21:20:47.520060 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.520011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:47.523004 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.522974 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 08 21:20:47.523162 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.522984 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 08 21:20:47.524111 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.524090 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 08 21:20:47.524247 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.524095 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-sxmbr\"" Jun 08 21:20:47.528690 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.528671 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r"] Jun 08 21:20:47.689462 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.689425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsscb\" (UniqueName: \"kubernetes.io/projected/35738b1d-6849-464b-a8e4-55e961be11e2-kube-api-access-nsscb\") pod \"maas-api-89b7cc898-sjj2r\" (UID: \"35738b1d-6849-464b-a8e4-55e961be11e2\") " pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:47.689633 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.689586 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35738b1d-6849-464b-a8e4-55e961be11e2-maas-api-tls\") pod \"maas-api-89b7cc898-sjj2r\" (UID: \"35738b1d-6849-464b-a8e4-55e961be11e2\") " pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:47.791003 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.790921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35738b1d-6849-464b-a8e4-55e961be11e2-maas-api-tls\") pod \"maas-api-89b7cc898-sjj2r\" (UID: \"35738b1d-6849-464b-a8e4-55e961be11e2\") " pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:47.791003 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.790964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsscb\" (UniqueName: \"kubernetes.io/projected/35738b1d-6849-464b-a8e4-55e961be11e2-kube-api-access-nsscb\") pod \"maas-api-89b7cc898-sjj2r\" (UID: \"35738b1d-6849-464b-a8e4-55e961be11e2\") " pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:47.791233 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:20:47.791097 2565 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 08 21:20:47.791233 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:20:47.791184 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35738b1d-6849-464b-a8e4-55e961be11e2-maas-api-tls podName:35738b1d-6849-464b-a8e4-55e961be11e2 nodeName:}" failed. No retries permitted until 2026-06-08 21:20:48.291163406 +0000 UTC m=+802.459177192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/35738b1d-6849-464b-a8e4-55e961be11e2-maas-api-tls") pod "maas-api-89b7cc898-sjj2r" (UID: "35738b1d-6849-464b-a8e4-55e961be11e2") : secret "maas-api-serving-cert" not found Jun 08 21:20:47.800828 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.800799 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsscb\" (UniqueName: \"kubernetes.io/projected/35738b1d-6849-464b-a8e4-55e961be11e2-kube-api-access-nsscb\") pod \"maas-api-89b7cc898-sjj2r\" (UID: \"35738b1d-6849-464b-a8e4-55e961be11e2\") " pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:47.901987 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.901943 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:47.999769 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:47.999732 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-62pm2"] Jun 08 21:20:48.001844 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.001811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:48.004321 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.004299 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" Jun 08 21:20:48.006850 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.006815 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 21:20:48.006980 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.006891 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b956r\"" Jun 08 21:20:48.013392 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.013357 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-62pm2"] Jun 08 21:20:48.158749 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.158645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:20:48.194532 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.194500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms25l\" (UniqueName: \"kubernetes.io/projected/f53badbb-5edf-4b3a-a3fd-d01c948a530c-kube-api-access-ms25l\") pod \"payload-pre-processing-67d7689b65-62pm2\" (UID: \"f53badbb-5edf-4b3a-a3fd-d01c948a530c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" Jun 08 21:20:48.295486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.295448 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35738b1d-6849-464b-a8e4-55e961be11e2-maas-api-tls\") pod \"maas-api-89b7cc898-sjj2r\" (UID: \"35738b1d-6849-464b-a8e4-55e961be11e2\") " pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:48.295486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.295490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms25l\" (UniqueName: \"kubernetes.io/projected/f53badbb-5edf-4b3a-a3fd-d01c948a530c-kube-api-access-ms25l\") pod \"payload-pre-processing-67d7689b65-62pm2\" (UID: \"f53badbb-5edf-4b3a-a3fd-d01c948a530c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" Jun 08 21:20:48.298198 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.298171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35738b1d-6849-464b-a8e4-55e961be11e2-maas-api-tls\") pod \"maas-api-89b7cc898-sjj2r\" (UID: \"35738b1d-6849-464b-a8e4-55e961be11e2\") " pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:48.303754 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.303724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms25l\" (UniqueName: \"kubernetes.io/projected/f53badbb-5edf-4b3a-a3fd-d01c948a530c-kube-api-access-ms25l\") pod \"payload-pre-processing-67d7689b65-62pm2\" (UID: \"f53badbb-5edf-4b3a-a3fd-d01c948a530c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" Jun 08 21:20:48.317748 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.317726 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" Jun 08 21:20:48.431338 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.431303 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:48.461760 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.461730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-62pm2"] Jun 08 21:20:48.462819 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:20:48.462787 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53badbb_5edf_4b3a_a3fd_d01c948a530c.slice/crio-f5a926f5aeabee3ba03c6b491dc3637fec86f3a233cfc315d14a411752df6bda WatchSource:0}: Error finding container f5a926f5aeabee3ba03c6b491dc3637fec86f3a233cfc315d14a411752df6bda: Status 404 returned error can't find the container with id f5a926f5aeabee3ba03c6b491dc3637fec86f3a233cfc315d14a411752df6bda Jun 08 21:20:48.614878 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:48.614848 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r"] Jun 08 21:20:48.616310 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:20:48.616282 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35738b1d_6849_464b_a8e4_55e961be11e2.slice/crio-3215bc79a0b7a8591e0f18bd01c6819cc93999aab3a59463ee4f7acac0442ea0 WatchSource:0}: Error finding container 3215bc79a0b7a8591e0f18bd01c6819cc93999aab3a59463ee4f7acac0442ea0: Status 404 returned error can't find the container with id 3215bc79a0b7a8591e0f18bd01c6819cc93999aab3a59463ee4f7acac0442ea0 Jun 08 21:20:49.108069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:49.108032 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" event={"ID":"35738b1d-6849-464b-a8e4-55e961be11e2","Type":"ContainerStarted","Data":"3215bc79a0b7a8591e0f18bd01c6819cc93999aab3a59463ee4f7acac0442ea0"} Jun 08 21:20:49.109573 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:49.109544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" event={"ID":"f53badbb-5edf-4b3a-a3fd-d01c948a530c","Type":"ContainerStarted","Data":"f5a926f5aeabee3ba03c6b491dc3637fec86f3a233cfc315d14a411752df6bda"} Jun 08 21:20:51.130741 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:51.130710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" event={"ID":"f53badbb-5edf-4b3a-a3fd-d01c948a530c","Type":"ContainerStarted","Data":"ab13a00b15656086e9c4aa3f846ce78c94d305884e7c78b2a904084e504e8811"} Jun 08 21:20:51.131253 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:51.131235 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" Jun 08 21:20:51.132460 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:51.132436 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" event={"ID":"35738b1d-6849-464b-a8e4-55e961be11e2","Type":"ContainerStarted","Data":"b294c181de92e64da52b1ae6ceee84be4957f10ee05aa4afd40013c466ea8806"} Jun 08 21:20:51.132578 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:51.132567 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:51.163510 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:51.163441 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" podStartSLOduration=2.194615825 podStartE2EDuration="4.163420411s" totalImagesPullingTime="1.968804586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:20:51.16221268 +0000 UTC m=+805.330226473" watchObservedRunningTime="2026-06-08 21:20:51.163420411 +0000 UTC m=+805.331434205" Jun 08 21:20:51.182222 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:51.182166 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" podStartSLOduration=2.296890752 podStartE2EDuration="4.182149127s" totalImagesPullingTime="1.885258375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:20:51.179879967 +0000 UTC m=+805.347893758" watchObservedRunningTime="2026-06-08 21:20:51.182149127 +0000 UTC m=+805.350162918" Jun 08 21:20:56.168317 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:56.168225 2565 generic.go:356] "Generic (PLEG): container finished" podID="d6e79356-1df5-43fb-9954-2f0269c9afec" containerID="fc239b8b6bc626de7b296a40c24fc14918541ede772122798273e36f0336d03d" exitCode=0 Jun 08 21:20:56.168317 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:56.168278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" event={"ID":"d6e79356-1df5-43fb-9954-2f0269c9afec","Type":"ContainerDied","Data":"fc239b8b6bc626de7b296a40c24fc14918541ede772122798273e36f0336d03d"} Jun 08 21:20:56.168882 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:56.168750 2565 scope.go:117] "RemoveContainer" containerID="fc239b8b6bc626de7b296a40c24fc14918541ede772122798273e36f0336d03d" Jun 08 21:20:56.169809 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:56.169777 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:20:56.169909 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:56.169861 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:20:56.169982 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:56.169909 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:20:57.145761 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:57.145728 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-89b7cc898-sjj2r" Jun 08 21:20:57.178103 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:57.178062 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" event={"ID":"d6e79356-1df5-43fb-9954-2f0269c9afec","Type":"ContainerStarted","Data":"40ac4e8aa7c3258b7aa9411d3b2ad8945f925b81a15e3bd8b7f424d86702d67a"} Jun 08 21:20:57.532068 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:57.532003 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:20:57.533433 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:57.533405 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-m8vb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 08 21:20:57.533556 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:57.533460 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" podUID="d6e79356-1df5-43fb-9954-2f0269c9afec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 08 21:20:58.302474 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:58.302434 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:20:58.531871 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:58.531836 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-m8vb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 08 21:20:58.532087 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:58.531904 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" podUID="d6e79356-1df5-43fb-9954-2f0269c9afec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 08 21:20:58.972406 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:58.972362 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:20:58.972617 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:58.972587 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" containerID="cri-o://b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589" gracePeriod=30 Jun 08 21:20:59.531729 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:59.531684 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-m8vb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 08 21:20:59.532240 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:20:59.531761 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" podUID="d6e79356-1df5-43fb-9954-2f0269c9afec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 08 21:21:00.532423 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:00.532387 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-m8vb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 08 21:21:00.532790 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:00.532441 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" podUID="d6e79356-1df5-43fb-9954-2f0269c9afec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 08 21:21:00.668764 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:00.668690 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:00.701161 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:00.701128 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8cdn\" (UniqueName: \"kubernetes.io/projected/56528794-4864-42fa-8745-6c44432e0346-kube-api-access-s8cdn\") pod \"56528794-4864-42fa-8745-6c44432e0346\" (UID: \"56528794-4864-42fa-8745-6c44432e0346\") " Jun 08 21:21:00.703473 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:00.703446 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56528794-4864-42fa-8745-6c44432e0346-kube-api-access-s8cdn" (OuterVolumeSpecName: "kube-api-access-s8cdn") pod "56528794-4864-42fa-8745-6c44432e0346" (UID: "56528794-4864-42fa-8745-6c44432e0346"). InnerVolumeSpecName "kube-api-access-s8cdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:21:00.802230 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:00.802193 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8cdn\" (UniqueName: \"kubernetes.io/projected/56528794-4864-42fa-8745-6c44432e0346-kube-api-access-s8cdn\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:21:01.202439 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.202399 2565 generic.go:356] "Generic (PLEG): container finished" podID="56528794-4864-42fa-8745-6c44432e0346" containerID="b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589" exitCode=143 Jun 08 21:21:01.202614 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.202457 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"56528794-4864-42fa-8745-6c44432e0346","Type":"ContainerDied","Data":"b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589"} Jun 08 21:21:01.202614 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.202463 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.202614 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.202537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"56528794-4864-42fa-8745-6c44432e0346","Type":"ContainerDied","Data":"afef98478f6a3049f980c1c94651fea12619a0e90d6a8c04bcbf75890e54200c"} Jun 08 21:21:01.202614 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.202565 2565 scope.go:117] "RemoveContainer" containerID="b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589" Jun 08 21:21:01.213608 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.213584 2565 scope.go:117] "RemoveContainer" containerID="b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589" Jun 08 21:21:01.213896 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:21:01.213875 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589\": container with ID starting with b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589 not found: ID does not exist" containerID="b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589" Jun 08 21:21:01.213955 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.213903 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589"} err="failed to get container status \"b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589\": rpc error: code = NotFound desc = could not find container \"b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589\": container with ID starting with b9cf8f3be4cd20c14d1cbb2ee7f1ffe7a0757ec889b21c920c1ebd59cfd47589 not found: ID does not exist" Jun 08 21:21:01.226063 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.226035 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:21:01.229648 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.229627 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:21:01.252652 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.252605 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:21:01.253325 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.253298 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" Jun 08 21:21:01.253325 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.253327 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" Jun 08 21:21:01.253499 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.253451 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="56528794-4864-42fa-8745-6c44432e0346" containerName="keycloak" Jun 08 21:21:01.259648 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.259609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.262168 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.262139 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2ln4v\"" Jun 08 21:21:01.262434 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.262413 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 21:21:01.262527 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.262469 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 21:21:01.262587 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.262412 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 21:21:01.262907 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.262755 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 21:21:01.267209 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.267184 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:21:01.307397 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.307354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/38346194-7998-4570-a413-b350e99cffb2-test-realms\") pod \"maas-keycloak-0\" (UID: \"38346194-7998-4570-a413-b350e99cffb2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.307568 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.307423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djqs6\" (UniqueName: \"kubernetes.io/projected/38346194-7998-4570-a413-b350e99cffb2-kube-api-access-djqs6\") pod \"maas-keycloak-0\" (UID: \"38346194-7998-4570-a413-b350e99cffb2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.408629 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.408580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djqs6\" (UniqueName: \"kubernetes.io/projected/38346194-7998-4570-a413-b350e99cffb2-kube-api-access-djqs6\") pod \"maas-keycloak-0\" (UID: \"38346194-7998-4570-a413-b350e99cffb2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.408837 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.408735 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/38346194-7998-4570-a413-b350e99cffb2-test-realms\") pod \"maas-keycloak-0\" (UID: \"38346194-7998-4570-a413-b350e99cffb2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.409479 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.409460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/38346194-7998-4570-a413-b350e99cffb2-test-realms\") pod \"maas-keycloak-0\" (UID: \"38346194-7998-4570-a413-b350e99cffb2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.418050 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.417993 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djqs6\" (UniqueName: \"kubernetes.io/projected/38346194-7998-4570-a413-b350e99cffb2-kube-api-access-djqs6\") pod \"maas-keycloak-0\" (UID: \"38346194-7998-4570-a413-b350e99cffb2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.541970 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.541891 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:21:01.542896 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.542873 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-m8vb8" Jun 08 21:21:01.573736 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.573702 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:01.723326 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:01.723298 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:21:01.725426 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:21:01.725403 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38346194_7998_4570_a413_b350e99cffb2.slice/crio-465e0d3890c13c9e61339f9b04242960211c6e0d47aa87eec2451ea8a0ec5ed3 WatchSource:0}: Error finding container 465e0d3890c13c9e61339f9b04242960211c6e0d47aa87eec2451ea8a0ec5ed3: Status 404 returned error can't find the container with id 465e0d3890c13c9e61339f9b04242960211c6e0d47aa87eec2451ea8a0ec5ed3 Jun 08 21:21:02.211783 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:02.211741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"38346194-7998-4570-a413-b350e99cffb2","Type":"ContainerStarted","Data":"465e0d3890c13c9e61339f9b04242960211c6e0d47aa87eec2451ea8a0ec5ed3"} Jun 08 21:21:02.310232 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:02.310150 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56528794-4864-42fa-8745-6c44432e0346" path="/var/lib/kubelet/pods/56528794-4864-42fa-8745-6c44432e0346/volumes" Jun 08 21:21:02.351973 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:21:02.351928 2565 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/keycloak/keycloak:26.6.3" Jun 08 21:21:02.352200 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:21:02.352099 2565 kuberuntime_manager.go:1459] "Unhandled Error" err="container keycloak start failed in pod maas-keycloak-0_keycloak-system(38346194-7998-4570-a413-b350e99cffb2): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jun 08 21:21:02.352270 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:21:02.352192 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"keycloak\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" Jun 08 21:21:03.148609 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:03.148577 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-62pm2" Jun 08 21:21:03.218115 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:21:03.218071 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"keycloak\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/keycloak/keycloak:26.6.3\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" Jun 08 21:21:17.303454 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:17.303408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"38346194-7998-4570-a413-b350e99cffb2","Type":"ContainerStarted","Data":"f617d2c95a20f857fe181b43acba5190d5a93a5ca5214db5e16f720e0419ee41"} Jun 08 21:21:17.321538 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:17.321476 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.448969973 podStartE2EDuration="16.321454602s" totalImagesPullingTime="14.872484629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-06-08 21:21:17.320284972 +0000 UTC m=+831.488298763" watchObservedRunningTime="2026-06-08 21:21:17.321454602 +0000 UTC m=+831.489468395" Jun 08 21:21:17.574854 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:17.574752 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:17.576602 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:17.576559 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:18.575030 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:18.574960 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:19.574827 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:19.574369 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:20.574428 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:20.574374 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:21.574324 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:21.574269 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:21.574682 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:21.574643 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:22.574636 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:22.574580 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:23.575175 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:23.575118 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:24.575040 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:24.574959 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:25.574457 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:25.574410 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:26.574861 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:26.574808 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:27.575089 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:27.574997 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:28.574996 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:28.574936 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:29.575162 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:29.575106 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 08 21:21:30.712180 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:30.712132 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:30.730936 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:30.730862 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="38346194-7998-4570-a413-b350e99cffb2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:21:40.718198 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:40.718147 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 21:21:47.785471 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:47.785433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:21:52.941099 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:52.941051 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67b8db4fd9-vmzpp"] Jun 08 21:21:52.941518 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:52.941368 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" podUID="847c0b44-9027-44e9-946b-38b1886ae4b9" containerName="authorino" containerID="cri-o://b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de" gracePeriod=30 Jun 08 21:21:53.207999 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.207959 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:21:53.333330 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.333295 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/847c0b44-9027-44e9-946b-38b1886ae4b9-tls-cert\") pod \"847c0b44-9027-44e9-946b-38b1886ae4b9\" (UID: \"847c0b44-9027-44e9-946b-38b1886ae4b9\") " Jun 08 21:21:53.333330 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.333334 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9j92\" (UniqueName: \"kubernetes.io/projected/847c0b44-9027-44e9-946b-38b1886ae4b9-kube-api-access-x9j92\") pod \"847c0b44-9027-44e9-946b-38b1886ae4b9\" (UID: \"847c0b44-9027-44e9-946b-38b1886ae4b9\") " Jun 08 21:21:53.335853 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.335819 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847c0b44-9027-44e9-946b-38b1886ae4b9-kube-api-access-x9j92" (OuterVolumeSpecName: "kube-api-access-x9j92") pod "847c0b44-9027-44e9-946b-38b1886ae4b9" (UID: "847c0b44-9027-44e9-946b-38b1886ae4b9"). InnerVolumeSpecName "kube-api-access-x9j92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:21:53.344497 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.344476 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847c0b44-9027-44e9-946b-38b1886ae4b9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "847c0b44-9027-44e9-946b-38b1886ae4b9" (UID: "847c0b44-9027-44e9-946b-38b1886ae4b9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:21:53.434917 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.434883 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/847c0b44-9027-44e9-946b-38b1886ae4b9-tls-cert\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:21:53.434917 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.434911 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9j92\" (UniqueName: \"kubernetes.io/projected/847c0b44-9027-44e9-946b-38b1886ae4b9-kube-api-access-x9j92\") on node \"ip-10-0-140-214.ec2.internal\" DevicePath \"\"" Jun 08 21:21:53.462203 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.462089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:21:53.565600 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.565571 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:21:53.571121 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.571090 2565 generic.go:356] "Generic (PLEG): container finished" podID="847c0b44-9027-44e9-946b-38b1886ae4b9" containerID="b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de" exitCode=0 Jun 08 21:21:53.571270 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.571132 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" Jun 08 21:21:53.571270 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.571132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" event={"ID":"847c0b44-9027-44e9-946b-38b1886ae4b9","Type":"ContainerDied","Data":"b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de"} Jun 08 21:21:53.571270 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.571232 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b8db4fd9-vmzpp" event={"ID":"847c0b44-9027-44e9-946b-38b1886ae4b9","Type":"ContainerDied","Data":"78c4a0be17e30e27a6805149b89b41058fd3d9c630e94dddb09dbbd98cac9019"} Jun 08 21:21:53.571270 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.571250 2565 scope.go:117] "RemoveContainer" containerID="b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de" Jun 08 21:21:53.585232 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.581361 2565 scope.go:117] "RemoveContainer" containerID="b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de" Jun 08 21:21:53.585232 ip-10-0-140-214 kubenswrapper[2565]: E0608 21:21:53.581746 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de\": container with ID starting with b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de not found: ID does not exist" containerID="b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de" Jun 08 21:21:53.585232 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.581785 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de"} err="failed to get container status \"b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de\": rpc error: code = NotFound desc = could not find container \"b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de\": container with ID starting with b7790612e92aa3e05e6f48b90eb90d3deff19aebfe94ed97b9121ea0d062a6de not found: ID does not exist" Jun 08 21:21:53.593477 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.593452 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67b8db4fd9-vmzpp"] Jun 08 21:21:53.597475 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:53.597454 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67b8db4fd9-vmzpp"] Jun 08 21:21:54.311188 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:54.311158 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847c0b44-9027-44e9-946b-38b1886ae4b9" path="/var/lib/kubelet/pods/847c0b44-9027-44e9-946b-38b1886ae4b9/volumes" Jun 08 21:21:59.578312 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.578275 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr"] Jun 08 21:21:59.578777 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.578707 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847c0b44-9027-44e9-946b-38b1886ae4b9" containerName="authorino" Jun 08 21:21:59.578777 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.578719 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="847c0b44-9027-44e9-946b-38b1886ae4b9" containerName="authorino" Jun 08 21:21:59.578869 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.578785 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="847c0b44-9027-44e9-946b-38b1886ae4b9" containerName="authorino" Jun 08 21:21:59.583618 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.583598 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.592744 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.592715 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6t2zd\"" Jun 08 21:21:59.592884 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.592716 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 21:21:59.592884 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.592718 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 21:21:59.593407 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.593386 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 21:21:59.621396 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.621364 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr"] Jun 08 21:21:59.679062 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.679005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:21:59.691770 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.691741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.691946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.691780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.691946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.691802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.691946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.691901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48xf9\" (UniqueName: \"kubernetes.io/projected/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-kube-api-access-48xf9\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.691946 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.691920 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.692125 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.691998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.792992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.793078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793352 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.793099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793352 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.793146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48xf9\" (UniqueName: \"kubernetes.io/projected/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-kube-api-access-48xf9\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793352 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.793162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793352 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.793216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793627 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.793603 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793690 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.793654 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.793737 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.793688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.795601 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.795582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.795768 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.795748 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.805920 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.805889 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48xf9\" (UniqueName: \"kubernetes.io/projected/d3d4bd4a-3cf2-4bd1-a9f8-97516107d474-kube-api-access-48xf9\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr\" (UID: \"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:21:59.894188 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:21:59.894098 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:22:00.061152 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:22:00.061121 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d4bd4a_3cf2_4bd1_a9f8_97516107d474.slice/crio-fd95731228c04d26e4c4efc9f620cd627bc51921565f1dfefbddc90bff72137c WatchSource:0}: Error finding container fd95731228c04d26e4c4efc9f620cd627bc51921565f1dfefbddc90bff72137c: Status 404 returned error can't find the container with id fd95731228c04d26e4c4efc9f620cd627bc51921565f1dfefbddc90bff72137c Jun 08 21:22:00.061589 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:00.061508 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr"] Jun 08 21:22:00.617513 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:00.617468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" event={"ID":"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474","Type":"ContainerStarted","Data":"fd95731228c04d26e4c4efc9f620cd627bc51921565f1dfefbddc90bff72137c"} Jun 08 21:22:03.422249 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.422212 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb"] Jun 08 21:22:03.440110 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.440078 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb"] Jun 08 21:22:03.440279 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.440153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.443820 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.443770 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 21:22:03.444132 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.444100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:22:03.527961 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.527898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.527961 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.527949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/235acdab-469c-4170-b73a-676b58d0de11-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.528311 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.527996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnn8\" (UniqueName: \"kubernetes.io/projected/235acdab-469c-4170-b73a-676b58d0de11-kube-api-access-7gnn8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.528311 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.528096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.528311 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.528204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.528311 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.528300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.629035 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.628963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.629228 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.629064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.629228 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.629145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.629228 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.629170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/235acdab-469c-4170-b73a-676b58d0de11-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.629228 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.629196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnn8\" (UniqueName: \"kubernetes.io/projected/235acdab-469c-4170-b73a-676b58d0de11-kube-api-access-7gnn8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.629474 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.629230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.629532 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.629479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.629816 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.629789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.630085 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.630064 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.631875 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.631848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/235acdab-469c-4170-b73a-676b58d0de11-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.632241 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.632219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/235acdab-469c-4170-b73a-676b58d0de11-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.638697 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.638663 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnn8\" (UniqueName: \"kubernetes.io/projected/235acdab-469c-4170-b73a-676b58d0de11-kube-api-access-7gnn8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xxppb\" (UID: \"235acdab-469c-4170-b73a-676b58d0de11\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:03.753776 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:03.753734 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:04.442110 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:04.442081 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb"] Jun 08 21:22:04.648066 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:04.647957 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" event={"ID":"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474","Type":"ContainerStarted","Data":"68603631cb245bd9e58f24bcf32e628346b46d86b22038901255fadc5d7c3f27"} Jun 08 21:22:04.649790 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:04.649742 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" event={"ID":"235acdab-469c-4170-b73a-676b58d0de11","Type":"ContainerStarted","Data":"4b5ce1feb96526ab9046b7e61cb6c6a0e301c93e18ea8700d2b3fd414a3fe8ac"} Jun 08 21:22:04.649945 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:04.649811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" event={"ID":"235acdab-469c-4170-b73a-676b58d0de11","Type":"ContainerStarted","Data":"75caa92a31895075294ec7fd6cfc62de67e708d3953fcef419618262a9dd926c"} Jun 08 21:22:06.662905 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:06.662871 2565 generic.go:356] "Generic (PLEG): container finished" podID="235acdab-469c-4170-b73a-676b58d0de11" containerID="4b5ce1feb96526ab9046b7e61cb6c6a0e301c93e18ea8700d2b3fd414a3fe8ac" exitCode=0 Jun 08 21:22:06.663321 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:06.662944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" event={"ID":"235acdab-469c-4170-b73a-676b58d0de11","Type":"ContainerDied","Data":"4b5ce1feb96526ab9046b7e61cb6c6a0e301c93e18ea8700d2b3fd414a3fe8ac"} Jun 08 21:22:06.664789 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:06.664767 2565 generic.go:356] "Generic (PLEG): container finished" podID="d3d4bd4a-3cf2-4bd1-a9f8-97516107d474" containerID="68603631cb245bd9e58f24bcf32e628346b46d86b22038901255fadc5d7c3f27" exitCode=0 Jun 08 21:22:06.664875 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:06.664804 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" event={"ID":"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474","Type":"ContainerDied","Data":"68603631cb245bd9e58f24bcf32e628346b46d86b22038901255fadc5d7c3f27"} Jun 08 21:22:08.678786 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:08.678749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" event={"ID":"d3d4bd4a-3cf2-4bd1-a9f8-97516107d474","Type":"ContainerStarted","Data":"dc4767291302bd24e443e1d1ccf2f9a964c424c2aa59bb3b826a33ee1288c27f"} Jun 08 21:22:08.680526 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:08.680503 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" event={"ID":"235acdab-469c-4170-b73a-676b58d0de11","Type":"ContainerStarted","Data":"f31a7d7867a21fbd5dae8b60a897ecb33cb14473dd6e4d050ed9afa88dc96704"} Jun 08 21:22:08.697899 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:08.697855 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" podStartSLOduration=2.877153304 podStartE2EDuration="9.697839933s" totalImagesPullingTime="5.553452727s" totalInitContainerRuntime="1.267233902s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:21:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:08.696847599 +0000 UTC m=+882.864861392" watchObservedRunningTime="2026-06-08 21:22:08.697839933 +0000 UTC m=+882.865853725" Jun 08 21:22:08.714875 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:08.714816 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" podStartSLOduration=3.08379011 podStartE2EDuration="5.714797993s" totalImagesPullingTime="1.268280092s" totalInitContainerRuntime="1.362727791s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:08.713355559 +0000 UTC m=+882.881369370" watchObservedRunningTime="2026-06-08 21:22:08.714797993 +0000 UTC m=+882.882811803" Jun 08 21:22:09.894858 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:09.894750 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:22:09.894858 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:09.894831 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:22:09.907781 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:09.907748 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:22:10.710775 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:10.710741 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr" Jun 08 21:22:13.754159 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:13.754116 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:13.754548 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:13.754191 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:13.766638 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:13.766616 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:14.729219 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:14.729190 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xxppb" Jun 08 21:22:14.808725 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:14.808692 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:22:26.346085 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:26.346051 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:22:26.346538 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:26.346131 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:22:27.858058 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.857990 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb"] Jun 08 21:22:27.872660 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.872630 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb"] Jun 08 21:22:27.872832 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.872749 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:27.876526 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.876504 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 21:22:27.896144 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.896114 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:22:27.968957 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.968921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcca97e4-82ed-449b-8259-f25f8ad7b376-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:27.969153 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.968968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:27.969153 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.968997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:27.969153 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.969046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:27.969153 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.969069 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:27.969153 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:27.969132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5sls\" (UniqueName: \"kubernetes.io/projected/fcca97e4-82ed-449b-8259-f25f8ad7b376-kube-api-access-d5sls\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070003 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.069965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070003 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.070001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070257 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.070045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070257 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.070099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5sls\" (UniqueName: \"kubernetes.io/projected/fcca97e4-82ed-449b-8259-f25f8ad7b376-kube-api-access-d5sls\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070257 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.070184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcca97e4-82ed-449b-8259-f25f8ad7b376-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070257 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.070226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070469 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.070385 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070469 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.070449 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.070574 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.070514 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.072614 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.072597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcca97e4-82ed-449b-8259-f25f8ad7b376-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.072870 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.072852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcca97e4-82ed-449b-8259-f25f8ad7b376-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.078863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.078837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5sls\" (UniqueName: \"kubernetes.io/projected/fcca97e4-82ed-449b-8259-f25f8ad7b376-kube-api-access-d5sls\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb\" (UID: \"fcca97e4-82ed-449b-8259-f25f8ad7b376\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.183977 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.183936 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:28.325135 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.325107 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb"] Jun 08 21:22:28.326305 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.326279 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:22:28.326719 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:22:28.326694 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcca97e4_82ed_449b_8259_f25f8ad7b376.slice/crio-dd2717c149883980f30b6de3ed2bc687d32242ef928f922313f4d639be536a1e WatchSource:0}: Error finding container dd2717c149883980f30b6de3ed2bc687d32242ef928f922313f4d639be536a1e: Status 404 returned error can't find the container with id dd2717c149883980f30b6de3ed2bc687d32242ef928f922313f4d639be536a1e Jun 08 21:22:28.807631 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.807599 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" event={"ID":"fcca97e4-82ed-449b-8259-f25f8ad7b376","Type":"ContainerStarted","Data":"2ce727b57e5e9316d8385e5de07f4d1185be1afc8126abf6338fa15b8f1fdd76"} Jun 08 21:22:28.807805 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:28.807652 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" event={"ID":"fcca97e4-82ed-449b-8259-f25f8ad7b376","Type":"ContainerStarted","Data":"dd2717c149883980f30b6de3ed2bc687d32242ef928f922313f4d639be536a1e"} Jun 08 21:22:29.292457 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:29.292424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:22:29.815472 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:29.815442 2565 generic.go:356] "Generic (PLEG): container finished" podID="fcca97e4-82ed-449b-8259-f25f8ad7b376" containerID="2ce727b57e5e9316d8385e5de07f4d1185be1afc8126abf6338fa15b8f1fdd76" exitCode=0 Jun 08 21:22:29.815640 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:29.815508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" event={"ID":"fcca97e4-82ed-449b-8259-f25f8ad7b376","Type":"ContainerDied","Data":"2ce727b57e5e9316d8385e5de07f4d1185be1afc8126abf6338fa15b8f1fdd76"} Jun 08 21:22:30.823421 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:30.823387 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" event={"ID":"fcca97e4-82ed-449b-8259-f25f8ad7b376","Type":"ContainerStarted","Data":"3078789b764b25677f2f7fe85eb57ccecfa0ad95f1f118b1f15de4f1b2bb21c6"} Jun 08 21:22:30.847292 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:30.847225 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" podStartSLOduration=2.422577837 podStartE2EDuration="3.847208712s" totalImagesPullingTime="187.954817ms" totalInitContainerRuntime="1.236676058s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:30.844213388 +0000 UTC m=+905.012227182" watchObservedRunningTime="2026-06-08 21:22:30.847208712 +0000 UTC m=+905.015222505" Jun 08 21:22:38.184347 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:38.184304 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:38.184790 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:38.184418 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:38.196969 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:38.196946 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:38.882335 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:38.882304 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb" Jun 08 21:22:47.399127 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:47.399089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:22:54.073999 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:22:54.073961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:24:18.408611 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:18.408571 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:24:36.314010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:36.313972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:24:36.443701 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:36.443663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:24:37.458698 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:37.458659 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:24:37.557735 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:37.557685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:24:56.575666 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:56.575638 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5878f5f596-kpmms_4f74e1e0-31b2-4144-8846-5225410e748b/nginx/0.log" Jun 08 21:24:56.930045 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:56.929985 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dccdbd7b5-ljp29_5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d/manager/0.log" Jun 08 21:24:57.398742 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:57.398659 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598c8c4df5-c55jp_0e093d31-99c6-4867-900c-584663afe490/copy-manifests/0.log" Jun 08 21:24:57.406536 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:57.406488 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598c8c4df5-c55jp_0e093d31-99c6-4867-900c-584663afe490/manager/0.log" Jun 08 21:24:58.306010 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.305970 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv_0b3637e8-70cc-4028-b2fa-ace3debf7836/pull/0.log" Jun 08 21:24:58.313480 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.313456 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv_0b3637e8-70cc-4028-b2fa-ace3debf7836/extract/0.log" Jun 08 21:24:58.319861 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.319846 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv_0b3637e8-70cc-4028-b2fa-ace3debf7836/util/0.log" Jun 08 21:24:58.433928 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.433899 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz_a6671bb8-7784-43f4-b4aa-2261d1fb2811/pull/0.log" Jun 08 21:24:58.440779 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.440751 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz_a6671bb8-7784-43f4-b4aa-2261d1fb2811/extract/0.log" Jun 08 21:24:58.446848 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.446829 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz_a6671bb8-7784-43f4-b4aa-2261d1fb2811/util/0.log" Jun 08 21:24:58.558808 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.558728 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt_7395b14f-439e-4619-852e-4a2adf7d6a0a/util/0.log" Jun 08 21:24:58.565271 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.565245 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt_7395b14f-439e-4619-852e-4a2adf7d6a0a/pull/0.log" Jun 08 21:24:58.571199 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.571174 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt_7395b14f-439e-4619-852e-4a2adf7d6a0a/extract/0.log" Jun 08 21:24:58.683487 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.683463 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq_a05787fa-b84b-4097-9580-9d5adb1ae8a7/util/0.log" Jun 08 21:24:58.691434 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.691403 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq_a05787fa-b84b-4097-9580-9d5adb1ae8a7/pull/0.log" Jun 08 21:24:58.701232 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:58.701212 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq_a05787fa-b84b-4097-9580-9d5adb1ae8a7/extract/0.log" Jun 08 21:24:59.071548 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:59.071520 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-857d4_d9813419-4172-4195-91cb-19c7a5c7249f/manager/0.log" Jun 08 21:24:59.303616 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:59.303583 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9gfk5_3c9d1b92-2c54-464a-a7dd-a1f8f5841164/registry-server/0.log" Jun 08 21:24:59.437355 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:59.437328 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lr5hl_039b6fe3-33e8-4d07-aa92-937007516f2a/manager/0.log" Jun 08 21:24:59.670678 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:24:59.670652 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n7njk_aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81/manager/0.log" Jun 08 21:25:00.027130 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:00.027097 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956zpp4_ba558b9e-9bfe-43cd-b7a4-67fe2ad64658/istio-proxy/0.log" Jun 08 21:25:00.494655 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:00.494622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/1.log" Jun 08 21:25:00.611739 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:00.611708 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-62pm2_f53badbb-5edf-4b3a-a3fd-d01c948a530c/payload-pre-processing/0.log" Jun 08 21:25:01.193727 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:01.193688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr_d3d4bd4a-3cf2-4bd1-a9f8-97516107d474/storage-initializer/0.log" Jun 08 21:25:01.202135 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:01.202105 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vmtqr_d3d4bd4a-3cf2-4bd1-a9f8-97516107d474/main/0.log" Jun 08 21:25:01.314213 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:01.314185 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-xxppb_235acdab-469c-4170-b73a-676b58d0de11/storage-initializer/0.log" Jun 08 21:25:01.322425 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:01.322400 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-xxppb_235acdab-469c-4170-b73a-676b58d0de11/main/0.log" Jun 08 21:25:01.553456 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:01.553369 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb_fcca97e4-82ed-449b-8259-f25f8ad7b376/storage-initializer/0.log" Jun 08 21:25:01.561608 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:01.561581 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c9n8wb_fcca97e4-82ed-449b-8259-f25f8ad7b376/main/0.log" Jun 08 21:25:06.116950 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:06.116905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:25:06.214969 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:06.214930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:25:07.614156 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:07.614127 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:25:08.944364 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:08.944334 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-46vwd_e94c4dc5-924d-44f5-a92a-e0a5ba7a7a57/global-pull-secret-syncer/0.log" Jun 08 21:25:09.071300 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:09.071267 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" Jun 08 21:25:09.181635 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:09.181601 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-214.ec2.internal_22d19728a6b30ba594ad5947a1e84ee3/haproxy/0.log" Jun 08 21:25:13.858190 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:13.858150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv_0b3637e8-70cc-4028-b2fa-ace3debf7836/extract/0.log" Jun 08 21:25:13.880370 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:13.880341 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv_0b3637e8-70cc-4028-b2fa-ace3debf7836/util/0.log" Jun 08 21:25:13.906799 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:13.906755 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hjknv_0b3637e8-70cc-4028-b2fa-ace3debf7836/pull/0.log" Jun 08 21:25:13.940802 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:13.940775 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz_a6671bb8-7784-43f4-b4aa-2261d1fb2811/extract/0.log" Jun 08 21:25:13.962900 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:13.962845 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz_a6671bb8-7784-43f4-b4aa-2261d1fb2811/util/0.log" Jun 08 21:25:13.983504 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:13.983475 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s47zz_a6671bb8-7784-43f4-b4aa-2261d1fb2811/pull/0.log" Jun 08 21:25:14.008505 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.008472 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt_7395b14f-439e-4619-852e-4a2adf7d6a0a/extract/0.log" Jun 08 21:25:14.030037 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.029825 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt_7395b14f-439e-4619-852e-4a2adf7d6a0a/util/0.log" Jun 08 21:25:14.056755 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.056724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wznqt_7395b14f-439e-4619-852e-4a2adf7d6a0a/pull/0.log" Jun 08 21:25:14.082976 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.082943 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq_a05787fa-b84b-4097-9580-9d5adb1ae8a7/extract/0.log" Jun 08 21:25:14.114999 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.114921 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq_a05787fa-b84b-4097-9580-9d5adb1ae8a7/util/0.log" Jun 08 21:25:14.137002 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.136970 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zsrq_a05787fa-b84b-4097-9580-9d5adb1ae8a7/pull/0.log" Jun 08 21:25:14.224065 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.224035 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-857d4_d9813419-4172-4195-91cb-19c7a5c7249f/manager/0.log" Jun 08 21:25:14.282830 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.282792 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9gfk5_3c9d1b92-2c54-464a-a7dd-a1f8f5841164/registry-server/0.log" Jun 08 21:25:14.333306 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.333273 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lr5hl_039b6fe3-33e8-4d07-aa92-937007516f2a/manager/0.log" Jun 08 21:25:14.382879 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.382798 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n7njk_aaeca6dc-15fd-4a69-9a79-2a1e0e09ac81/manager/0.log" Jun 08 21:25:14.517052 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:14.516990 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4x86_6180f8ea-7395-4556-9699-7c1c127d1c67/konnectivity-agent/0.log" limit=1024 Jun 08 21:25:16.178863 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:16.178829 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-f6blw_94072c29-45ee-463d-9cb0-8e87481d5c49/cluster-monitoring-operator/0.log" Jun 08 21:25:16.330483 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:16.330449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-2ftxx_919c0b2d-06f7-4776-9c6c-6024de7d5b3d/monitoring-plugin/0.log" Jun 08 21:25:16.444069 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:16.443951 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbjqs_55d0b667-787d-4b7c-ad0d-386dc89a0f32/node-exporter/0.log" Jun 08 21:25:16.467486 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:16.467435 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbjqs_55d0b667-787d-4b7c-ad0d-386dc89a0f32/kube-rbac-proxy/0.log" Jun 08 21:25:16.491234 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:16.491211 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbjqs_55d0b667-787d-4b7c-ad0d-386dc89a0f32/init-textfile/0.log" Jun 08 21:25:16.610699 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:16.610672 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwm27_0c312f9e-8e77-4707-965e-d913d3ae55ab/kube-rbac-proxy-main/0.log" Jun 08 21:25:16.634042 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:16.633996 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwm27_0c312f9e-8e77-4707-965e-d913d3ae55ab/kube-rbac-proxy-self/0.log" Jun 08 21:25:16.658718 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:16.658684 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zwm27_0c312f9e-8e77-4707-965e-d913d3ae55ab/openshift-state-metrics/0.log" Jun 08 21:25:17.095470 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:17.095444 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/thanos-query/0.log" Jun 08 21:25:17.118397 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:17.118368 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/kube-rbac-proxy-web/0.log" Jun 08 21:25:17.151217 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:17.151140 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/kube-rbac-proxy/0.log" Jun 08 21:25:17.178862 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:17.178839 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/prom-label-proxy/0.log" Jun 08 21:25:17.210785 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:17.210740 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/kube-rbac-proxy-rules/0.log" Jun 08 21:25:17.234339 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:17.234315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ccd54c4bb-jkzvn_ae186360-2d66-4a37-96ff-cad8b84462af/kube-rbac-proxy-metrics/0.log" Jun 08 21:25:18.758688 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:18.758654 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-gc672_7c3fd102-2650-4e0d-909e-6bce6446cbee/networking-console-plugin/0.log" Jun 08 21:25:19.940158 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:19.940124 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5479557688-295cq_e01c725c-94ba-43d2-8ffd-b9148ae749ee/console/0.log" Jun 08 21:25:19.973936 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:19.973908 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-8v5wv_d1f4c12f-65f4-4454-976d-2efb2834a35a/download-server/0.log" Jun 08 21:25:20.580234 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.580195 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb"] Jun 08 21:25:20.583751 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.583731 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.586373 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.586351 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6lpfs\"/\"kube-root-ca.crt\"" Jun 08 21:25:20.587268 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.587247 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6lpfs\"/\"default-dockercfg-99bb6\"" Jun 08 21:25:20.587399 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.587272 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6lpfs\"/\"openshift-service-ca.crt\"" Jun 08 21:25:20.593110 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.593079 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb"] Jun 08 21:25:20.682854 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.682821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xk4c\" (UniqueName: \"kubernetes.io/projected/86cb3d29-28e7-4f71-921d-a58bd5a852fc-kube-api-access-7xk4c\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.683066 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.682864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-sys\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.683066 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.683046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-lib-modules\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.683174 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.683101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-proc\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.683174 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.683123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-podres\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784164 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-lib-modules\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-proc\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-podres\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xk4c\" (UniqueName: \"kubernetes.io/projected/86cb3d29-28e7-4f71-921d-a58bd5a852fc-kube-api-access-7xk4c\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-sys\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784267 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-proc\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-lib-modules\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784350 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-sys\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.784681 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.784384 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86cb3d29-28e7-4f71-921d-a58bd5a852fc-podres\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.792340 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.792307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xk4c\" (UniqueName: \"kubernetes.io/projected/86cb3d29-28e7-4f71-921d-a58bd5a852fc-kube-api-access-7xk4c\") pod \"perf-node-gather-daemonset-dgrwb\" (UID: \"86cb3d29-28e7-4f71-921d-a58bd5a852fc\") " pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:20.895629 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:20.895543 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:21.036388 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:21.036356 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb"] Jun 08 21:25:21.038132 ip-10-0-140-214 kubenswrapper[2565]: W0608 21:25:21.038105 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod86cb3d29_28e7_4f71_921d_a58bd5a852fc.slice/crio-6ec46263a86f5317992700b00020097994ccd8fd6fea762446dec4e5e545d7fe WatchSource:0}: Error finding container 6ec46263a86f5317992700b00020097994ccd8fd6fea762446dec4e5e545d7fe: Status 404 returned error can't find the container with id 6ec46263a86f5317992700b00020097994ccd8fd6fea762446dec4e5e545d7fe Jun 08 21:25:21.855091 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:21.855046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" event={"ID":"86cb3d29-28e7-4f71-921d-a58bd5a852fc","Type":"ContainerStarted","Data":"d51a69e8bd710f6af3121f3b38d98ddbd19a9cf394f351d20ba737ede4d67add"} Jun 08 21:25:21.855265 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:21.855215 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:21.855265 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:21.855255 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" event={"ID":"86cb3d29-28e7-4f71-921d-a58bd5a852fc","Type":"ContainerStarted","Data":"6ec46263a86f5317992700b00020097994ccd8fd6fea762446dec4e5e545d7fe"} Jun 08 21:25:21.871587 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:21.871540 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" podStartSLOduration=1.87152575 podStartE2EDuration="1.87152575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:25:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:25:21.870359833 +0000 UTC m=+1076.038373636" watchObservedRunningTime="2026-06-08 21:25:21.87152575 +0000 UTC m=+1076.039539542" Jun 08 21:25:21.887610 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:21.887585 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4wmk_27b38eb9-0c8a-4b0a-914d-8bdb328df801/dns/0.log" Jun 08 21:25:21.908617 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:21.908567 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4wmk_27b38eb9-0c8a-4b0a-914d-8bdb328df801/kube-rbac-proxy/0.log" Jun 08 21:25:22.025008 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:22.024979 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7hxfk_e55a22b3-abfb-47dd-a1ca-573d521c3352/dns-node-resolver/0.log" Jun 08 21:25:22.609191 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:22.609162 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54f4658f85-fbljc_1500bf9f-4aad-4f5f-8e21-594bce1f3733/registry/0.log" Jun 08 21:25:22.615306 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:22.615277 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54f4658f85-fbljc_1500bf9f-4aad-4f5f-8e21-594bce1f3733/registry/1.log" Jun 08 21:25:22.683883 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:22.683853 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzngq_f22e0f0a-0cdc-4c1d-a852-408d98572076/node-ca/0.log" Jun 08 21:25:23.598266 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:23.598228 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956zpp4_ba558b9e-9bfe-43cd-b7a4-67fe2ad64658/istio-proxy/0.log" Jun 08 21:25:23.714898 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:23.714866 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/0.log" Jun 08 21:25:23.716890 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:23.716848 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/1.log" Jun 08 21:25:23.741636 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:23.741604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-62pm2_f53badbb-5edf-4b3a-a3fd-d01c948a530c/payload-pre-processing/0.log" Jun 08 21:25:24.432916 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:24.432879 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q5ssl_bd9ae466-e3df-4221-844f-8e25cd28ede7/serve-healthcheck-canary/0.log" Jun 08 21:25:24.936493 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:24.936465 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-nw8zc_4094b4af-2c80-4dbd-a5ac-3fdb315f4123/insights-operator/0.log" Jun 08 21:25:24.940754 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:24.940731 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-nw8zc_4094b4af-2c80-4dbd-a5ac-3fdb315f4123/insights-operator/1.log" Jun 08 21:25:24.959860 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:24.959832 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mc5w_e6875278-3171-4a21-9b08-bbafb3d90514/kube-rbac-proxy/0.log" Jun 08 21:25:24.983870 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:24.983838 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mc5w_e6875278-3171-4a21-9b08-bbafb3d90514/exporter/0.log" Jun 08 21:25:25.003962 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:25.003934 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mc5w_e6875278-3171-4a21-9b08-bbafb3d90514/extractor/0.log" Jun 08 21:25:27.318274 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:27.318240 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5878f5f596-kpmms_4f74e1e0-31b2-4144-8846-5225410e748b/nginx/0.log" Jun 08 21:25:27.401038 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:27.400995 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dccdbd7b5-ljp29_5344b0c8-13c3-47b6-ac59-eb94c2ec9e3d/manager/0.log" Jun 08 21:25:27.544132 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:27.544104 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598c8c4df5-c55jp_0e093d31-99c6-4867-900c-584663afe490/manager/0.log" Jun 08 21:25:27.564765 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:27.564737 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598c8c4df5-c55jp_0e093d31-99c6-4867-900c-584663afe490/copy-manifests/0.log" Jun 08 21:25:27.873094 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:27.873068 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6lpfs/perf-node-gather-daemonset-dgrwb" Jun 08 21:25:29.065833 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:29.065799 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d787bb96d-zj2nz_e9131756-c2fd-43df-a4d6-5eea31159c79/manager/0.log" Jun 08 21:25:34.788036 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:34.787983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956zpp4_ba558b9e-9bfe-43cd-b7a4-67fe2ad64658/istio-proxy/0.log" Jun 08 21:25:34.874251 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:34.874189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/0.log" Jun 08 21:25:34.876136 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:34.876112 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/1.log" Jun 08 21:25:34.896365 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:34.896325 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-62pm2_f53badbb-5edf-4b3a-a3fd-d01c948a530c/payload-pre-processing/0.log" Jun 08 21:25:35.381873 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:35.381841 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-hs959_b47e7973-90b3-4b1f-bcf3-f7b2eafb4414/kube-storage-version-migrator-operator/1.log" Jun 08 21:25:35.384287 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:35.384259 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-hs959_b47e7973-90b3-4b1f-bcf3-f7b2eafb4414/kube-storage-version-migrator-operator/0.log" Jun 08 21:25:36.071113 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:36.071077 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956zpp4_ba558b9e-9bfe-43cd-b7a4-67fe2ad64658/istio-proxy/0.log" Jun 08 21:25:36.173441 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:36.173396 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/0.log" Jun 08 21:25:36.175632 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:36.175599 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/1.log" Jun 08 21:25:36.192097 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:36.192067 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-62pm2_f53badbb-5edf-4b3a-a3fd-d01c948a530c/payload-pre-processing/0.log" Jun 08 21:25:36.950901 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:36.950844 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtq7c_c101ce08-965d-4659-83d6-3c891032c66d/kube-multus-additional-cni-plugins/0.log" Jun 08 21:25:36.973327 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:36.973298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtq7c_c101ce08-965d-4659-83d6-3c891032c66d/egress-router-binary-copy/0.log" Jun 08 21:25:36.994312 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:36.994281 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtq7c_c101ce08-965d-4659-83d6-3c891032c66d/cni-plugins/0.log" Jun 08 21:25:37.014727 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.014700 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtq7c_c101ce08-965d-4659-83d6-3c891032c66d/bond-cni-plugin/0.log" Jun 08 21:25:37.036466 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.036439 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtq7c_c101ce08-965d-4659-83d6-3c891032c66d/routeoverride-cni/0.log" Jun 08 21:25:37.057778 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.057751 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtq7c_c101ce08-965d-4659-83d6-3c891032c66d/whereabouts-cni-bincopy/0.log" Jun 08 21:25:37.078357 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.078327 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtq7c_c101ce08-965d-4659-83d6-3c891032c66d/whereabouts-cni/0.log" Jun 08 21:25:37.174677 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.174639 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w825h_98d4443d-5324-45b1-a390-5008f031a6d6/kube-multus/0.log" Jun 08 21:25:37.196213 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.196178 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r2bj4_f26f36a5-4005-496b-a3a6-1fd09949eeda/network-metrics-daemon/0.log" Jun 08 21:25:37.214384 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.214294 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r2bj4_f26f36a5-4005-496b-a3a6-1fd09949eeda/kube-rbac-proxy/0.log" Jun 08 21:25:37.749196 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.749163 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956zpp4_ba558b9e-9bfe-43cd-b7a4-67fe2ad64658/istio-proxy/0.log" Jun 08 21:25:37.844830 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.844790 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/0.log" Jun 08 21:25:37.846997 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.846967 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-m8vb8_d6e79356-1df5-43fb-9954-2f0269c9afec/istio-proxy/1.log" Jun 08 21:25:37.867586 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:37.865176 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-62pm2_f53badbb-5edf-4b3a-a3fd-d01c948a530c/payload-pre-processing/0.log" Jun 08 21:25:38.457145 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.457112 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-controller/0.log" Jun 08 21:25:38.475518 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.475477 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/1.log" Jun 08 21:25:38.475685 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.475501 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovn-acl-logging/0.log" Jun 08 21:25:38.498188 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.498153 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/kube-rbac-proxy-node/0.log" Jun 08 21:25:38.521855 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.521823 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 21:25:38.538333 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.538289 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/northd/0.log" Jun 08 21:25:38.558191 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.558161 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/nbdb/0.log" Jun 08 21:25:38.578770 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.578714 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/sbdb/0.log" Jun 08 21:25:38.645742 ip-10-0-140-214 kubenswrapper[2565]: I0608 21:25:38.645711 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mwdgp_f505d281-c4d1-47bb-8f7f-3061a3adf170/ovnkube-controller/0.log"