Jul 16 12:20:05.014218 ip-10-0-137-10 systemd[1]: Starting Kubernetes Kubelet... Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.501892 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509136 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509158 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509167 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509173 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509179 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509183 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509187 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:20:05.523917 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509191 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509195 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509201 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509205 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509209 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509213 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509216 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509220 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509224 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509228 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509232 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509235 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509240 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509244 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509248 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509252 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509263 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509267 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509271 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509275 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:20:05.525311 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509280 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509283 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509287 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509290 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509294 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509298 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509302 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509305 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509309 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509312 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509316 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509319 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509323 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509326 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509330 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509334 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509338 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509343 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509349 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:20:05.525891 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509354 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509359 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509364 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509368 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509373 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509377 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509381 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509384 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509388 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509392 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509395 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509399 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509402 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509406 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509410 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509414 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509417 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509421 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509424 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509428 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:20:05.526530 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509432 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509436 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509439 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509443 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509447 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509450 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509454 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509458 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509462 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509466 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509470 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509474 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509479 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509483 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509486 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509491 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509495 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509499 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509503 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:20:05.527118 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509506 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509510 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509515 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509518 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509522 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509525 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509529 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509532 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509539 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509544 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509548 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509553 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509558 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.509562 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510642 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510652 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510657 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510661 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510666 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510670 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:20:05.527722 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510674 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510678 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510682 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510686 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510691 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510694 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510698 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510702 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510705 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510709 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510713 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510717 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510720 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510724 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510728 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510732 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510735 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510739 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510742 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510746 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:20:05.528285 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510750 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510755 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510759 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510763 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510767 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510770 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510775 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510778 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510782 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510785 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510790 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510794 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510798 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510803 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510806 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510810 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510814 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510818 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510821 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510825 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:20:05.529023 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510829 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510833 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510837 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510840 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510847 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510853 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510857 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510861 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510865 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510869 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510899 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510903 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510907 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510911 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510916 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510920 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510924 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510929 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510934 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:20:05.529586 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510938 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510942 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510946 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510968 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510973 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510978 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510982 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510987 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510990 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510995 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.510999 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511003 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511007 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511011 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511015 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511018 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511022 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511025 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511029 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:20:05.531681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511033 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511036 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511040 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511044 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511054 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511058 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511061 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511067 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511072 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511077 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511082 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511086 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511090 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511093 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511097 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511686 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511693 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511698 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511702 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:20:05.532554 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511706 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511710 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511713 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511717 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511721 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511724 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511728 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511732 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511737 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511743 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511747 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511751 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511755 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511758 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511762 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511765 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511770 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511776 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511781 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511784 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:20:05.621271 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511788 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:20:05.602017 ip-10-0-137-10 systemd[1]: Started Kubernetes Kubelet. Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511792 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511796 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511800 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511804 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511808 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511811 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511815 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511821 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511826 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511829 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511833 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511836 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511840 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511844 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511848 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511854 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511859 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511864 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:20:05.622364 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511870 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511889 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511894 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511898 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511902 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511906 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511909 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511913 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511918 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511921 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511928 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511932 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511935 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511939 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511944 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511948 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511953 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511957 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511961 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:20:05.625402 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511964 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511968 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511974 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511978 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511981 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511986 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511989 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511993 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.511997 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512001 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512005 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512009 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512014 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512017 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512021 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512025 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512029 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512033 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512036 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512040 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:20:05.626473 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512044 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512048 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512051 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512057 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512061 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512065 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512068 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512072 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512075 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512079 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512083 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512087 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512091 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512094 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512100 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512104 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.512107 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512209 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512220 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512231 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512237 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 12:20:05.629223 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512243 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512247 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512253 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512259 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512264 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512269 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512274 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512279 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512283 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512288 2570 flags.go:64] FLAG: --cgroup-root="" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512292 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512296 2570 flags.go:64] FLAG: --client-ca-file="" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512301 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512305 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512313 2570 flags.go:64] FLAG: --cluster-domain="" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512316 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512321 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512326 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512331 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512337 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512341 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512346 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512351 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512355 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 16 12:20:05.630462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512360 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512365 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512370 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512374 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512381 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512386 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512391 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512395 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512399 2570 flags.go:64] FLAG: --enable-server="true" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512404 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512410 2570 flags.go:64] FLAG: --event-burst="100" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512415 2570 flags.go:64] FLAG: --event-qps="50" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512419 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512424 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512428 2570 flags.go:64] FLAG: --eviction-hard="" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512434 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512438 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512442 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512447 2570 flags.go:64] FLAG: --eviction-soft="" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512451 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512455 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512460 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512466 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512470 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512475 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 12:20:05.632777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512479 2570 flags.go:64] FLAG: --feature-gates="" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512485 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512489 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512493 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512498 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512502 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512507 2570 flags.go:64] FLAG: --help="false" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512512 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-137-10.ec2.internal" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512518 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512523 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512527 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512532 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512537 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512541 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512546 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512550 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512554 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512558 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512563 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512567 2570 flags.go:64] FLAG: --kube-reserved="" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512571 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512575 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512579 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512583 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 12:20:05.634082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512587 2570 flags.go:64] FLAG: --lock-file="" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512591 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512595 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512599 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512607 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512613 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512617 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512621 2570 flags.go:64] FLAG: --logging-format="text" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512625 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512631 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512635 2570 flags.go:64] FLAG: --manifest-url="" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512640 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512646 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512650 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512657 2570 flags.go:64] FLAG: --max-pods="110" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512662 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512669 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512673 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512678 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512682 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512686 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512691 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512701 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512706 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512710 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 12:20:05.635597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512714 2570 flags.go:64] FLAG: --pod-cidr="" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512719 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512726 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512731 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512735 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512739 2570 flags.go:64] FLAG: --port="10250" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512743 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512748 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-050675349da5071c8" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512753 2570 flags.go:64] FLAG: --qos-reserved="" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512757 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512761 2570 flags.go:64] FLAG: --register-node="true" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512766 2570 flags.go:64] FLAG: --register-with-taints="" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512773 2570 flags.go:64] FLAG: --registry-burst="10" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512777 2570 flags.go:64] FLAG: --registry-qps="5" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512781 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512786 2570 flags.go:64] FLAG: --reserved-memory="" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512791 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512795 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512800 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512805 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512809 2570 flags.go:64] FLAG: --runonce="false" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512814 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512819 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512824 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512830 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 12:20:05.636699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512834 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512838 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512843 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512847 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512850 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512855 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512859 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512864 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512868 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512887 2570 flags.go:64] FLAG: --system-cgroups="" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512891 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512900 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512904 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512910 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512915 2570 flags.go:64] FLAG: --tls-min-version="" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512919 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512923 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512927 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512931 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512937 2570 flags.go:64] FLAG: --v="2" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512943 2570 flags.go:64] FLAG: --version="false" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512949 2570 flags.go:64] FLAG: --vmodule="" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512954 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.512959 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513132 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:20:05.638048 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513138 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513144 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513148 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513153 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513157 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513161 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513168 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513171 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513175 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513179 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513183 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513186 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513190 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513194 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513197 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513201 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513205 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513210 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513215 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:20:05.638832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513220 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513224 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513228 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513234 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513238 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513242 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513246 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513252 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513256 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513260 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513264 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513269 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513272 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513277 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513281 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513285 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513289 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513293 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513297 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513303 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:20:05.639552 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513307 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513312 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513316 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513319 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513323 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513327 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513331 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513334 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513338 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513342 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513346 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513350 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513354 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513357 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513361 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513365 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513368 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513372 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513376 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513381 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:20:05.640192 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513385 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513389 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513392 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513396 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513400 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513403 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513407 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513411 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513415 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513418 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513422 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513427 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513431 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513437 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513440 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513444 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513448 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513451 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513456 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513459 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:20:05.713871 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513463 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513467 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513470 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513474 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513478 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513482 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513485 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513489 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513493 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513497 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513501 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513506 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513510 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513514 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513519 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513524 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513528 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513532 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:20:05.714804 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.513535 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.514275 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.525802 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.525834 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.525851 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.525857 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525931 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525938 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525942 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525945 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525949 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525952 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525955 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525958 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525961 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:20:05.717488 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525963 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525967 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525969 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525972 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525976 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525979 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525983 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525988 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525991 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525994 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525996 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.525999 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526002 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526004 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526007 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526010 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526013 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526016 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526019 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:20:05.718116 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526021 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526025 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526027 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526030 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526033 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526036 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526038 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526041 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526045 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526049 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526051 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526054 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526058 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526061 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526065 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526068 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526071 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526074 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526077 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:20:05.719076 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526079 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526082 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526085 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526088 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526091 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526094 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526097 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526100 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526103 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526105 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526108 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526111 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526113 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526116 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526118 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526122 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526125 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526128 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526130 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:20:05.719670 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526133 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526135 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526138 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526140 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526143 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526146 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526148 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526151 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526154 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526156 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526159 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526162 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526164 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526168 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526171 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526174 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526176 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526179 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526183 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526186 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:20:05.720342 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526189 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526191 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526194 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526196 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526199 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526202 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526204 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526207 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526210 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526213 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526216 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526218 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526221 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.526226 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526344 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:20:05.721195 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526349 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526351 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526354 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526358 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526361 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526364 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526367 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526370 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526372 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526375 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526378 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526386 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526390 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526394 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526398 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526401 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526404 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526407 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526410 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:20:05.721681 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526413 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526415 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526418 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526421 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526423 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526426 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526429 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526432 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526435 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526438 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526441 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526443 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526446 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526448 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526451 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526454 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526456 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526459 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526461 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526464 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:20:05.722264 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526467 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526469 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526472 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526474 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526478 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526481 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526484 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526487 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526489 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526491 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526494 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526497 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526499 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526502 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526506 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526509 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526512 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526514 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526516 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:20:05.722939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526519 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526521 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526525 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526528 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526530 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526533 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526536 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526538 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526543 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526546 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526549 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526554 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526557 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526560 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526563 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526566 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526568 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526572 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526575 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526578 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:20:05.723474 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526581 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526583 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526586 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526588 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526591 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526593 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526596 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526599 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526602 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526604 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526607 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526609 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526612 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526614 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526617 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526620 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526622 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526625 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526627 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:20:05.803718 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:05.526630 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.526635 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.526781 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.531742 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.533541 2570 server.go:1019] "Starting client certificate rotation" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.537221 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.539394 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.539435 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.539735 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.552190 2570 log.go:25] "Validated CRI v1 runtime API" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.559629 2570 log.go:25] "Validated CRI v1 image API" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.560438 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 12:20:05.826062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.564206 2570 fs.go:135] Filesystem UUIDs: map[091440e7-5c05-46bc-8363-b26f174c2c3f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a51a0fe1-6aba-480c-a67c-2c34ae7bccf1:/dev/nvme0n1p3] Jul 16 12:20:05.828451 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.564235 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 12:20:05.828674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.570213 2570 manager.go:216] Machine: {Timestamp:2026-07-16 12:20:05.569578442 +0000 UTC m=+0.421779245 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100772 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29cdc06d0aa024c0295b3063d45a2d SystemUUID:ec29cdc0-6d0a-a024-c029-5b3063d45a2d BootID:e5872c56-fd3e-4b57-aab2-9e5f7a54a9d3 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1d:6f:ad:09:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1d:6f:ad:09:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:ea:55:70:01:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 12:20:05.828674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.570341 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 12:20:05.828674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.570448 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 12:20:05.828674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.571332 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 12:20:05.828674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.572312 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 12:20:05.828674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.572352 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-10.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 12:20:05.828674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.573970 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.573983 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.573991 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.574815 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.576029 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.580690 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.580903 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.580936 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.580951 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.580977 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.580991 2570 kubelet.go:398] "Adding apiserver pod source" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.581004 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.581472 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.581489 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.590226 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.592053 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.592082 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593013 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593027 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593033 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593038 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593048 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593053 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593061 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593066 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593073 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593078 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593093 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593099 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593128 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.593133 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.596500 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.596503 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.596570 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-10.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.596790 2570 server.go:1268] "Started kubelet" Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.596847 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.596906 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.597016 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 12:20:05.974662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.604774 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.606286 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-10.ec2.internal.18c2c4742a482106 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-10.ec2.internal,UID:ip-10-0-137-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-10.ec2.internal,},FirstTimestamp:2026-07-16 12:20:05.596758278 +0000 UTC m=+0.448959081,LastTimestamp:2026-07-16 12:20:05.596758278 +0000 UTC m=+0.448959081,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-10.ec2.internal,}" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.607590 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.610479 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.615713 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.616196 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.617182 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.617193 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.617354 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.617582 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.617667 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.617674 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.618278 2570 factory.go:55] Registering systemd factory Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.618294 2570 factory.go:223] Registration of the systemd container factory successfully Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.618572 2570 factory.go:153] Registering CRI-O factory Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.618590 2570 factory.go:223] Registration of the crio container factory successfully Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.618654 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.618678 2570 factory.go:103] Registering Raw factory Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.618694 2570 manager.go:1196] Started watching for new ooms in manager Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.619269 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.619462 2570 manager.go:349] Starting recovery of all containers Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.620407 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.624812 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9277v" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.625509 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.631283 2570 manager.go:354] Recovery completed Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.633314 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9277v" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.637402 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.643411 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.643446 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.643469 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.644375 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.644384 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.644399 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 16 12:20:05.977682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.644426 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.645280 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.645309 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.645324 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.647097 2570 policy_none.go:49] "None policy: Start" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.647110 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.647121 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.649116 2570 policy_none.go:47] "Start" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.706615 2570 manager.go:337] "Starting Device Plugin manager" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.706814 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.706829 2570 server.go:87] "Starting device plugin registration server" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.707137 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.707150 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.707231 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.707372 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.707383 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.708111 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.708171 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.807229 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.808287 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.808311 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.808327 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.808356 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-10.ec2.internal" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.815233 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-10.ec2.internal" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.815259 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-10.ec2.internal\": node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.817406 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.817443 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.817461 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.817498 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.819455 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.850607 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.922604 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal"] Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.922713 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.924453 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.924484 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.924494 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.927064 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.927172 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:05.979416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.927205 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.927940 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.927978 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.927980 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.927994 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.928000 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.928010 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.930544 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.930580 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.931437 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.931471 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:05.931488 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.951517 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.964096 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-10.ec2.internal\" not found" node="ip-10-0-137-10.ec2.internal" Jul 16 12:20:05.981717 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:05.969060 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-10.ec2.internal\" not found" node="ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.022814 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.022777 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0666eb19974600d7a3d9fe4c6ca0a2f8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-10.ec2.internal\" (UID: \"0666eb19974600d7a3d9fe4c6ca0a2f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.022979 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.022820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/326e654e47caaca63c2129d4af2c8eb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal\" (UID: \"326e654e47caaca63c2129d4af2c8eb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.022979 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.022840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/326e654e47caaca63c2129d4af2c8eb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal\" (UID: \"326e654e47caaca63c2129d4af2c8eb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.051710 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:06.051671 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:06.123624 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.123581 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0666eb19974600d7a3d9fe4c6ca0a2f8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-10.ec2.internal\" (UID: \"0666eb19974600d7a3d9fe4c6ca0a2f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.123720 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.123634 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/326e654e47caaca63c2129d4af2c8eb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal\" (UID: \"326e654e47caaca63c2129d4af2c8eb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.123720 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.123654 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/326e654e47caaca63c2129d4af2c8eb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal\" (UID: \"326e654e47caaca63c2129d4af2c8eb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.123720 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.123701 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0666eb19974600d7a3d9fe4c6ca0a2f8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-10.ec2.internal\" (UID: \"0666eb19974600d7a3d9fe4c6ca0a2f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.123833 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.123709 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/326e654e47caaca63c2129d4af2c8eb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal\" (UID: \"326e654e47caaca63c2129d4af2c8eb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.123833 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.123709 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/326e654e47caaca63c2129d4af2c8eb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal\" (UID: \"326e654e47caaca63c2129d4af2c8eb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.154040 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:06.154003 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:06.256568 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:06.256462 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:06.267456 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.267424 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.273726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.272849 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.359100 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:06.359037 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:06.450558 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.450532 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:20:06.460202 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:06.460176 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:06.539965 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.539856 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 12:20:06.540520 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.540036 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 12:20:06.540520 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.540084 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 12:20:06.560685 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:06.560646 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-10.ec2.internal\" not found" Jul 16 12:20:06.601934 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.601906 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:20:06.618210 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.618176 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 12:20:06.618210 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.618185 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.628836 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.628804 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 12:20:06.630542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.630524 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" Jul 16 12:20:06.631665 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.631645 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 12:20:06.640872 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.640829 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 12:15:05 +0000 UTC" deadline="2028-01-19 22:20:04.557733875 +0000 UTC" Jul 16 12:20:06.640872 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.640868 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13257h59m57.916868969s" Jul 16 12:20:06.645160 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.645145 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 12:20:06.663241 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.663209 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bcrw8" Jul 16 12:20:06.663449 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.663431 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:20:06.672321 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.672292 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bcrw8" Jul 16 12:20:06.921573 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:06.921505 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0666eb19974600d7a3d9fe4c6ca0a2f8.slice/crio-9bf2d6d128f37471ef96785395be32b2cc325ba8791f3304191e03beede68c18 WatchSource:0}: Error finding container 9bf2d6d128f37471ef96785395be32b2cc325ba8791f3304191e03beede68c18: Status 404 returned error can't find the container with id 9bf2d6d128f37471ef96785395be32b2cc325ba8791f3304191e03beede68c18 Jul 16 12:20:06.930533 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:06.930507 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:20:06.936336 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:06.936303 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326e654e47caaca63c2129d4af2c8eb4.slice/crio-3368557df6e53f2d493981cc8173a69a7b773c0118578723a01c8a9a5e5fc234 WatchSource:0}: Error finding container 3368557df6e53f2d493981cc8173a69a7b773c0118578723a01c8a9a5e5fc234: Status 404 returned error can't find the container with id 3368557df6e53f2d493981cc8173a69a7b773c0118578723a01c8a9a5e5fc234 Jul 16 12:20:07.582300 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.582251 2570 apiserver.go:52] "Watching apiserver" Jul 16 12:20:07.591219 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.591173 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 12:20:07.592540 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.592509 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-zswmk","openshift-dns/node-resolver-qrfnd","openshift-image-registry/node-ca-s7w6z","openshift-multus/multus-additional-cni-plugins-kxm82","openshift-network-diagnostics/network-check-target-svqkk","openshift-ovn-kubernetes/ovnkube-node-jgl9d","kube-system/konnectivity-agent-872t8","kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal","openshift-multus/multus-2j4wv","openshift-multus/network-metrics-daemon-lxqfm","openshift-network-operator/iptables-alerter-k28hn","kube-system/global-pull-secret-syncer-6246f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p"] Jul 16 12:20:07.595419 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.595391 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.598198 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.598171 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wzxrr\"" Jul 16 12:20:07.598349 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.598329 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 12:20:07.598454 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.598438 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:20:07.599298 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.599278 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.603149 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.602737 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 12:20:07.603149 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.602979 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 12:20:07.603149 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.603027 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lgbvl\"" Jul 16 12:20:07.604637 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.604615 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.606916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.606874 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 12:20:07.607258 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.607212 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.607484 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.607434 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 12:20:07.607605 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.607585 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mmgnz\"" Jul 16 12:20:07.607850 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.607829 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 12:20:07.609986 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.609939 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:07.610104 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.610017 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 12:20:07.610170 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.610075 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:07.610294 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.610277 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 12:20:07.610500 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.610485 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 12:20:07.610563 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.610505 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 12:20:07.610613 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.610560 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 12:20:07.610707 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.610689 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4hfhd\"" Jul 16 12:20:07.612360 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.612332 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.615086 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.615063 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:07.615194 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.615090 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zjbw5\"" Jul 16 12:20:07.615623 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.615601 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 12:20:07.616773 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.616749 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 12:20:07.617038 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.617018 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 12:20:07.617304 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.617286 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 12:20:07.617304 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.617295 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 12:20:07.617798 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.617780 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 12:20:07.618196 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.618177 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 12:20:07.618600 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.618523 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 12:20:07.621701 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.621666 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lnbmq\"" Jul 16 12:20:07.622063 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.622046 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.624577 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.624559 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:07.624799 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.624773 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:07.625343 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.625319 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 12:20:07.625445 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.625332 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gxd2m\"" Jul 16 12:20:07.627720 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.627395 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.630092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.630068 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:20:07.630425 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.630399 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.630531 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.630479 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:07.632129 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.632105 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j79v6\"" Jul 16 12:20:07.632227 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.632162 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 12:20:07.632289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.632113 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 12:20:07.632684 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.632663 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.633996 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.633944 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-slash\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.634097 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634008 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-run-netns\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.634097 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634037 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-log-socket\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.634097 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.634213 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634152 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vml8h\" (UniqueName: \"kubernetes.io/projected/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-kube-api-access-vml8h\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.634213 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634201 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-k8s-cni-cncf-io\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634280 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634251 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-kubelet\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634313 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-hostroot\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634360 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.634360 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634348 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-ovn\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.634428 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634374 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94ea42dd-9d25-4218-b973-828ffd6d7796-cni-binary-copy\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634428 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634412 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-daemon-config\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634501 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634454 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-run\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.634501 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634488 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-tmp\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.634608 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634524 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh54n\" (UniqueName: \"kubernetes.io/projected/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-kube-api-access-hh54n\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.634608 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634558 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-cni-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634608 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634582 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-netns\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634763 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-cni-multus\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634763 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-socket-dir-parent\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634763 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634694 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-modprobe-d\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.634763 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634719 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysctl-d\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.634974 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634758 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45hqg\" (UniqueName: \"kubernetes.io/projected/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-kube-api-access-45hqg\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.634974 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634786 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.634974 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634831 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.634974 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634880 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-cnibin\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.634974 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-host\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.635229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.634974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-cni-netd\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.635229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635000 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovn-node-metrics-cert\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.635229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635034 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-kubernetes\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.635229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-456r6\" (UniqueName: \"kubernetes.io/projected/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-kube-api-access-456r6\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.635229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635086 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-conf-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.635229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635153 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovnkube-config\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.635229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635185 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovnkube-script-lib\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.635229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635216 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2de93f5d-8172-4e3b-bc2f-20d83afac84c-agent-certs\") pod \"konnectivity-agent-872t8\" (UID: \"2de93f5d-8172-4e3b-bc2f-20d83afac84c\") " pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-serviceca\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635273 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-systemd\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635308 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-node-log\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635333 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysctl-conf\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635404 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l98nv\" (UniqueName: \"kubernetes.io/projected/8dfd361f-c637-4992-bc3d-195d93515460-kube-api-access-l98nv\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635445 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-cni-bin\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635486 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-multus-certs\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-etc-kubernetes\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-var-lib-kubelet\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.635697 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635589 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dfd361f-c637-4992-bc3d-195d93515460-tmp-dir\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.636265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635627 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.636265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635836 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 12:20:07.636265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635843 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.636265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.635917 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-system-cni-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.636265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636184 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 12:20:07.636265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636211 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7zwbh\"" Jul 16 12:20:07.636591 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636458 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 12:20:07.636652 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636589 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-os-release\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.636711 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2de93f5d-8172-4e3b-bc2f-20d83afac84c-konnectivity-ca\") pod \"konnectivity-agent-872t8\" (UID: \"2de93f5d-8172-4e3b-bc2f-20d83afac84c\") " pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:07.636711 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysconfig\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.636817 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636720 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cnibin\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.636817 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636755 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-os-release\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.636817 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636782 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nccg7\" (UniqueName: \"kubernetes.io/projected/94ea42dd-9d25-4218-b973-828ffd6d7796-kube-api-access-nccg7\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.636990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dfd361f-c637-4992-bc3d-195d93515460-hosts-file\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.636990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636868 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-tuned\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.636990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636913 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-etc-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.636990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-sys\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.636990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636967 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-system-cni-dir\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.636993 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-var-lib-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637020 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-env-overrides\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637043 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-host\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637065 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-systemd\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-lib-modules\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637115 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637142 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637173 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-kubelet\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.637247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-systemd-units\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.639272 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.637530 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-cni-bin\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.675442 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.675373 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 12:15:06 +0000 UTC" deadline="2028-04-06 02:25:52.720364642 +0000 UTC" Jul 16 12:20:07.675442 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.675439 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15110h5m45.04492997s" Jul 16 12:20:07.718743 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.718705 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 12:20:07.739852 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.739796 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-modprobe-d\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.739871 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysctl-d\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.739913 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45hqg\" (UniqueName: \"kubernetes.io/projected/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-kube-api-access-45hqg\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.739939 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.739963 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.739990 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-cnibin\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740008 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-modprobe-d\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740068 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-host\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740015 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-host\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740079 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysctl-d\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.740105 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740106 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-cni-netd\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740155 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-cni-netd\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740179 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-cnibin\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740196 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740180 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovn-node-metrics-cert\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740285 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdmgj\" (UniqueName: \"kubernetes.io/projected/2c06e44a-b5c2-487f-ae27-78a4f08f4044-kube-api-access-bdmgj\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740317 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-kubernetes\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740347 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-456r6\" (UniqueName: \"kubernetes.io/projected/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-kube-api-access-456r6\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740372 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-conf-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740387 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-kubernetes\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740398 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovnkube-config\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovnkube-script-lib\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740444 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-conf-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2de93f5d-8172-4e3b-bc2f-20d83afac84c-agent-certs\") pod \"konnectivity-agent-872t8\" (UID: \"2de93f5d-8172-4e3b-bc2f-20d83afac84c\") " pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:07.740619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740492 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-serviceca\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740515 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-systemd\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740540 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-node-log\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740572 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-registration-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740592 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysctl-conf\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740617 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l98nv\" (UniqueName: \"kubernetes.io/projected/8dfd361f-c637-4992-bc3d-195d93515460-kube-api-access-l98nv\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740636 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-cni-bin\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740666 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-multus-certs\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740669 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-systemd\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740689 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-etc-kubernetes\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740716 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-device-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740733 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740788 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-var-lib-kubelet\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740829 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-cni-bin\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740956 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysctl-conf\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.741345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.741236 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-multus-certs\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.743373 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.742584 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-etc-kubernetes\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.743373 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.743160 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-node-log\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.743538 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.743327 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-serviceca\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.744358 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744330 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovnkube-script-lib\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.744537 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.740742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-var-lib-kubelet\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.744613 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dfd361f-c637-4992-bc3d-195d93515460-tmp-dir\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.744666 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744628 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.744727 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744672 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.744727 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744709 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-system-cni-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.744835 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744744 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-os-release\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.744835 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744773 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2de93f5d-8172-4e3b-bc2f-20d83afac84c-konnectivity-ca\") pod \"konnectivity-agent-872t8\" (UID: \"2de93f5d-8172-4e3b-bc2f-20d83afac84c\") " pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:07.744835 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744827 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46zdr\" (UniqueName: \"kubernetes.io/projected/8ce77094-7be6-4e19-9926-b7cc33b9fff3-kube-api-access-46zdr\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:07.745019 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744865 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c06e44a-b5c2-487f-ae27-78a4f08f4044-host-slash\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.745019 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.745019 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744941 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysconfig\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.745019 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744943 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dfd361f-c637-4992-bc3d-195d93515460-tmp-dir\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.745019 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cnibin\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.745277 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745147 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-sysconfig\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.745277 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745218 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-system-cni-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745470 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovn-node-metrics-cert\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745493 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cnibin\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745604 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-os-release\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745621 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-os-release\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745634 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2de93f5d-8172-4e3b-bc2f-20d83afac84c-agent-certs\") pod \"konnectivity-agent-872t8\" (UID: \"2de93f5d-8172-4e3b-bc2f-20d83afac84c\") " pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nccg7\" (UniqueName: \"kubernetes.io/projected/94ea42dd-9d25-4218-b973-828ffd6d7796-kube-api-access-nccg7\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745712 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c06e44a-b5c2-487f-ae27-78a4f08f4044-iptables-alerter-script\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745749 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745739 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-os-release\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745780 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dfd361f-c637-4992-bc3d-195d93515460-hosts-file\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745816 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-kubelet-config\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745851 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745885 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-tuned\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.747199 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745918 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-etc-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745943 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.745995 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-sys-fs\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746030 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-sys\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746062 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-system-cni-dir\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746089 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-var-lib-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746120 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-env-overrides\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746148 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-dbus\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746179 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fkf5\" (UniqueName: \"kubernetes.io/projected/b76c956f-eb88-4b51-9ab9-45eaf4c77397-kube-api-access-4fkf5\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-host\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746237 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-systemd\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746268 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-lib-modules\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746301 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:07.747991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746364 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-kubelet\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746382 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2de93f5d-8172-4e3b-bc2f-20d83afac84c-konnectivity-ca\") pod \"konnectivity-agent-872t8\" (UID: \"2de93f5d-8172-4e3b-bc2f-20d83afac84c\") " pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746391 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-systemd-units\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-cni-bin\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746469 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-slash\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746500 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-run-netns\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746528 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-log-socket\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746549 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746560 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746611 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vml8h\" (UniqueName: \"kubernetes.io/projected/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-kube-api-access-vml8h\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746649 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-k8s-cni-cncf-io\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746683 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-kubelet\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746719 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-hostroot\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746762 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.748774 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-ovn\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746822 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94ea42dd-9d25-4218-b973-828ffd6d7796-cni-binary-copy\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746855 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-daemon-config\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746888 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-run\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-tmp\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746968 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh54n\" (UniqueName: \"kubernetes.io/projected/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-kube-api-access-hh54n\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747001 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-cni-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747034 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-netns\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747065 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-cni-multus\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-socket-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-socket-dir-parent\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747276 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-socket-dir-parent\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747333 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747396 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dfd361f-c637-4992-bc3d-195d93515460-hosts-file\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747652 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-systemd\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.749521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747684 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-k8s-cni-cncf-io\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747741 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-sys\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747752 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-kubelet\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747788 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-system-cni-dir\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747825 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-var-lib-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.746362 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748116 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-kubelet\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748304 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-env-overrides\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748433 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-lib-modules\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748484 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-run-ovn\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748516 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94ea42dd-9d25-4218-b973-828ffd6d7796-cni-binary-copy\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748529 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-host\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748573 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-hostroot\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748648 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-slash\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.744292 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-ovnkube-config\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.750289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748709 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-systemd-units\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.748838 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.747697 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-etc-openvswitch\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.749141 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-etc-tuned\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.749907 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-host-run-netns\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.750034 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-cni-bin\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.750109 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-log-socket\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.750103 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.750235 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-run\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.750307 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-cni-dir\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.750765 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-var-lib-cni-multus\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.751103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.750826 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94ea42dd-9d25-4218-b973-828ffd6d7796-host-run-netns\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.751685 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.751406 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94ea42dd-9d25-4218-b973-828ffd6d7796-multus-daemon-config\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.752705 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.752638 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45hqg\" (UniqueName: \"kubernetes.io/projected/4eaa7819-97bc-4be4-823f-1b30eb9fd0fa-kube-api-access-45hqg\") pod \"multus-additional-cni-plugins-kxm82\" (UID: \"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa\") " pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.754106 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.754067 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:20:07.754106 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.754094 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:20:07.754106 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.754109 2570 projected.go:196] Error preparing data for projected volume kube-api-access-v22jz for pod openshift-network-diagnostics/network-check-target-svqkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:07.754340 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.754190 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz podName:5a4fe502-f835-4090-82fe-ed50ad79af7d nodeName:}" failed. No retries permitted until 2026-07-16 12:20:08.254168416 +0000 UTC m=+3.106369218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v22jz" (UniqueName: "kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz") pod "network-check-target-svqkk" (UID: "5a4fe502-f835-4090-82fe-ed50ad79af7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:07.754461 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.754438 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-456r6\" (UniqueName: \"kubernetes.io/projected/aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e-kube-api-access-456r6\") pod \"node-ca-s7w6z\" (UID: \"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e\") " pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.755756 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.755729 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-tmp\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.755846 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.755734 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l98nv\" (UniqueName: \"kubernetes.io/projected/8dfd361f-c637-4992-bc3d-195d93515460-kube-api-access-l98nv\") pod \"node-resolver-qrfnd\" (UID: \"8dfd361f-c637-4992-bc3d-195d93515460\") " pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.756553 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.756530 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nccg7\" (UniqueName: \"kubernetes.io/projected/94ea42dd-9d25-4218-b973-828ffd6d7796-kube-api-access-nccg7\") pod \"multus-2j4wv\" (UID: \"94ea42dd-9d25-4218-b973-828ffd6d7796\") " pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.757076 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.757058 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vml8h\" (UniqueName: \"kubernetes.io/projected/f3ba8030-15f6-4204-8445-ef7ae53ac5d6-kube-api-access-vml8h\") pod \"ovnkube-node-jgl9d\" (UID: \"f3ba8030-15f6-4204-8445-ef7ae53ac5d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.759564 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.759540 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh54n\" (UniqueName: \"kubernetes.io/projected/f0f554ff-f6f4-4eef-b6bc-c6479f07511d-kube-api-access-hh54n\") pod \"tuned-zswmk\" (UID: \"f0f554ff-f6f4-4eef-b6bc-c6479f07511d\") " pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.823635 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.823561 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" event={"ID":"326e654e47caaca63c2129d4af2c8eb4","Type":"ContainerStarted","Data":"3368557df6e53f2d493981cc8173a69a7b773c0118578723a01c8a9a5e5fc234"} Jul 16 12:20:07.824982 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.824946 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" event={"ID":"0666eb19974600d7a3d9fe4c6ca0a2f8","Type":"ContainerStarted","Data":"9bf2d6d128f37471ef96785395be32b2cc325ba8791f3304191e03beede68c18"} Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.847871 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-socket-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.847970 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdmgj\" (UniqueName: \"kubernetes.io/projected/2c06e44a-b5c2-487f-ae27-78a4f08f4044-kube-api-access-bdmgj\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848037 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-registration-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-device-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848077 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-socket-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848103 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46zdr\" (UniqueName: \"kubernetes.io/projected/8ce77094-7be6-4e19-9926-b7cc33b9fff3-kube-api-access-46zdr\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848128 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c06e44a-b5c2-487f-ae27-78a4f08f4044-host-slash\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848149 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-registration-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848174 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848200 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-device-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848206 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c06e44a-b5c2-487f-ae27-78a4f08f4044-iptables-alerter-script\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848233 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848239 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c06e44a-b5c2-487f-ae27-78a4f08f4044-host-slash\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.848969 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848261 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-kubelet-config\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848285 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848312 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848335 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-sys-fs\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848374 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-dbus\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848422 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fkf5\" (UniqueName: \"kubernetes.io/projected/b76c956f-eb88-4b51-9ab9-45eaf4c77397-kube-api-access-4fkf5\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848434 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-kubelet-config\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848571 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848636 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.848650 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848699 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76c956f-eb88-4b51-9ab9-45eaf4c77397-sys-fs\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.848724 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs podName:8ce77094-7be6-4e19-9926-b7cc33b9fff3 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:08.348703364 +0000 UTC m=+3.200904178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs") pod "network-metrics-daemon-lxqfm" (UID: "8ce77094-7be6-4e19-9926-b7cc33b9fff3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.848762 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-dbus\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.848849 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:07.849878 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:07.848938 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret podName:3d1c8afb-3295-4ea3-94cd-73ae61d2fb01 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:08.348895771 +0000 UTC m=+3.201096562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret") pod "global-pull-secret-syncer-6246f" (UID: "3d1c8afb-3295-4ea3-94cd-73ae61d2fb01") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:07.850782 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.849245 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c06e44a-b5c2-487f-ae27-78a4f08f4044-iptables-alerter-script\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.863100 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.863064 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46zdr\" (UniqueName: \"kubernetes.io/projected/8ce77094-7be6-4e19-9926-b7cc33b9fff3-kube-api-access-46zdr\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:07.863393 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.863337 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fkf5\" (UniqueName: \"kubernetes.io/projected/b76c956f-eb88-4b51-9ab9-45eaf4c77397-kube-api-access-4fkf5\") pod \"aws-ebs-csi-driver-node-hhl4p\" (UID: \"b76c956f-eb88-4b51-9ab9-45eaf4c77397\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:07.864833 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.864799 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdmgj\" (UniqueName: \"kubernetes.io/projected/2c06e44a-b5c2-487f-ae27-78a4f08f4044-kube-api-access-bdmgj\") pod \"iptables-alerter-k28hn\" (UID: \"2c06e44a-b5c2-487f-ae27-78a4f08f4044\") " pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.912095 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.912046 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zswmk" Jul 16 12:20:07.924517 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.924415 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qrfnd" Jul 16 12:20:07.939520 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.939107 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:07.943056 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.943030 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s7w6z" Jul 16 12:20:07.953446 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.953417 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kxm82" Jul 16 12:20:07.961936 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.961912 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:07.971347 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.971156 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2j4wv" Jul 16 12:20:07.980101 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.980002 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k28hn" Jul 16 12:20:07.984937 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.984911 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:20:07.986039 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:07.986012 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" Jul 16 12:20:08.354211 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:08.354160 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:08.354211 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:08.354217 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:08.354258 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:08.354361 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:08.354377 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:08.354394 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:08.354408 2570 projected.go:196] Error preparing data for projected volume kube-api-access-v22jz for pod openshift-network-diagnostics/network-check-target-svqkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:08.354436 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs podName:8ce77094-7be6-4e19-9926-b7cc33b9fff3 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:09.35441679 +0000 UTC m=+4.206617592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs") pod "network-metrics-daemon-lxqfm" (UID: "8ce77094-7be6-4e19-9926-b7cc33b9fff3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:08.354363 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:08.354455 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz podName:5a4fe502-f835-4090-82fe-ed50ad79af7d nodeName:}" failed. No retries permitted until 2026-07-16 12:20:09.354444796 +0000 UTC m=+4.206645589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v22jz" (UniqueName: "kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz") pod "network-check-target-svqkk" (UID: "5a4fe502-f835-4090-82fe-ed50ad79af7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:08.354475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:08.354472 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret podName:3d1c8afb-3295-4ea3-94cd-73ae61d2fb01 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:09.354461414 +0000 UTC m=+4.206662205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret") pod "global-pull-secret-syncer-6246f" (UID: "3d1c8afb-3295-4ea3-94cd-73ae61d2fb01") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:08.670704 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:08.670620 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:20:08.676068 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:08.676019 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 12:15:06 +0000 UTC" deadline="2028-02-01 02:23:27.401719701 +0000 UTC" Jul 16 12:20:08.676068 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:08.676066 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13550h3m18.725656224s" Jul 16 12:20:08.979254 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:08.979222 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76c956f_eb88_4b51_9ab9_45eaf4c77397.slice/crio-f4c2d1aa9376610bfa7675947e7a59fa13016f07b7a319b521f7e1bcd5aa1c18 WatchSource:0}: Error finding container f4c2d1aa9376610bfa7675947e7a59fa13016f07b7a319b521f7e1bcd5aa1c18: Status 404 returned error can't find the container with id f4c2d1aa9376610bfa7675947e7a59fa13016f07b7a319b521f7e1bcd5aa1c18 Jul 16 12:20:08.982499 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:08.982466 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ea42dd_9d25_4218_b973_828ffd6d7796.slice/crio-cf34e5c14c0368ed05cb8c3b9087e728e2f0e5b76e1601a2284a00baa13550b0 WatchSource:0}: Error finding container cf34e5c14c0368ed05cb8c3b9087e728e2f0e5b76e1601a2284a00baa13550b0: Status 404 returned error can't find the container with id cf34e5c14c0368ed05cb8c3b9087e728e2f0e5b76e1601a2284a00baa13550b0 Jul 16 12:20:08.986675 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:08.985821 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c06e44a_b5c2_487f_ae27_78a4f08f4044.slice/crio-596aba204cd184e8ba44a5bd59644202e45d3abc06f2a4f7bb5906e1ff2f5f72 WatchSource:0}: Error finding container 596aba204cd184e8ba44a5bd59644202e45d3abc06f2a4f7bb5906e1ff2f5f72: Status 404 returned error can't find the container with id 596aba204cd184e8ba44a5bd59644202e45d3abc06f2a4f7bb5906e1ff2f5f72 Jul 16 12:20:08.987347 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:08.987310 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eaa7819_97bc_4be4_823f_1b30eb9fd0fa.slice/crio-2ff61e864bfaff79d0f8d71d9e103304ba37202a14f9a8335a53338632cc83ac WatchSource:0}: Error finding container 2ff61e864bfaff79d0f8d71d9e103304ba37202a14f9a8335a53338632cc83ac: Status 404 returned error can't find the container with id 2ff61e864bfaff79d0f8d71d9e103304ba37202a14f9a8335a53338632cc83ac Jul 16 12:20:08.990831 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:08.990803 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f554ff_f6f4_4eef_b6bc_c6479f07511d.slice/crio-4577724c2e127fcbd6303b7600fa2ce392c3ea01d1664786b9f899a0f63e3f64 WatchSource:0}: Error finding container 4577724c2e127fcbd6303b7600fa2ce392c3ea01d1664786b9f899a0f63e3f64: Status 404 returned error can't find the container with id 4577724c2e127fcbd6303b7600fa2ce392c3ea01d1664786b9f899a0f63e3f64 Jul 16 12:20:09.014025 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:09.013988 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dfd361f_c637_4992_bc3d_195d93515460.slice/crio-fbee204683063412246526d26cd9cff69c4a9e2b2afa2de30e72b84c31be39e9 WatchSource:0}: Error finding container fbee204683063412246526d26cd9cff69c4a9e2b2afa2de30e72b84c31be39e9: Status 404 returned error can't find the container with id fbee204683063412246526d26cd9cff69c4a9e2b2afa2de30e72b84c31be39e9 Jul 16 12:20:09.014919 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:09.014892 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ba8030_15f6_4204_8445_ef7ae53ac5d6.slice/crio-db71b5c268ca4a396f2f0c08861d0eb831c1c698b470935a921e721b358a49a8 WatchSource:0}: Error finding container db71b5c268ca4a396f2f0c08861d0eb831c1c698b470935a921e721b358a49a8: Status 404 returned error can't find the container with id db71b5c268ca4a396f2f0c08861d0eb831c1c698b470935a921e721b358a49a8 Jul 16 12:20:09.363454 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.363247 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:09.363639 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.363479 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:09.363639 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.363396 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:09.363639 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.363591 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:09.363639 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.363526 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:09.363639 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.363612 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:20:09.363639 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.363595 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs podName:8ce77094-7be6-4e19-9926-b7cc33b9fff3 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:11.363575496 +0000 UTC m=+6.215776289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs") pod "network-metrics-daemon-lxqfm" (UID: "8ce77094-7be6-4e19-9926-b7cc33b9fff3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:09.363865 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.363631 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:20:09.363865 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.363662 2570 projected.go:196] Error preparing data for projected volume kube-api-access-v22jz for pod openshift-network-diagnostics/network-check-target-svqkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:09.363865 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.363673 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret podName:3d1c8afb-3295-4ea3-94cd-73ae61d2fb01 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:11.363647758 +0000 UTC m=+6.215848552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret") pod "global-pull-secret-syncer-6246f" (UID: "3d1c8afb-3295-4ea3-94cd-73ae61d2fb01") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:09.363865 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.363704 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz podName:5a4fe502-f835-4090-82fe-ed50ad79af7d nodeName:}" failed. No retries permitted until 2026-07-16 12:20:11.3636885 +0000 UTC m=+6.215889303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v22jz" (UniqueName: "kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz") pod "network-check-target-svqkk" (UID: "5a4fe502-f835-4090-82fe-ed50ad79af7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:09.819509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.819012 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:09.819509 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.819167 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:09.820188 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.819623 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:09.820188 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.819721 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:09.820188 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.819801 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:09.820188 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:09.819890 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:09.835934 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.835846 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerStarted","Data":"2ff61e864bfaff79d0f8d71d9e103304ba37202a14f9a8335a53338632cc83ac"} Jul 16 12:20:09.838510 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.838479 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2j4wv" event={"ID":"94ea42dd-9d25-4218-b973-828ffd6d7796","Type":"ContainerStarted","Data":"cf34e5c14c0368ed05cb8c3b9087e728e2f0e5b76e1601a2284a00baa13550b0"} Jul 16 12:20:09.842657 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.842621 2570 generic.go:356] "Generic (PLEG): container finished" podID="326e654e47caaca63c2129d4af2c8eb4" containerID="f37877aeba1038d9d9709cde33db2f5fe2810f99cd849ac356c2561e3318c9f8" exitCode=0 Jul 16 12:20:09.842802 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.842719 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" event={"ID":"326e654e47caaca63c2129d4af2c8eb4","Type":"ContainerDied","Data":"f37877aeba1038d9d9709cde33db2f5fe2810f99cd849ac356c2561e3318c9f8"} Jul 16 12:20:09.848164 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.847672 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" event={"ID":"0666eb19974600d7a3d9fe4c6ca0a2f8","Type":"ContainerStarted","Data":"82b1136b19049fe33642a56438a7ccdef316e8398b88d5bf65533f91d7e11b1a"} Jul 16 12:20:09.854558 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.854527 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"db71b5c268ca4a396f2f0c08861d0eb831c1c698b470935a921e721b358a49a8"} Jul 16 12:20:09.859665 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.859586 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zswmk" event={"ID":"f0f554ff-f6f4-4eef-b6bc-c6479f07511d","Type":"ContainerStarted","Data":"4577724c2e127fcbd6303b7600fa2ce392c3ea01d1664786b9f899a0f63e3f64"} Jul 16 12:20:09.868174 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.868144 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-872t8" event={"ID":"2de93f5d-8172-4e3b-bc2f-20d83afac84c","Type":"ContainerStarted","Data":"11d9b3d5d616ae87e2f2af437cf63bae5922213223a6c0ac5537b5f468070c40"} Jul 16 12:20:09.881463 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.881387 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k28hn" event={"ID":"2c06e44a-b5c2-487f-ae27-78a4f08f4044","Type":"ContainerStarted","Data":"596aba204cd184e8ba44a5bd59644202e45d3abc06f2a4f7bb5906e1ff2f5f72"} Jul 16 12:20:09.887618 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.887579 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" event={"ID":"b76c956f-eb88-4b51-9ab9-45eaf4c77397","Type":"ContainerStarted","Data":"f4c2d1aa9376610bfa7675947e7a59fa13016f07b7a319b521f7e1bcd5aa1c18"} Jul 16 12:20:09.892804 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.892767 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qrfnd" event={"ID":"8dfd361f-c637-4992-bc3d-195d93515460","Type":"ContainerStarted","Data":"fbee204683063412246526d26cd9cff69c4a9e2b2afa2de30e72b84c31be39e9"} Jul 16 12:20:09.894348 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:09.894314 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s7w6z" event={"ID":"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e","Type":"ContainerStarted","Data":"c0beb057543f9e05d69d1dc498e62e638f868c317960301295104919020b75ef"} Jul 16 12:20:10.908769 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:10.908731 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" event={"ID":"326e654e47caaca63c2129d4af2c8eb4","Type":"ContainerStarted","Data":"fbcc4b7cac367e54ceb05b189592a45f45b821376d7232d5f3eec5a82936269d"} Jul 16 12:20:10.926506 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:10.926442 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-10.ec2.internal" podStartSLOduration=4.926422007 podStartE2EDuration="4.926422007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:09.881357236 +0000 UTC m=+4.733558068" watchObservedRunningTime="2026-07-16 12:20:10.926422007 +0000 UTC m=+5.778622817" Jul 16 12:20:11.380967 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:11.380623 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:11.380967 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:11.380683 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:11.380967 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:11.380752 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:11.385849 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.381512 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:11.385849 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.381867 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret podName:3d1c8afb-3295-4ea3-94cd-73ae61d2fb01 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:15.381825953 +0000 UTC m=+10.234026754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret") pod "global-pull-secret-syncer-6246f" (UID: "3d1c8afb-3295-4ea3-94cd-73ae61d2fb01") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:11.385849 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.382051 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:11.385849 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.382104 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs podName:8ce77094-7be6-4e19-9926-b7cc33b9fff3 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:15.382088863 +0000 UTC m=+10.234289657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs") pod "network-metrics-daemon-lxqfm" (UID: "8ce77094-7be6-4e19-9926-b7cc33b9fff3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:11.385849 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.382186 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:20:11.385849 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.382205 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:20:11.385849 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.382225 2570 projected.go:196] Error preparing data for projected volume kube-api-access-v22jz for pod openshift-network-diagnostics/network-check-target-svqkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:11.385849 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.382269 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz podName:5a4fe502-f835-4090-82fe-ed50ad79af7d nodeName:}" failed. No retries permitted until 2026-07-16 12:20:15.382249751 +0000 UTC m=+10.234450543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v22jz" (UniqueName: "kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz") pod "network-check-target-svqkk" (UID: "5a4fe502-f835-4090-82fe-ed50ad79af7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:11.819081 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:11.818994 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:11.819081 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:11.819048 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:11.819303 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:11.818995 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:11.819303 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.819204 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:11.819529 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.819498 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:11.819616 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:11.819588 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:13.818708 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:13.817800 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:13.818708 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:13.817965 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:13.818708 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:13.818422 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:13.818708 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:13.818525 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:13.818708 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:13.818584 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:13.818708 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:13.818672 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:15.418372 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:15.418336 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:15.418395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:15.418466 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.418497 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.418539 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.418562 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs podName:8ce77094-7be6-4e19-9926-b7cc33b9fff3 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:23.418543432 +0000 UTC m=+18.270744239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs") pod "network-metrics-daemon-lxqfm" (UID: "8ce77094-7be6-4e19-9926-b7cc33b9fff3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.418580 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret podName:3d1c8afb-3295-4ea3-94cd-73ae61d2fb01 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:23.418570884 +0000 UTC m=+18.270771674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret") pod "global-pull-secret-syncer-6246f" (UID: "3d1c8afb-3295-4ea3-94cd-73ae61d2fb01") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.418594 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.418621 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.418636 2570 projected.go:196] Error preparing data for projected volume kube-api-access-v22jz for pod openshift-network-diagnostics/network-check-target-svqkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:15.418920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.418692 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz podName:5a4fe502-f835-4090-82fe-ed50ad79af7d nodeName:}" failed. No retries permitted until 2026-07-16 12:20:23.418672917 +0000 UTC m=+18.270873709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v22jz" (UniqueName: "kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz") pod "network-check-target-svqkk" (UID: "5a4fe502-f835-4090-82fe-ed50ad79af7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:15.822818 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:15.821141 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:15.822818 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:15.821263 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:15.822818 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:15.821302 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:15.822818 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.821411 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:15.822818 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.821783 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:15.822818 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:15.821831 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:17.818268 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:17.818231 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:17.818810 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:17.818270 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:17.818810 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:17.818231 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:17.818810 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:17.818379 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:17.818810 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:17.818475 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:17.818810 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:17.818564 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:19.820861 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:19.820829 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:19.821345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:19.820864 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:19.821345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:19.820864 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:19.821345 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:19.820957 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:19.821345 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:19.821044 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:19.821345 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:19.821101 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:21.818465 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:21.818422 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:21.818465 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:21.818453 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:21.819002 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:21.818422 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:21.819002 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:21.818564 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:21.819002 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:21.818699 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:21.819002 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:21.818792 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:23.482673 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:23.482630 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:23.482673 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:23.482680 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:23.482708 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.482780 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.482839 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.482863 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret podName:3d1c8afb-3295-4ea3-94cd-73ae61d2fb01 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:39.482840624 +0000 UTC m=+34.335041429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret") pod "global-pull-secret-syncer-6246f" (UID: "3d1c8afb-3295-4ea3-94cd-73ae61d2fb01") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.482863 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.482900 2570 projected.go:196] Error preparing data for projected volume kube-api-access-v22jz for pod openshift-network-diagnostics/network-check-target-svqkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.482936 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz podName:5a4fe502-f835-4090-82fe-ed50ad79af7d nodeName:}" failed. No retries permitted until 2026-07-16 12:20:39.482925578 +0000 UTC m=+34.335126380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v22jz" (UniqueName: "kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz") pod "network-check-target-svqkk" (UID: "5a4fe502-f835-4090-82fe-ed50ad79af7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.482841 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:23.483217 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.482973 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs podName:8ce77094-7be6-4e19-9926-b7cc33b9fff3 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:39.482962595 +0000 UTC m=+34.335163399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs") pod "network-metrics-daemon-lxqfm" (UID: "8ce77094-7be6-4e19-9926-b7cc33b9fff3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:23.818586 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:23.818547 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:23.818812 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:23.818607 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:23.818812 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:23.818622 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:23.818812 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.818716 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:23.818812 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.818765 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:23.819014 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:23.818903 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:25.818923 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:25.818864 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:25.818923 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:25.818927 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:25.819462 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:25.818993 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:25.819462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:25.819076 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:25.819462 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:25.819062 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:25.819462 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:25.819173 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:27.821084 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.821056 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:27.821719 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.821157 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:27.821719 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:27.821167 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:27.821719 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.821191 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:27.821719 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:27.821284 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:27.821719 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:27.821392 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:27.946444 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.946230 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" event={"ID":"b76c956f-eb88-4b51-9ab9-45eaf4c77397","Type":"ContainerStarted","Data":"8477954be95b0b1c50646e6e7c3a06f5932a8acb1b24a76ed36e08214ed588f8"} Jul 16 12:20:27.947678 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.947652 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qrfnd" event={"ID":"8dfd361f-c637-4992-bc3d-195d93515460","Type":"ContainerStarted","Data":"af235db4bdfbed364f5401c2d7241f57bfd02de7d730e3b7bb683eeb3872cefa"} Jul 16 12:20:27.949172 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.949150 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s7w6z" event={"ID":"aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e","Type":"ContainerStarted","Data":"99a23f93b7021faaa066db23ba4efd7f09b439b10e398bb470492bd55d2ca1a6"} Jul 16 12:20:27.950916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.950867 2570 generic.go:356] "Generic (PLEG): container finished" podID="4eaa7819-97bc-4be4-823f-1b30eb9fd0fa" containerID="81ed1a0cb291cd618fa1412f4232a4d3719104813348008855795246899e3417" exitCode=0 Jul 16 12:20:27.951033 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.950979 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerDied","Data":"81ed1a0cb291cd618fa1412f4232a4d3719104813348008855795246899e3417"} Jul 16 12:20:27.952625 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.952595 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2j4wv" event={"ID":"94ea42dd-9d25-4218-b973-828ffd6d7796","Type":"ContainerStarted","Data":"2ebeeb2cabaddb4d4c123f32a0688259741adf431ebcb97ae857cda95c2955cb"} Jul 16 12:20:27.955334 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.955318 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:20:27.955714 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.955629 2570 generic.go:356] "Generic (PLEG): container finished" podID="f3ba8030-15f6-4204-8445-ef7ae53ac5d6" containerID="2bacb2ab9d89a0d30b3d00ad7ba055a2f8dd964b0d0eb76c0eab77fed3f89f83" exitCode=1 Jul 16 12:20:27.955714 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.955694 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"69193080a8b5ab64ac766c86328e9ff92e13600f8d18e06e6b2fd353c1c27677"} Jul 16 12:20:27.955860 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.955769 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"e641919ba2bdd93805af8fc22c124c280edcd2424c9b8d7394077d5cc72c379b"} Jul 16 12:20:27.955860 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.955821 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerDied","Data":"2bacb2ab9d89a0d30b3d00ad7ba055a2f8dd964b0d0eb76c0eab77fed3f89f83"} Jul 16 12:20:27.955986 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.955888 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"642344a9c32923166601338b10c174cf3079ff0327ed0a3293c41f62a46eb1af"} Jul 16 12:20:27.957195 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.957169 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zswmk" event={"ID":"f0f554ff-f6f4-4eef-b6bc-c6479f07511d","Type":"ContainerStarted","Data":"80c186d90c1a3cae4a3246887d1885bda871dc99810c768d6a61039440fcb540"} Jul 16 12:20:27.958663 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.958640 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-872t8" event={"ID":"2de93f5d-8172-4e3b-bc2f-20d83afac84c","Type":"ContainerStarted","Data":"d73df8099bd5e40c6d3128a4c3fce69b702488745fa5e0f07ac8f40c554d35ad"} Jul 16 12:20:27.969827 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.969787 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qrfnd" podStartSLOduration=7.682561944 podStartE2EDuration="21.969773639s" totalImagesPullingTime="14.287211695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:27.969584514 +0000 UTC m=+22.821785326" watchObservedRunningTime="2026-07-16 12:20:27.969773639 +0000 UTC m=+22.821974450" Jul 16 12:20:27.970179 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.970156 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-10.ec2.internal" podStartSLOduration=21.970151029 podStartE2EDuration="21.970151029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:10.927326338 +0000 UTC m=+5.779527149" watchObservedRunningTime="2026-07-16 12:20:27.970151029 +0000 UTC m=+22.822351840" Jul 16 12:20:27.984846 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:27.984800 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-872t8" podStartSLOduration=3.537366419 podStartE2EDuration="21.984783999s" totalImagesPullingTime="18.44741758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:27.984487298 +0000 UTC m=+22.836688112" watchObservedRunningTime="2026-07-16 12:20:27.984783999 +0000 UTC m=+22.836984810" Jul 16 12:20:28.007645 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.007597 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zswmk" podStartSLOduration=3.5601719320000003 podStartE2EDuration="22.007579904s" totalImagesPullingTime="18.447407972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:28.000018494 +0000 UTC m=+22.852219332" watchObservedRunningTime="2026-07-16 12:20:28.007579904 +0000 UTC m=+22.859780714" Jul 16 12:20:28.013778 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.013731 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s7w6z" podStartSLOduration=3.573227492 podStartE2EDuration="22.013714899s" totalImagesPullingTime="18.440487407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:28.013482163 +0000 UTC m=+22.865682975" watchObservedRunningTime="2026-07-16 12:20:28.013714899 +0000 UTC m=+22.865915709" Jul 16 12:20:28.038815 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.038765 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2j4wv" podStartSLOduration=3.5074905530000002 podStartE2EDuration="22.038747866s" totalImagesPullingTime="18.531257313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:28.037310891 +0000 UTC m=+22.889511703" watchObservedRunningTime="2026-07-16 12:20:28.038747866 +0000 UTC m=+22.890948676" Jul 16 12:20:28.845123 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.845091 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 12:20:28.865132 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.865099 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:28.865706 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.865687 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:28.964625 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.964599 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:20:28.965069 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.965037 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"76dda2ee172ec437311ea2c2ad1a6f53d29c173760b7ccf3da38543430b332f5"} Jul 16 12:20:28.965191 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.965117 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"00d35352812b4f9fe8f27f0f8e0c6f91bc1f1a7d5fc959dbc60bf423f7f6a582"} Jul 16 12:20:28.966718 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.966694 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k28hn" event={"ID":"2c06e44a-b5c2-487f-ae27-78a4f08f4044","Type":"ContainerStarted","Data":"e2915294919226a432249f9f412001059bd2564d9d0b5531c063372846acb4b2"} Jul 16 12:20:28.968451 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.968424 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" event={"ID":"b76c956f-eb88-4b51-9ab9-45eaf4c77397","Type":"ContainerStarted","Data":"12ec0c801f5da6fc64ebbceb02c22a40a09562d45c2fb335c1c3286c31003b7e"} Jul 16 12:20:28.969035 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.969014 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:28.969162 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.969144 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-872t8" Jul 16 12:20:28.986066 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:28.986007 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k28hn" podStartSLOduration=4.514421155 podStartE2EDuration="22.985986459s" totalImagesPullingTime="18.471565304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:28.985944022 +0000 UTC m=+23.838144835" watchObservedRunningTime="2026-07-16 12:20:28.985986459 +0000 UTC m=+23.838187276" Jul 16 12:20:29.720498 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:29.720398 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T12:20:28.84511637Z","UUID":"5cd80d39-4474-4d6f-a452-ed0f142f6028","Handler":null,"Name":"","Endpoint":""} Jul 16 12:20:29.721967 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:29.721937 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 12:20:29.722112 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:29.721982 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 12:20:29.818162 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:29.818128 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:29.818345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:29.818136 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:29.818345 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:29.818251 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:29.818345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:29.818140 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:29.818345 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:29.818334 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:29.818562 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:29.818423 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:30.978291 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:30.978053 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:20:30.980447 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:30.979098 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"764808ab8b992f8c4c21f40bacd826b26fd31cc0497901bd9b1f68886f698fe0"} Jul 16 12:20:30.983208 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:30.983179 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" event={"ID":"b76c956f-eb88-4b51-9ab9-45eaf4c77397","Type":"ContainerStarted","Data":"9081659c73057c214a09ee5abcd9b49850dea36054c9b96001ca34de0fabff8d"} Jul 16 12:20:31.818925 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:31.818529 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:31.818925 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:31.818531 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:31.818925 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:31.818674 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:31.818925 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:31.818677 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:31.818925 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:31.818767 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:31.818925 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:31.818843 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:33.818700 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.818515 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:33.819391 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.818515 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:33.819391 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.818515 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:33.819391 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:33.818825 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:33.819391 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:33.818906 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:33.819391 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:33.818999 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:33.992710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.992680 2570 generic.go:356] "Generic (PLEG): container finished" podID="4eaa7819-97bc-4be4-823f-1b30eb9fd0fa" containerID="36da0c59b73640d44cea08c65feb148b09c56ae47462412103678ae30cb40cf6" exitCode=0 Jul 16 12:20:33.992851 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.992759 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerDied","Data":"36da0c59b73640d44cea08c65feb148b09c56ae47462412103678ae30cb40cf6"} Jul 16 12:20:33.996375 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.996358 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:20:33.996756 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.996735 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"acca3f5ff820672be0eda70379724cf103ef4baec8a06636e2c9a1092135ca68"} Jul 16 12:20:33.997053 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.997035 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:33.997137 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.997102 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:33.997248 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.997172 2570 scope.go:117] "RemoveContainer" containerID="2bacb2ab9d89a0d30b3d00ad7ba055a2f8dd964b0d0eb76c0eab77fed3f89f83" Jul 16 12:20:33.997327 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:33.997315 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:34.013710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:34.013688 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:34.014436 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:34.014415 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:20:34.020180 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:34.020130 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhl4p" podStartSLOduration=7.451287649 podStartE2EDuration="28.020109384s" totalImagesPullingTime="20.568821735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:31.004321632 +0000 UTC m=+25.856522454" watchObservedRunningTime="2026-07-16 12:20:34.020109384 +0000 UTC m=+28.872310192" Jul 16 12:20:35.005853 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.005822 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:20:35.006416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.006304 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" event={"ID":"f3ba8030-15f6-4204-8445-ef7ae53ac5d6","Type":"ContainerStarted","Data":"261e6b145258295e4a4989197e3057d8e1867065f79affb2aeba8260e0be1ea3"} Jul 16 12:20:35.036444 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.036257 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" podStartSLOduration=10.475484806 podStartE2EDuration="29.036241304s" totalImagesPullingTime="18.560756498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:35.035766138 +0000 UTC m=+29.887967006" watchObservedRunningTime="2026-07-16 12:20:35.036241304 +0000 UTC m=+29.888442114" Jul 16 12:20:35.488562 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.488519 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lxqfm"] Jul 16 12:20:35.488812 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.488735 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:35.488928 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:35.488901 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:35.492189 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.492152 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6246f"] Jul 16 12:20:35.492360 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.492291 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:35.492428 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:35.492404 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:35.493101 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.493075 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svqkk"] Jul 16 12:20:35.493203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:35.493190 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:35.493302 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:35.493286 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:36.010393 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:36.010353 2570 generic.go:356] "Generic (PLEG): container finished" podID="4eaa7819-97bc-4be4-823f-1b30eb9fd0fa" containerID="156b11658aa7f25c4cbabb8375ce5205da543fd05ee77e01bd89523f480c8579" exitCode=0 Jul 16 12:20:36.010790 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:36.010446 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerDied","Data":"156b11658aa7f25c4cbabb8375ce5205da543fd05ee77e01bd89523f480c8579"} Jul 16 12:20:36.817871 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:36.817841 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:36.818011 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:36.817860 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:36.818011 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:36.817985 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:36.818088 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:36.817984 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:36.818130 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:36.818094 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:36.818180 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:36.818165 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:38.818543 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:38.818331 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:38.819299 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:38.818333 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:38.819299 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:38.818616 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svqkk" podUID="5a4fe502-f835-4090-82fe-ed50ad79af7d" Jul 16 12:20:38.819299 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:38.818333 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:38.819299 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:38.818692 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxqfm" podUID="8ce77094-7be6-4e19-9926-b7cc33b9fff3" Jul 16 12:20:38.819299 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:38.818783 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6246f" podUID="3d1c8afb-3295-4ea3-94cd-73ae61d2fb01" Jul 16 12:20:39.020197 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:39.020159 2570 generic.go:356] "Generic (PLEG): container finished" podID="4eaa7819-97bc-4be4-823f-1b30eb9fd0fa" containerID="d24db36095e0effad27605c7d3d9566414aab78a2a4dc2f95fe830110ba005c3" exitCode=0 Jul 16 12:20:39.020197 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:39.020204 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerDied","Data":"d24db36095e0effad27605c7d3d9566414aab78a2a4dc2f95fe830110ba005c3"} Jul 16 12:20:39.496275 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:39.496228 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:39.496475 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:39.496316 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:39.496475 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:39.496349 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:39.496475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:39.496412 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:20:39.496475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:39.496439 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:20:39.496475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:39.496453 2570 projected.go:196] Error preparing data for projected volume kube-api-access-v22jz for pod openshift-network-diagnostics/network-check-target-svqkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:39.496475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:39.496454 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:39.496475 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:39.496458 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:39.496745 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:39.496522 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs podName:8ce77094-7be6-4e19-9926-b7cc33b9fff3 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:11.496502075 +0000 UTC m=+66.348702865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs") pod "network-metrics-daemon-lxqfm" (UID: "8ce77094-7be6-4e19-9926-b7cc33b9fff3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:20:39.496745 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:39.496546 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz podName:5a4fe502-f835-4090-82fe-ed50ad79af7d nodeName:}" failed. No retries permitted until 2026-07-16 12:21:11.496534655 +0000 UTC m=+66.348735458 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v22jz" (UniqueName: "kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz") pod "network-check-target-svqkk" (UID: "5a4fe502-f835-4090-82fe-ed50ad79af7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:20:39.496745 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:39.496563 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret podName:3d1c8afb-3295-4ea3-94cd-73ae61d2fb01 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:11.496554418 +0000 UTC m=+66.348755213 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret") pod "global-pull-secret-syncer-6246f" (UID: "3d1c8afb-3295-4ea3-94cd-73ae61d2fb01") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:20:40.393512 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.393474 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-10.ec2.internal" event="NodeReady" Jul 16 12:20:40.394004 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.393631 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 12:20:40.436198 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.436167 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-674f575bbd-4962w"] Jul 16 12:20:40.440278 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.440222 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.442860 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.442832 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 12:20:40.443021 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.442859 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 12:20:40.443021 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.442832 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-drrn2\"" Jul 16 12:20:40.443021 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.442832 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 12:20:40.448848 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.448810 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 12:20:40.454023 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.452382 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-djqx8"] Jul 16 12:20:40.458301 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.458267 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-674f575bbd-4962w"] Jul 16 12:20:40.458441 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.458316 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zs5rp"] Jul 16 12:20:40.458441 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.458423 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.460738 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.460710 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 12:20:40.460738 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.460734 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-drvvw\"" Jul 16 12:20:40.460981 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.460915 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 12:20:40.462257 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.462236 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zs5rp" Jul 16 12:20:40.464428 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.464404 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-djqx8"] Jul 16 12:20:40.465028 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.464724 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-khcsh\"" Jul 16 12:20:40.465028 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.464784 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 12:20:40.465400 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.465380 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 12:20:40.465491 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.465404 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 12:20:40.468507 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.468475 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zs5rp"] Jul 16 12:20:40.604514 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-image-registry-private-configuration\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.604514 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604517 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0aaaae00-5d99-4149-8347-aba5bc6a4426-ca-trust-extracted\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.604738 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604542 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-trusted-ca\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.604738 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604647 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-bound-sa-token\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.604738 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604701 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-config-volume\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.604859 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.604859 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604758 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-installation-pull-secrets\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.604859 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-tmp-dir\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.604859 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604830 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vslkj\" (UniqueName: \"kubernetes.io/projected/0d588531-9df4-4f7d-b42f-3609a2a684d6-kube-api-access-vslkj\") pod \"ingress-canary-zs5rp\" (UID: \"0d588531-9df4-4f7d-b42f-3609a2a684d6\") " pod="openshift-ingress-canary/ingress-canary-zs5rp" Jul 16 12:20:40.605051 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604871 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d588531-9df4-4f7d-b42f-3609a2a684d6-cert\") pod \"ingress-canary-zs5rp\" (UID: \"0d588531-9df4-4f7d-b42f-3609a2a684d6\") " pod="openshift-ingress-canary/ingress-canary-zs5rp" Jul 16 12:20:40.605051 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604916 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-certificates\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.605051 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.604943 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v42f4\" (UniqueName: \"kubernetes.io/projected/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-kube-api-access-v42f4\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.605051 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.605009 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.605051 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.605042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt7kf\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-kube-api-access-kt7kf\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.705848 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.705745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-bound-sa-token\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.705848 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.705813 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-config-volume\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.705848 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.705837 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.705867 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-installation-pull-secrets\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.705914 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-tmp-dir\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.705935 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vslkj\" (UniqueName: \"kubernetes.io/projected/0d588531-9df4-4f7d-b42f-3609a2a684d6-kube-api-access-vslkj\") pod \"ingress-canary-zs5rp\" (UID: \"0d588531-9df4-4f7d-b42f-3609a2a684d6\") " pod="openshift-ingress-canary/ingress-canary-zs5rp" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.705962 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d588531-9df4-4f7d-b42f-3609a2a684d6-cert\") pod \"ingress-canary-zs5rp\" (UID: \"0d588531-9df4-4f7d-b42f-3609a2a684d6\") " pod="openshift-ingress-canary/ingress-canary-zs5rp" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.705989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-certificates\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.706012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v42f4\" (UniqueName: \"kubernetes.io/projected/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-kube-api-access-v42f4\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.706057 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.706078 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt7kf\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-kube-api-access-kt7kf\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.706123 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-image-registry-private-configuration\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.706151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0aaaae00-5d99-4149-8347-aba5bc6a4426-ca-trust-extracted\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.706226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.706178 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-trusted-ca\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.706769 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.706469 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-config-volume\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.706769 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:40.706496 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:20:40.706769 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:40.706517 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f575bbd-4962w: secret "image-registry-tls" not found Jul 16 12:20:40.706769 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:40.706577 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:20:40.707450 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:40.706581 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls podName:0aaaae00-5d99-4149-8347-aba5bc6a4426 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:41.206563927 +0000 UTC m=+36.058764730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls") pod "image-registry-674f575bbd-4962w" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426") : secret "image-registry-tls" not found Jul 16 12:20:40.707450 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:40.707027 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls podName:cc2a9eea-8c67-4488-a4c4-0426dcdbe012 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:41.206991287 +0000 UTC m=+36.059192085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls") pod "dns-default-djqx8" (UID: "cc2a9eea-8c67-4488-a4c4-0426dcdbe012") : secret "dns-default-metrics-tls" not found Jul 16 12:20:40.707450 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.707257 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0aaaae00-5d99-4149-8347-aba5bc6a4426-ca-trust-extracted\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.707450 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.707269 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-trusted-ca\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.707450 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.707292 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-certificates\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.707450 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.707297 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-tmp-dir\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.711938 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.711913 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d588531-9df4-4f7d-b42f-3609a2a684d6-cert\") pod \"ingress-canary-zs5rp\" (UID: \"0d588531-9df4-4f7d-b42f-3609a2a684d6\") " pod="openshift-ingress-canary/ingress-canary-zs5rp" Jul 16 12:20:40.711938 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.711921 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-image-registry-private-configuration\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.712127 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.711921 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-installation-pull-secrets\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.715970 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.715910 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-bound-sa-token\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.716468 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.716442 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vslkj\" (UniqueName: \"kubernetes.io/projected/0d588531-9df4-4f7d-b42f-3609a2a684d6-kube-api-access-vslkj\") pod \"ingress-canary-zs5rp\" (UID: \"0d588531-9df4-4f7d-b42f-3609a2a684d6\") " pod="openshift-ingress-canary/ingress-canary-zs5rp" Jul 16 12:20:40.716557 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.716464 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v42f4\" (UniqueName: \"kubernetes.io/projected/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-kube-api-access-v42f4\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:40.717168 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.717143 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt7kf\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-kube-api-access-kt7kf\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:40.779563 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.779524 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zs5rp" Jul 16 12:20:40.818425 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.818382 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:20:40.818584 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.818533 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:20:40.818584 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.818568 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:20:40.821448 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.821387 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 12:20:40.821855 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.821612 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 12:20:40.821855 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.821692 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qp65q\"" Jul 16 12:20:40.821855 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.821717 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 12:20:40.822051 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.821938 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 12:20:40.822418 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.822395 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6rr4c\"" Jul 16 12:20:40.947707 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:40.947669 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zs5rp"] Jul 16 12:20:40.952673 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:40.952643 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d588531_9df4_4f7d_b42f_3609a2a684d6.slice/crio-d6108194756a364184575e47afb8debc3d3b9492aceb97a8ca6052d24861e41f WatchSource:0}: Error finding container d6108194756a364184575e47afb8debc3d3b9492aceb97a8ca6052d24861e41f: Status 404 returned error can't find the container with id d6108194756a364184575e47afb8debc3d3b9492aceb97a8ca6052d24861e41f Jul 16 12:20:41.027031 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:41.026991 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zs5rp" event={"ID":"0d588531-9df4-4f7d-b42f-3609a2a684d6","Type":"ContainerStarted","Data":"d6108194756a364184575e47afb8debc3d3b9492aceb97a8ca6052d24861e41f"} Jul 16 12:20:41.211040 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:41.210944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:41.211219 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:41.211047 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:41.211219 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:41.211113 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:20:41.211219 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:41.211131 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f575bbd-4962w: secret "image-registry-tls" not found Jul 16 12:20:41.211219 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:41.211139 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:20:41.211219 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:41.211192 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls podName:cc2a9eea-8c67-4488-a4c4-0426dcdbe012 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:42.211176433 +0000 UTC m=+37.063377230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls") pod "dns-default-djqx8" (UID: "cc2a9eea-8c67-4488-a4c4-0426dcdbe012") : secret "dns-default-metrics-tls" not found Jul 16 12:20:41.211219 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:41.211207 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls podName:0aaaae00-5d99-4149-8347-aba5bc6a4426 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:42.21120201 +0000 UTC m=+37.063402799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls") pod "image-registry-674f575bbd-4962w" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426") : secret "image-registry-tls" not found Jul 16 12:20:41.849596 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:41.849546 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:41.951826 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:41.951789 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:42.011065 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:42.011019 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:42.219719 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:42.219626 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:42.219920 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:42.219850 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:20:42.220392 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:42.220368 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls podName:cc2a9eea-8c67-4488-a4c4-0426dcdbe012 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:44.220343762 +0000 UTC m=+39.072544554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls") pod "dns-default-djqx8" (UID: "cc2a9eea-8c67-4488-a4c4-0426dcdbe012") : secret "dns-default-metrics-tls" not found Jul 16 12:20:42.220516 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:42.220422 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:42.220563 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:42.220543 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:20:42.220612 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:42.220578 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f575bbd-4962w: secret "image-registry-tls" not found Jul 16 12:20:42.220661 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:42.220624 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls podName:0aaaae00-5d99-4149-8347-aba5bc6a4426 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:44.220603486 +0000 UTC m=+39.072804277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls") pod "image-registry-674f575bbd-4962w" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426") : secret "image-registry-tls" not found Jul 16 12:20:44.038481 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.038205 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zs5rp" event={"ID":"0d588531-9df4-4f7d-b42f-3609a2a684d6","Type":"ContainerStarted","Data":"73c3a4477650fad87bb5802fbb4e4e2c0b4757eaef07a32fc30452b82e681c53"} Jul 16 12:20:44.041413 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.041379 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerStarted","Data":"8242adac52927478f24a571d4164bfab3ed670872a1267e053b3eba71b15c076"} Jul 16 12:20:44.059960 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.059896 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zs5rp" podStartSLOduration=1.147094122 podStartE2EDuration="4.059852164s" totalImagesPullingTime="2.912758042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:44.058999744 +0000 UTC m=+38.911200559" watchObservedRunningTime="2026-07-16 12:20:44.059852164 +0000 UTC m=+38.912053008" Jul 16 12:20:44.237861 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.237818 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:44.238028 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.237896 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:44.238028 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.237988 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:20:44.238028 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.238009 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f575bbd-4962w: secret "image-registry-tls" not found Jul 16 12:20:44.238028 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.237986 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:20:44.238171 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.238066 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls podName:0aaaae00-5d99-4149-8347-aba5bc6a4426 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:48.23805106 +0000 UTC m=+43.090251852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls") pod "image-registry-674f575bbd-4962w" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426") : secret "image-registry-tls" not found Jul 16 12:20:44.238171 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.238079 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls podName:cc2a9eea-8c67-4488-a4c4-0426dcdbe012 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:48.238073727 +0000 UTC m=+43.090274516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls") pod "dns-default-djqx8" (UID: "cc2a9eea-8c67-4488-a4c4-0426dcdbe012") : secret "dns-default-metrics-tls" not found Jul 16 12:20:44.526560 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.526484 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-twttw"] Jul 16 12:20:44.539943 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.539911 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.541626 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.541596 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-twttw"] Jul 16 12:20:44.542710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.542689 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 12:20:44.542810 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.542734 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 12:20:44.542810 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.542690 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 12:20:44.542957 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.542894 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-29tfz\"" Jul 16 12:20:44.543847 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.543830 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 12:20:44.548561 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.548536 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 12:20:44.629677 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.629641 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4"] Jul 16 12:20:44.641020 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.640980 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179cd1bb-64f3-4af6-927b-58ee4e78cf15-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.641020 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.641021 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb2l2\" (UniqueName: \"kubernetes.io/projected/179cd1bb-64f3-4af6-927b-58ee4e78cf15-kube-api-access-zb2l2\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.641260 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.641092 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/179cd1bb-64f3-4af6-927b-58ee4e78cf15-serving-cert\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.641260 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.641199 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/179cd1bb-64f3-4af6-927b-58ee4e78cf15-snapshots\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.641361 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.641266 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/179cd1bb-64f3-4af6-927b-58ee4e78cf15-tmp\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.641361 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.641291 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179cd1bb-64f3-4af6-927b-58ee4e78cf15-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.646725 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.646691 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f8649488-lw5qn"] Jul 16 12:20:44.646834 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.646813 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.649866 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.649843 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 12:20:44.651123 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.651097 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nprhb\"" Jul 16 12:20:44.651239 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.651136 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 12:20:44.651239 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.651136 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 12:20:44.651239 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.651140 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 12:20:44.656764 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.656739 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4"] Jul 16 12:20:44.656916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.656856 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.657554 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.657529 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f8649488-lw5qn"] Jul 16 12:20:44.659407 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.659389 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 16 12:20:44.659507 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.659412 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 16 12:20:44.659828 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.659813 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 16 12:20:44.659924 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.659909 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9dcsb\"" Jul 16 12:20:44.660143 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.660121 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 12:20:44.660254 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.660161 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 16 12:20:44.660254 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.660163 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 12:20:44.742187 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.742145 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/179cd1bb-64f3-4af6-927b-58ee4e78cf15-serving-cert\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.742359 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.742313 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/179cd1bb-64f3-4af6-927b-58ee4e78cf15-snapshots\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.742442 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.742385 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/179cd1bb-64f3-4af6-927b-58ee4e78cf15-tmp\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.742442 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.742407 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179cd1bb-64f3-4af6-927b-58ee4e78cf15-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.742529 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.742443 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179cd1bb-64f3-4af6-927b-58ee4e78cf15-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.742529 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.742473 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb2l2\" (UniqueName: \"kubernetes.io/projected/179cd1bb-64f3-4af6-927b-58ee4e78cf15-kube-api-access-zb2l2\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.743077 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.743052 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/179cd1bb-64f3-4af6-927b-58ee4e78cf15-tmp\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.743177 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.743081 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179cd1bb-64f3-4af6-927b-58ee4e78cf15-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.743177 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.743124 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/179cd1bb-64f3-4af6-927b-58ee4e78cf15-snapshots\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.743419 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.743403 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179cd1bb-64f3-4af6-927b-58ee4e78cf15-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.745786 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.745769 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/179cd1bb-64f3-4af6-927b-58ee4e78cf15-serving-cert\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.751768 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.751740 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb2l2\" (UniqueName: \"kubernetes.io/projected/179cd1bb-64f3-4af6-927b-58ee4e78cf15-kube-api-access-zb2l2\") pod \"insights-operator-68d9dd94cf-twttw\" (UID: \"179cd1bb-64f3-4af6-927b-58ee4e78cf15\") " pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.798691 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.798602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:44.843785 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.843742 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.843995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.843819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lnrj\" (UniqueName: \"kubernetes.io/projected/e2141df0-1926-4524-9c52-14cf694c6022-kube-api-access-9lnrj\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.843995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.843892 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-stats-auth\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.843995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.843930 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-default-certificate\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.843995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.843970 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.844175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.844050 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.844175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.844089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.844175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.844111 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtzcj\" (UniqueName: \"kubernetes.io/projected/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-kube-api-access-vtzcj\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.850926 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.850893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-twttw" Jul 16 12:20:44.874727 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.874692 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:44.945501 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.945305 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-stats-auth\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.945634 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.945525 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-default-certificate\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.945634 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.945560 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.945634 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.945591 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.945634 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.945611 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.945855 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.945636 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtzcj\" (UniqueName: \"kubernetes.io/projected/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-kube-api-access-vtzcj\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.945855 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.945666 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.945855 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.945688 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:44.945855 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.945781 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls podName:3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad nodeName:}" failed. No retries permitted until 2026-07-16 12:20:45.445757586 +0000 UTC m=+40.297958377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xlts4" (UID: "3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad") : secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:44.945855 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.945803 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:45.44579207 +0000 UTC m=+40.297992859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : configmap references non-existent config key: service-ca.crt Jul 16 12:20:44.945855 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.945810 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 12:20:44.945855 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:44.945851 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:45.445834975 +0000 UTC m=+40.298035775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : secret "router-metrics-certs-default" not found Jul 16 12:20:44.946138 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.945869 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lnrj\" (UniqueName: \"kubernetes.io/projected/e2141df0-1926-4524-9c52-14cf694c6022-kube-api-access-9lnrj\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.946573 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.946551 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.949277 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.948974 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-stats-auth\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.949433 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.949400 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-default-certificate\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.955706 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.955683 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lnrj\" (UniqueName: \"kubernetes.io/projected/e2141df0-1926-4524-9c52-14cf694c6022-kube-api-access-9lnrj\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:44.956037 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.956011 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtzcj\" (UniqueName: \"kubernetes.io/projected/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-kube-api-access-vtzcj\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:44.994725 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:44.994692 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-twttw"] Jul 16 12:20:44.998434 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:44.998406 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179cd1bb_64f3_4af6_927b_58ee4e78cf15.slice/crio-49a29f54b46e0c829c6c2884e994ca587fcc2594d16c30be6ee6a12cca125624 WatchSource:0}: Error finding container 49a29f54b46e0c829c6c2884e994ca587fcc2594d16c30be6ee6a12cca125624: Status 404 returned error can't find the container with id 49a29f54b46e0c829c6c2884e994ca587fcc2594d16c30be6ee6a12cca125624 Jul 16 12:20:45.045405 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.045372 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-twttw" event={"ID":"179cd1bb-64f3-4af6-927b-58ee4e78cf15","Type":"ContainerStarted","Data":"49a29f54b46e0c829c6c2884e994ca587fcc2594d16c30be6ee6a12cca125624"} Jul 16 12:20:45.048285 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.048255 2570 generic.go:356] "Generic (PLEG): container finished" podID="4eaa7819-97bc-4be4-823f-1b30eb9fd0fa" containerID="8242adac52927478f24a571d4164bfab3ed670872a1267e053b3eba71b15c076" exitCode=0 Jul 16 12:20:45.048434 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.048355 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerDied","Data":"8242adac52927478f24a571d4164bfab3ed670872a1267e053b3eba71b15c076"} Jul 16 12:20:45.450230 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.450200 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:45.450472 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.450299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:45.450472 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.450333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:45.450472 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:45.450355 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 12:20:45.450472 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:45.450419 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:46.450404635 +0000 UTC m=+41.302605424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : secret "router-metrics-certs-default" not found Jul 16 12:20:45.450472 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:45.450429 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:45.450472 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:45.450434 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:46.450426846 +0000 UTC m=+41.302627634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : configmap references non-existent config key: service-ca.crt Jul 16 12:20:45.450472 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:45.450478 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls podName:3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad nodeName:}" failed. No retries permitted until 2026-07-16 12:20:46.45046506 +0000 UTC m=+41.302665849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xlts4" (UID: "3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad") : secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:45.501437 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.501401 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv"] Jul 16 12:20:45.523972 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.523941 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv"] Jul 16 12:20:45.524135 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.524054 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv" Jul 16 12:20:45.528670 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.528631 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:20:45.528852 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.528681 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6dqnf\"" Jul 16 12:20:45.528852 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.528681 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 12:20:45.551373 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.551330 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvbss\" (UniqueName: \"kubernetes.io/projected/fa91a08c-add6-4bbe-9c70-93f7e707527e-kube-api-access-lvbss\") pod \"volume-data-source-validator-78495597f6-4fbnv\" (UID: \"fa91a08c-add6-4bbe-9c70-93f7e707527e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv" Jul 16 12:20:45.600639 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.600575 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd"] Jul 16 12:20:45.618411 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.618369 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd"] Jul 16 12:20:45.618591 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.618503 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:45.621711 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.621687 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 16 12:20:45.621711 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.621699 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:20:45.621976 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.621699 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 16 12:20:45.621976 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.621704 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zf5xf\"" Jul 16 12:20:45.651841 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.651808 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvbss\" (UniqueName: \"kubernetes.io/projected/fa91a08c-add6-4bbe-9c70-93f7e707527e-kube-api-access-lvbss\") pod \"volume-data-source-validator-78495597f6-4fbnv\" (UID: \"fa91a08c-add6-4bbe-9c70-93f7e707527e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv" Jul 16 12:20:45.652027 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.651901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:45.652027 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.651940 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwl74\" (UniqueName: \"kubernetes.io/projected/a60b1c19-f45b-46dc-b2e4-072948cf5785-kube-api-access-dwl74\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:45.661592 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.661564 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvbss\" (UniqueName: \"kubernetes.io/projected/fa91a08c-add6-4bbe-9c70-93f7e707527e-kube-api-access-lvbss\") pod \"volume-data-source-validator-78495597f6-4fbnv\" (UID: \"fa91a08c-add6-4bbe-9c70-93f7e707527e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv" Jul 16 12:20:45.752727 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.752631 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:45.752727 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.752716 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwl74\" (UniqueName: \"kubernetes.io/projected/a60b1c19-f45b-46dc-b2e4-072948cf5785-kube-api-access-dwl74\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:45.753005 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:45.752805 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 12:20:45.753005 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:45.752916 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls podName:a60b1c19-f45b-46dc-b2e4-072948cf5785 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:46.252893944 +0000 UTC m=+41.105094748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls") pod "cluster-samples-operator-65db858894-265jd" (UID: "a60b1c19-f45b-46dc-b2e4-072948cf5785") : secret "samples-operator-tls" not found Jul 16 12:20:45.765369 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.765332 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwl74\" (UniqueName: \"kubernetes.io/projected/a60b1c19-f45b-46dc-b2e4-072948cf5785-kube-api-access-dwl74\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:45.836363 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:45.836324 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv" Jul 16 12:20:46.029767 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.029672 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv"] Jul 16 12:20:46.044832 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:46.044783 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa91a08c_add6_4bbe_9c70_93f7e707527e.slice/crio-b724e7f7dd8cb23dac18fb8f8e9578cbc6343ecfa6e3490e685670dceac3d42e WatchSource:0}: Error finding container b724e7f7dd8cb23dac18fb8f8e9578cbc6343ecfa6e3490e685670dceac3d42e: Status 404 returned error can't find the container with id b724e7f7dd8cb23dac18fb8f8e9578cbc6343ecfa6e3490e685670dceac3d42e Jul 16 12:20:46.054717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.054680 2570 generic.go:356] "Generic (PLEG): container finished" podID="4eaa7819-97bc-4be4-823f-1b30eb9fd0fa" containerID="c9e177307e4530c4d69f6858b5f5b142fb369242eccc5177d62e702acdde5c08" exitCode=0 Jul 16 12:20:46.055125 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.054785 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerDied","Data":"c9e177307e4530c4d69f6858b5f5b142fb369242eccc5177d62e702acdde5c08"} Jul 16 12:20:46.056300 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.056272 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv" event={"ID":"fa91a08c-add6-4bbe-9c70-93f7e707527e","Type":"ContainerStarted","Data":"b724e7f7dd8cb23dac18fb8f8e9578cbc6343ecfa6e3490e685670dceac3d42e"} Jul 16 12:20:46.240819 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.240782 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:46.256578 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.256548 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:46.256784 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:46.256722 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 12:20:46.256857 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:46.256804 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls podName:a60b1c19-f45b-46dc-b2e4-072948cf5785 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:47.2567826 +0000 UTC m=+42.108983404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls") pod "cluster-samples-operator-65db858894-265jd" (UID: "a60b1c19-f45b-46dc-b2e4-072948cf5785") : secret "samples-operator-tls" not found Jul 16 12:20:46.342232 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.342184 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:46.458225 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.458188 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:46.458410 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.458336 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:46.458410 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:46.458348 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 12:20:46.458410 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.458393 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:46.458565 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:46.458416 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:48.458396613 +0000 UTC m=+43.310597417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : secret "router-metrics-certs-default" not found Jul 16 12:20:46.458565 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:46.458460 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:46.458565 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:46.458472 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:48.458462195 +0000 UTC m=+43.310662983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : configmap references non-existent config key: service-ca.crt Jul 16 12:20:46.458565 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:46.458549 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls podName:3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad nodeName:}" failed. No retries permitted until 2026-07-16 12:20:48.458527705 +0000 UTC m=+43.310728495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xlts4" (UID: "3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad") : secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:46.511391 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.511357 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-5x9lg"] Jul 16 12:20:46.528557 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.528523 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5x9lg"] Jul 16 12:20:46.528718 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.528646 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.531593 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.531520 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 12:20:46.531755 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.531658 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cpwbv\"" Jul 16 12:20:46.531755 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.531687 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 12:20:46.531897 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.531764 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 12:20:46.532016 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.531993 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:20:46.537867 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.537844 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 12:20:46.559383 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.559345 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90df5fb6-dd25-4493-ba24-73892e0c372e-config\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.559570 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.559511 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl2qr\" (UniqueName: \"kubernetes.io/projected/90df5fb6-dd25-4493-ba24-73892e0c372e-kube-api-access-cl2qr\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.559570 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.559546 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90df5fb6-dd25-4493-ba24-73892e0c372e-serving-cert\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.559705 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.559619 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90df5fb6-dd25-4493-ba24-73892e0c372e-trusted-ca\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.661031 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.660947 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90df5fb6-dd25-4493-ba24-73892e0c372e-config\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.661203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.661085 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2qr\" (UniqueName: \"kubernetes.io/projected/90df5fb6-dd25-4493-ba24-73892e0c372e-kube-api-access-cl2qr\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.661203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.661112 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90df5fb6-dd25-4493-ba24-73892e0c372e-serving-cert\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.661203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.661166 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90df5fb6-dd25-4493-ba24-73892e0c372e-trusted-ca\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.661730 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.661709 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90df5fb6-dd25-4493-ba24-73892e0c372e-config\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.662206 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.662115 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90df5fb6-dd25-4493-ba24-73892e0c372e-trusted-ca\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.665779 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.665541 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90df5fb6-dd25-4493-ba24-73892e0c372e-serving-cert\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.672741 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.672698 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2qr\" (UniqueName: \"kubernetes.io/projected/90df5fb6-dd25-4493-ba24-73892e0c372e-kube-api-access-cl2qr\") pod \"console-operator-7866497494-5x9lg\" (UID: \"90df5fb6-dd25-4493-ba24-73892e0c372e\") " pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:46.840473 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:46.840242 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:47.062529 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:47.062486 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxm82" event={"ID":"4eaa7819-97bc-4be4-823f-1b30eb9fd0fa","Type":"ContainerStarted","Data":"c39dd6c9d57d035bb14fea696d8ce380cbf76f485fb04c514e404437802fcef8"} Jul 16 12:20:47.088846 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:47.088793 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kxm82" podStartSLOduration=9.13931326 podStartE2EDuration="41.088772927s" totalImagesPullingTime="31.949459667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:47.086954171 +0000 UTC m=+41.939154982" watchObservedRunningTime="2026-07-16 12:20:47.088772927 +0000 UTC m=+41.940973735" Jul 16 12:20:47.157268 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:47.157232 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5x9lg"] Jul 16 12:20:47.160161 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:47.160126 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90df5fb6_dd25_4493_ba24_73892e0c372e.slice/crio-c523bd2051c3852f26bb87103d9fd92e642df8f28478662d9ed7d9cdb314af13 WatchSource:0}: Error finding container c523bd2051c3852f26bb87103d9fd92e642df8f28478662d9ed7d9cdb314af13: Status 404 returned error can't find the container with id c523bd2051c3852f26bb87103d9fd92e642df8f28478662d9ed7d9cdb314af13 Jul 16 12:20:47.212765 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:47.212729 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:47.267436 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:47.267400 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:47.267647 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:47.267573 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 12:20:47.267713 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:47.267653 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls podName:a60b1c19-f45b-46dc-b2e4-072948cf5785 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:49.26763027 +0000 UTC m=+44.119831065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls") pod "cluster-samples-operator-65db858894-265jd" (UID: "a60b1c19-f45b-46dc-b2e4-072948cf5785") : secret "samples-operator-tls" not found Jul 16 12:20:48.066213 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.066169 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-twttw" event={"ID":"179cd1bb-64f3-4af6-927b-58ee4e78cf15","Type":"ContainerStarted","Data":"c308dba13f58a6782ff2b7ee94ed8de87dae0cd5d5f787437d45fab702a5bec8"} Jul 16 12:20:48.067411 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.067384 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5x9lg" event={"ID":"90df5fb6-dd25-4493-ba24-73892e0c372e","Type":"ContainerStarted","Data":"c523bd2051c3852f26bb87103d9fd92e642df8f28478662d9ed7d9cdb314af13"} Jul 16 12:20:48.098664 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.098549 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-twttw" podStartSLOduration=1.372346176 podStartE2EDuration="4.098525016s" totalImagesPullingTime="2.72617884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:48.098231701 +0000 UTC m=+42.950432507" watchObservedRunningTime="2026-07-16 12:20:48.098525016 +0000 UTC m=+42.950725829" Jul 16 12:20:48.275452 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.275401 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:48.275650 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.275479 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:48.275650 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.275579 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:20:48.275650 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.275610 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f575bbd-4962w: secret "image-registry-tls" not found Jul 16 12:20:48.275840 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.275680 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls podName:0aaaae00-5d99-4149-8347-aba5bc6a4426 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:56.275657029 +0000 UTC m=+51.127857833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls") pod "image-registry-674f575bbd-4962w" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426") : secret "image-registry-tls" not found Jul 16 12:20:48.275840 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.275587 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:20:48.275840 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.275763 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls podName:cc2a9eea-8c67-4488-a4c4-0426dcdbe012 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:56.27574263 +0000 UTC m=+51.127943419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls") pod "dns-default-djqx8" (UID: "cc2a9eea-8c67-4488-a4c4-0426dcdbe012") : secret "dns-default-metrics-tls" not found Jul 16 12:20:48.329513 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.329460 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:48.477169 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.477128 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:48.477370 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.477201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:48.477370 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:48.477239 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:48.477370 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.477297 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:48.477370 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.477363 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:52.477342695 +0000 UTC m=+47.329543500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : configmap references non-existent config key: service-ca.crt Jul 16 12:20:48.477600 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.477383 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls podName:3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad nodeName:}" failed. No retries permitted until 2026-07-16 12:20:52.477374919 +0000 UTC m=+47.329575708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xlts4" (UID: "3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad") : secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:48.477600 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.477406 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 12:20:48.477600 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:48.477474 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:52.477453997 +0000 UTC m=+47.329654808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : secret "router-metrics-certs-default" not found Jul 16 12:20:49.073169 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.073090 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv" event={"ID":"fa91a08c-add6-4bbe-9c70-93f7e707527e","Type":"ContainerStarted","Data":"aa70af547e75e39f53a97be8b5f1b25dd08fc39ce5986e9136fe7bf546209e72"} Jul 16 12:20:49.090820 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.090755 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-4fbnv" podStartSLOduration=2.079722388 podStartE2EDuration="4.090732773s" totalImagesPullingTime="2.011010385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:49.089657154 +0000 UTC m=+43.941857966" watchObservedRunningTime="2026-07-16 12:20:49.090732773 +0000 UTC m=+43.942933585" Jul 16 12:20:49.201335 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.201283 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:49.284076 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.284023 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:49.284245 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:49.284176 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 12:20:49.284245 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:49.284239 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls podName:a60b1c19-f45b-46dc-b2e4-072948cf5785 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:53.284222002 +0000 UTC m=+48.136422794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls") pod "cluster-samples-operator-65db858894-265jd" (UID: "a60b1c19-f45b-46dc-b2e4-072948cf5785") : secret "samples-operator-tls" not found Jul 16 12:20:49.293355 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.293319 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:49.395470 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.395378 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-82gfb"] Jul 16 12:20:49.412593 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.412557 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.414646 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.414577 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-82gfb"] Jul 16 12:20:49.415521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.415496 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 12:20:49.415521 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.415502 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tkvf\"" Jul 16 12:20:49.415762 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.415522 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 12:20:49.483430 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.483395 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:49.486175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.486145 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-crio-socket\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.486327 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.486191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmq9n\" (UniqueName: \"kubernetes.io/projected/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-api-access-wmq9n\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.486374 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.486324 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-data-volume\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.486374 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.486355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.486456 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.486380 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.587282 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.587240 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-crio-socket\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.587282 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.587286 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmq9n\" (UniqueName: \"kubernetes.io/projected/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-api-access-wmq9n\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.587544 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.587397 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-data-volume\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.587544 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.587428 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.587544 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.587448 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.587544 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.587524 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-crio-socket\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.587684 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:49.587553 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:20:49.587684 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:49.587576 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:20:49.587684 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:49.587618 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:50.087599764 +0000 UTC m=+44.939800553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : secret "insights-runtime-extractor-tls" not found Jul 16 12:20:49.587684 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:49.587635 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:50.087625955 +0000 UTC m=+44.939826745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : configmap "kube-rbac-proxy" not found Jul 16 12:20:49.597313 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.597278 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-data-volume\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:49.601082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:49.601057 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmq9n\" (UniqueName: \"kubernetes.io/projected/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-api-access-wmq9n\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:50.076857 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.076831 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/0.log" Jul 16 12:20:50.077283 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.076889 2570 generic.go:356] "Generic (PLEG): container finished" podID="90df5fb6-dd25-4493-ba24-73892e0c372e" containerID="aa56ab4074732996f4cae7dc28122743dc2704f30c4053a79814654366042f53" exitCode=255 Jul 16 12:20:50.077283 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.076982 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5x9lg" event={"ID":"90df5fb6-dd25-4493-ba24-73892e0c372e","Type":"ContainerDied","Data":"aa56ab4074732996f4cae7dc28122743dc2704f30c4053a79814654366042f53"} Jul 16 12:20:50.077283 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.077213 2570 scope.go:117] "RemoveContainer" containerID="aa56ab4074732996f4cae7dc28122743dc2704f30c4053a79814654366042f53" Jul 16 12:20:50.091590 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.091467 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:50.091590 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:50.091556 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:20:50.091740 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:50.091615 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:51.091597595 +0000 UTC m=+45.943798388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : configmap "kube-rbac-proxy" not found Jul 16 12:20:50.091740 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.091636 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:50.091862 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:50.091823 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:20:50.091933 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:50.091869 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:51.091853683 +0000 UTC m=+45.944054488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : secret "insights-runtime-extractor-tls" not found Jul 16 12:20:50.508443 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.508352 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm"] Jul 16 12:20:50.544160 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.544117 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm"] Jul 16 12:20:50.544339 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.544258 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.547804 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.547769 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:20:50.547968 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.547780 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9hvrj\"" Jul 16 12:20:50.548081 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.548064 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 12:20:50.548159 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.548143 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 12:20:50.548221 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.548153 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 12:20:50.596954 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.596915 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b58c4c06-bf79-45c4-9be0-f303f5b942c6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.597137 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.596978 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm4kl\" (UniqueName: \"kubernetes.io/projected/b58c4c06-bf79-45c4-9be0-f303f5b942c6-kube-api-access-rm4kl\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.597181 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.597157 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b58c4c06-bf79-45c4-9be0-f303f5b942c6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.698140 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.698094 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b58c4c06-bf79-45c4-9be0-f303f5b942c6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.698361 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.698199 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b58c4c06-bf79-45c4-9be0-f303f5b942c6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.698361 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.698249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm4kl\" (UniqueName: \"kubernetes.io/projected/b58c4c06-bf79-45c4-9be0-f303f5b942c6-kube-api-access-rm4kl\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.698832 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.698807 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b58c4c06-bf79-45c4-9be0-f303f5b942c6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.700538 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.700513 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b58c4c06-bf79-45c4-9be0-f303f5b942c6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.707506 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.707476 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm4kl\" (UniqueName: \"kubernetes.io/projected/b58c4c06-bf79-45c4-9be0-f303f5b942c6-kube-api-access-rm4kl\") pod \"kube-storage-version-migrator-operator-799cb7f958-qx8sm\" (UID: \"b58c4c06-bf79-45c4-9be0-f303f5b942c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:50.803991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.803866 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qrfnd_8dfd361f-c637-4992-bc3d-195d93515460/dns-node-resolver/0.log" Jul 16 12:20:50.854165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:50.854121 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" Jul 16 12:20:51.021785 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.021760 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm"] Jul 16 12:20:51.024309 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:51.024281 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58c4c06_bf79_45c4_9be0_f303f5b942c6.slice/crio-bd4b0d4fc3c3f03a6931dd1694f425104ca3e5406bdb3abfd64da88943193c52 WatchSource:0}: Error finding container bd4b0d4fc3c3f03a6931dd1694f425104ca3e5406bdb3abfd64da88943193c52: Status 404 returned error can't find the container with id bd4b0d4fc3c3f03a6931dd1694f425104ca3e5406bdb3abfd64da88943193c52 Jul 16 12:20:51.081631 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.081594 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" event={"ID":"b58c4c06-bf79-45c4-9be0-f303f5b942c6","Type":"ContainerStarted","Data":"bd4b0d4fc3c3f03a6931dd1694f425104ca3e5406bdb3abfd64da88943193c52"} Jul 16 12:20:51.083255 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.083233 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:20:51.083664 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.083649 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/0.log" Jul 16 12:20:51.083711 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.083684 2570 generic.go:356] "Generic (PLEG): container finished" podID="90df5fb6-dd25-4493-ba24-73892e0c372e" containerID="6c577afc631233166b78503ff5ebb331e27c09291d9e39eb7fa0d714c514e244" exitCode=255 Jul 16 12:20:51.083744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.083715 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5x9lg" event={"ID":"90df5fb6-dd25-4493-ba24-73892e0c372e","Type":"ContainerDied","Data":"6c577afc631233166b78503ff5ebb331e27c09291d9e39eb7fa0d714c514e244"} Jul 16 12:20:51.083779 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.083756 2570 scope.go:117] "RemoveContainer" containerID="aa56ab4074732996f4cae7dc28122743dc2704f30c4053a79814654366042f53" Jul 16 12:20:51.084027 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.084006 2570 scope.go:117] "RemoveContainer" containerID="6c577afc631233166b78503ff5ebb331e27c09291d9e39eb7fa0d714c514e244" Jul 16 12:20:51.084244 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:51.084220 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5x9lg_openshift-console-operator(90df5fb6-dd25-4493-ba24-73892e0c372e)\"" pod="openshift-console-operator/console-operator-7866497494-5x9lg" podUID="90df5fb6-dd25-4493-ba24-73892e0c372e" Jul 16 12:20:51.102766 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.102730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:51.102997 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.102797 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:51.102997 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:51.102910 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:20:51.102997 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:51.102940 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:20:51.102997 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:51.102983 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:53.102956175 +0000 UTC m=+47.955157035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : configmap "kube-rbac-proxy" not found Jul 16 12:20:51.103211 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:51.103054 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:53.10303652 +0000 UTC m=+47.955237324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : secret "insights-runtime-extractor-tls" not found Jul 16 12:20:51.292672 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.292637 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd"] Jul 16 12:20:51.316812 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.316781 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd"] Jul 16 12:20:51.316990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.316907 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd" Jul 16 12:20:51.319963 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.319937 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fwpvz\"" Jul 16 12:20:51.407016 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.406923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bggjz\" (UniqueName: \"kubernetes.io/projected/48413f57-2840-4686-a768-cc1260315c7c-kube-api-access-bggjz\") pod \"network-check-source-869dcfcdcd-2xthd\" (UID: \"48413f57-2840-4686-a768-cc1260315c7c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd" Jul 16 12:20:51.507899 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.507842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bggjz\" (UniqueName: \"kubernetes.io/projected/48413f57-2840-4686-a768-cc1260315c7c-kube-api-access-bggjz\") pod \"network-check-source-869dcfcdcd-2xthd\" (UID: \"48413f57-2840-4686-a768-cc1260315c7c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd" Jul 16 12:20:51.517462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.517426 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bggjz\" (UniqueName: \"kubernetes.io/projected/48413f57-2840-4686-a768-cc1260315c7c-kube-api-access-bggjz\") pod \"network-check-source-869dcfcdcd-2xthd\" (UID: \"48413f57-2840-4686-a768-cc1260315c7c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd" Jul 16 12:20:51.603800 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.603765 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s7w6z_aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e/node-ca/0.log" Jul 16 12:20:51.626106 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.626070 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd" Jul 16 12:20:51.779059 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:51.778862 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd"] Jul 16 12:20:51.781992 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:51.781961 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48413f57_2840_4686_a768_cc1260315c7c.slice/crio-1550e4370be40efff8541efa5d1f3657fc02ff634fc9781d68861120ee813b3e WatchSource:0}: Error finding container 1550e4370be40efff8541efa5d1f3657fc02ff634fc9781d68861120ee813b3e: Status 404 returned error can't find the container with id 1550e4370be40efff8541efa5d1f3657fc02ff634fc9781d68861120ee813b3e Jul 16 12:20:52.004534 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:52.004450 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zs5rp_0d588531-9df4-4f7d-b42f-3609a2a684d6/serve-healthcheck-canary/0.log" Jul 16 12:20:52.088320 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:52.088289 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:20:52.088809 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:52.088744 2570 scope.go:117] "RemoveContainer" containerID="6c577afc631233166b78503ff5ebb331e27c09291d9e39eb7fa0d714c514e244" Jul 16 12:20:52.088988 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:52.088965 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5x9lg_openshift-console-operator(90df5fb6-dd25-4493-ba24-73892e0c372e)\"" pod="openshift-console-operator/console-operator-7866497494-5x9lg" podUID="90df5fb6-dd25-4493-ba24-73892e0c372e" Jul 16 12:20:52.089748 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:52.089713 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd" event={"ID":"48413f57-2840-4686-a768-cc1260315c7c","Type":"ContainerStarted","Data":"1550e4370be40efff8541efa5d1f3657fc02ff634fc9781d68861120ee813b3e"} Jul 16 12:20:52.518551 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:52.518511 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:20:52.518759 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:52.518577 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:52.518759 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:52.518613 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:20:52.518759 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:52.518692 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:52.518936 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:52.518765 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:00.51874901 +0000 UTC m=+55.370949818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : configmap references non-existent config key: service-ca.crt Jul 16 12:20:52.518936 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:52.518815 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 12:20:52.518936 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:52.518871 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:00.518853723 +0000 UTC m=+55.371054532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : secret "router-metrics-certs-default" not found Jul 16 12:20:52.518936 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:52.518917 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls podName:3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad nodeName:}" failed. No retries permitted until 2026-07-16 12:21:00.518906472 +0000 UTC m=+55.371107275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xlts4" (UID: "3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad") : secret "cluster-monitoring-operator-tls" not found Jul 16 12:20:53.125619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.124966 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:53.125619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.125021 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:53.125619 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:53.125188 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:20:53.125619 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:53.125258 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:57.125238225 +0000 UTC m=+51.977439017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : secret "insights-runtime-extractor-tls" not found Jul 16 12:20:53.125619 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:53.125549 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:20:53.126334 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:53.125657 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:57.125635156 +0000 UTC m=+51.977835950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : configmap "kube-rbac-proxy" not found Jul 16 12:20:53.327250 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.327214 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:20:53.327477 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:53.327386 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 12:20:53.327477 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:53.327456 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls podName:a60b1c19-f45b-46dc-b2e4-072948cf5785 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:01.327439641 +0000 UTC m=+56.179640430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls") pod "cluster-samples-operator-65db858894-265jd" (UID: "a60b1c19-f45b-46dc-b2e4-072948cf5785") : secret "samples-operator-tls" not found Jul 16 12:20:53.508042 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.507937 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk"] Jul 16 12:20:53.532066 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.532037 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk"] Jul 16 12:20:53.532223 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.532146 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.535003 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.534953 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 12:20:53.535165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.535040 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 12:20:53.535968 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.535944 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:20:53.536108 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.536021 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 12:20:53.536599 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.536573 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sfhq7\"" Jul 16 12:20:53.630512 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.630468 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h95st\" (UniqueName: \"kubernetes.io/projected/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-kube-api-access-h95st\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.630512 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.630519 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-config\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.630744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.630651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.731711 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.731668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h95st\" (UniqueName: \"kubernetes.io/projected/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-kube-api-access-h95st\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.731711 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.731712 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-config\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.731975 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.731771 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.732357 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.732329 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-config\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.734177 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.734143 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.740721 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.740695 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h95st\" (UniqueName: \"kubernetes.io/projected/0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d-kube-api-access-h95st\") pod \"service-ca-operator-7695fc6c8c-2tnsk\" (UID: \"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:53.846276 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:53.846238 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" Jul 16 12:20:54.098262 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:54.098232 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" event={"ID":"b58c4c06-bf79-45c4-9be0-f303f5b942c6","Type":"ContainerStarted","Data":"d378771bfcfc2a75c42e71b3ebca2f7268fadbee7b4ad312efed2ea56e4aefe2"} Jul 16 12:20:54.117178 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:54.117118 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" podStartSLOduration=1.43510172 podStartE2EDuration="4.117096133s" totalImagesPullingTime="2.681994413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:54.116681299 +0000 UTC m=+48.968882163" watchObservedRunningTime="2026-07-16 12:20:54.117096133 +0000 UTC m=+48.969296944" Jul 16 12:20:54.999196 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:54.999153 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk"] Jul 16 12:20:55.002939 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:55.002901 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0431c17e_7a15_4fbc_bf4a_0cc2e5f34a0d.slice/crio-cea0170672d99f849d88a4e47be2b174ddbc1f26654cc3813bacf40b6d2325c9 WatchSource:0}: Error finding container cea0170672d99f849d88a4e47be2b174ddbc1f26654cc3813bacf40b6d2325c9: Status 404 returned error can't find the container with id cea0170672d99f849d88a4e47be2b174ddbc1f26654cc3813bacf40b6d2325c9 Jul 16 12:20:55.103111 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.103073 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" event={"ID":"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d","Type":"ContainerStarted","Data":"cea0170672d99f849d88a4e47be2b174ddbc1f26654cc3813bacf40b6d2325c9"} Jul 16 12:20:55.534120 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.534023 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:55.561556 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.561519 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk"] Jul 16 12:20:55.579691 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.579656 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk"] Jul 16 12:20:55.579915 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.579770 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" Jul 16 12:20:55.582540 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.582517 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 12:20:55.582540 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.582517 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 12:20:55.583654 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.583633 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pfnbj\"" Jul 16 12:20:55.650905 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.650847 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbh2\" (UniqueName: \"kubernetes.io/projected/f0b73307-5fe0-46f4-b78e-2e9da436dd8b-kube-api-access-rxbh2\") pod \"migrator-7f59b54f6c-8knsk\" (UID: \"f0b73307-5fe0-46f4-b78e-2e9da436dd8b\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" Jul 16 12:20:55.752226 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.752189 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbh2\" (UniqueName: \"kubernetes.io/projected/f0b73307-5fe0-46f4-b78e-2e9da436dd8b-kube-api-access-rxbh2\") pod \"migrator-7f59b54f6c-8knsk\" (UID: \"f0b73307-5fe0-46f4-b78e-2e9da436dd8b\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" Jul 16 12:20:55.761194 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.761165 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbh2\" (UniqueName: \"kubernetes.io/projected/f0b73307-5fe0-46f4-b78e-2e9da436dd8b-kube-api-access-rxbh2\") pod \"migrator-7f59b54f6c-8knsk\" (UID: \"f0b73307-5fe0-46f4-b78e-2e9da436dd8b\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" Jul 16 12:20:55.890997 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:55.890959 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" Jul 16 12:20:56.057717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.057681 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk"] Jul 16 12:20:56.061131 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:20:56.061089 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b73307_5fe0_46f4_b78e_2e9da436dd8b.slice/crio-ff4cdf8ce8b342efc27aea03cbd21242db851fc116cfc3b995c49e1adda79c4c WatchSource:0}: Error finding container ff4cdf8ce8b342efc27aea03cbd21242db851fc116cfc3b995c49e1adda79c4c: Status 404 returned error can't find the container with id ff4cdf8ce8b342efc27aea03cbd21242db851fc116cfc3b995c49e1adda79c4c Jul 16 12:20:56.113928 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.113864 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" event={"ID":"f0b73307-5fe0-46f4-b78e-2e9da436dd8b","Type":"ContainerStarted","Data":"ff4cdf8ce8b342efc27aea03cbd21242db851fc116cfc3b995c49e1adda79c4c"} Jul 16 12:20:56.115762 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.115726 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd" event={"ID":"48413f57-2840-4686-a768-cc1260315c7c","Type":"ContainerStarted","Data":"7b3e0b03f7474c6b5b8d12b3569bdbdfb7f1cdcabb52869a9af4e8227f45a25a"} Jul 16 12:20:56.133447 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.133386 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2xthd" podStartSLOduration=1.632129318 podStartE2EDuration="5.133363469s" totalImagesPullingTime="3.501234151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:56.131485107 +0000 UTC m=+50.983685919" watchObservedRunningTime="2026-07-16 12:20:56.133363469 +0000 UTC m=+50.985564280" Jul 16 12:20:56.358623 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.358580 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:20:56.358826 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.358674 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:20:56.358826 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:56.358736 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:20:56.358826 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:56.358756 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f575bbd-4962w: secret "image-registry-tls" not found Jul 16 12:20:56.358826 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:56.358816 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls podName:0aaaae00-5d99-4149-8347-aba5bc6a4426 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:12.358800816 +0000 UTC m=+67.211001605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls") pod "image-registry-674f575bbd-4962w" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426") : secret "image-registry-tls" not found Jul 16 12:20:56.359060 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:56.358833 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:20:56.359060 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:56.358904 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls podName:cc2a9eea-8c67-4488-a4c4-0426dcdbe012 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:12.358868203 +0000 UTC m=+67.211068999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls") pod "dns-default-djqx8" (UID: "cc2a9eea-8c67-4488-a4c4-0426dcdbe012") : secret "dns-default-metrics-tls" not found Jul 16 12:20:56.570554 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.570512 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:56.670440 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.670349 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:56.840481 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.840441 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:56.840689 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.840502 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:20:56.840990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:56.840974 2570 scope.go:117] "RemoveContainer" containerID="6c577afc631233166b78503ff5ebb331e27c09291d9e39eb7fa0d714c514e244" Jul 16 12:20:56.841183 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:56.841145 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5x9lg_openshift-console-operator(90df5fb6-dd25-4493-ba24-73892e0c372e)\"" pod="openshift-console-operator/console-operator-7866497494-5x9lg" podUID="90df5fb6-dd25-4493-ba24-73892e0c372e" Jul 16 12:20:57.167123 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:57.167083 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:57.167681 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:57.167135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:57.167681 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:57.167314 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:20:57.167681 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:20:57.167405 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:05.167381171 +0000 UTC m=+60.019581978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : secret "insights-runtime-extractor-tls" not found Jul 16 12:20:57.167681 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:57.167629 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:20:58.658930 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:58.658818 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:58.745841 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:58.745802 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:59.099739 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.099705 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:59.128419 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.128383 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" event={"ID":"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d","Type":"ContainerStarted","Data":"ddb892c4a9f6d7a0220a1fffc1ce4433bbb1b7e986c5044f580075708bee8fd1"} Jul 16 12:20:59.130224 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.130199 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" event={"ID":"f0b73307-5fe0-46f4-b78e-2e9da436dd8b","Type":"ContainerStarted","Data":"04c59b382d9f4a578ddb33d35e207fc6f2da8455db6de1c51682caeb90221efe"} Jul 16 12:20:59.130361 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.130239 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" event={"ID":"f0b73307-5fe0-46f4-b78e-2e9da436dd8b","Type":"ContainerStarted","Data":"e20b8bc3687b2149578513fa3f76cce4ba39289a2155a072b58be10aa429bc87"} Jul 16 12:20:59.146923 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.146855 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" podStartSLOduration=3.047093624 podStartE2EDuration="6.146834749s" totalImagesPullingTime="3.099741125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:59.145615832 +0000 UTC m=+53.997816663" watchObservedRunningTime="2026-07-16 12:20:59.146834749 +0000 UTC m=+53.999035561" Jul 16 12:20:59.163870 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.163798 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8knsk" podStartSLOduration=2.120373651 podStartE2EDuration="4.163772752s" totalImagesPullingTime="2.043399101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:59.161811734 +0000 UTC m=+54.014012544" watchObservedRunningTime="2026-07-16 12:20:59.163772752 +0000 UTC m=+54.015973564" Jul 16 12:20:59.172893 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.172842 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:59.302244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.302197 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:20:59.534104 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:20:59.533980 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" limit=1024 Jul 16 12:21:00.600843 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:00.600801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:00.601403 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:00.601010 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 12:21:00.601403 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:00.601027 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:21:00.601403 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:00.601059 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:00.601403 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:00.601095 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:16.601072488 +0000 UTC m=+71.453273281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : secret "router-metrics-certs-default" not found Jul 16 12:21:00.601403 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:00.601163 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle podName:e2141df0-1926-4524-9c52-14cf694c6022 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:16.601150051 +0000 UTC m=+71.453350840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle") pod "router-default-5f8649488-lw5qn" (UID: "e2141df0-1926-4524-9c52-14cf694c6022") : configmap references non-existent config key: service-ca.crt Jul 16 12:21:00.601403 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:00.601169 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 12:21:00.601403 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:00.601217 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls podName:3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad nodeName:}" failed. No retries permitted until 2026-07-16 12:21:16.601202335 +0000 UTC m=+71.453403124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xlts4" (UID: "3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad") : secret "cluster-monitoring-operator-tls" not found Jul 16 12:21:01.407710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.407660 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:21:01.407925 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:01.407823 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 12:21:01.407925 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:01.407916 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls podName:a60b1c19-f45b-46dc-b2e4-072948cf5785 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:17.407899062 +0000 UTC m=+72.260099864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls") pod "cluster-samples-operator-65db858894-265jd" (UID: "a60b1c19-f45b-46dc-b2e4-072948cf5785") : secret "samples-operator-tls" not found Jul 16 12:21:01.461889 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.461837 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-nv5md"] Jul 16 12:21:01.467265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.467241 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.471109 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.471082 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-brdpd\"" Jul 16 12:21:01.471109 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.471097 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 16 12:21:01.472023 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.472006 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 16 12:21:01.472128 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.472023 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 16 12:21:01.472128 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.472026 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 16 12:21:01.480135 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.480108 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-nv5md"] Jul 16 12:21:01.609386 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.609347 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-signing-key\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.609386 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.609386 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-signing-cabundle\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.609852 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.609416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9sx9\" (UniqueName: \"kubernetes.io/projected/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-kube-api-access-d9sx9\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.710436 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.710327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-signing-key\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.710436 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.710371 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-signing-cabundle\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.710436 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.710415 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9sx9\" (UniqueName: \"kubernetes.io/projected/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-kube-api-access-d9sx9\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.711101 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.711073 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-signing-cabundle\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.712991 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.712956 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-signing-key\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.721708 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.721677 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9sx9\" (UniqueName: \"kubernetes.io/projected/34262fd0-e7cb-4b14-8bf5-b180d9cac36c-kube-api-access-d9sx9\") pod \"service-ca-79f68b9f4f-nv5md\" (UID: \"34262fd0-e7cb-4b14-8bf5-b180d9cac36c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.776504 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.776457 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" Jul 16 12:21:01.907365 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:01.907327 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-nv5md"] Jul 16 12:21:01.910518 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:01.910490 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34262fd0_e7cb_4b14_8bf5_b180d9cac36c.slice/crio-f6e31218e07b5f568cfbf9492987121b80eb775ff50be77479d388a1e7cd7e31 WatchSource:0}: Error finding container f6e31218e07b5f568cfbf9492987121b80eb775ff50be77479d388a1e7cd7e31: Status 404 returned error can't find the container with id f6e31218e07b5f568cfbf9492987121b80eb775ff50be77479d388a1e7cd7e31 Jul 16 12:21:02.145023 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:02.144989 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" event={"ID":"34262fd0-e7cb-4b14-8bf5-b180d9cac36c","Type":"ContainerStarted","Data":"bfef375a422ce3789e6d02ad0544bcb11fbcd5b7f8f8a8f4e8ba234a9f6880da"} Jul 16 12:21:02.145265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:02.145048 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" event={"ID":"34262fd0-e7cb-4b14-8bf5-b180d9cac36c","Type":"ContainerStarted","Data":"f6e31218e07b5f568cfbf9492987121b80eb775ff50be77479d388a1e7cd7e31"} Jul 16 12:21:02.164648 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:02.164587 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-nv5md" podStartSLOduration=1.164564048 podStartE2EDuration="1.164564048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:02.163998961 +0000 UTC m=+57.016199801" watchObservedRunningTime="2026-07-16 12:21:02.164564048 +0000 UTC m=+57.016764864" Jul 16 12:21:05.246391 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:05.246351 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:21:05.246834 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:05.246495 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:21:05.246834 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:21:05.246553 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls podName:26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:21.246538006 +0000 UTC m=+76.098738798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82gfb" (UID: "26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03") : secret "insights-runtime-extractor-tls" not found Jul 16 12:21:06.032888 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:06.032851 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgl9d" Jul 16 12:21:11.508687 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.508636 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:21:11.508687 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.508694 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:21:11.509175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.508920 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:21:11.511394 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.511371 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v22jz\" (UniqueName: \"kubernetes.io/projected/5a4fe502-f835-4090-82fe-ed50ad79af7d-kube-api-access-v22jz\") pod \"network-check-target-svqkk\" (UID: \"5a4fe502-f835-4090-82fe-ed50ad79af7d\") " pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:21:11.511509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.511453 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 12:21:11.512499 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.512480 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 12:21:11.521601 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.521576 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce77094-7be6-4e19-9926-b7cc33b9fff3-metrics-certs\") pod \"network-metrics-daemon-lxqfm\" (UID: \"8ce77094-7be6-4e19-9926-b7cc33b9fff3\") " pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:21:11.521739 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.521619 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1c8afb-3295-4ea3-94cd-73ae61d2fb01-original-pull-secret\") pod \"global-pull-secret-syncer-6246f\" (UID: \"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01\") " pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:21:11.732978 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.732938 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6246f" Jul 16 12:21:11.742270 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.742238 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qp65q\"" Jul 16 12:21:11.748780 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.748748 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6rr4c\"" Jul 16 12:21:11.751024 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.750777 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:21:11.756605 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.756576 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxqfm" Jul 16 12:21:11.822533 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.821007 2570 scope.go:117] "RemoveContainer" containerID="6c577afc631233166b78503ff5ebb331e27c09291d9e39eb7fa0d714c514e244" Jul 16 12:21:11.921055 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.921022 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6246f"] Jul 16 12:21:11.924621 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:11.924583 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1c8afb_3295_4ea3_94cd_73ae61d2fb01.slice/crio-84c34807070fefe9b1a0003064e58b8330626026209773a7b916c003ff024b29 WatchSource:0}: Error finding container 84c34807070fefe9b1a0003064e58b8330626026209773a7b916c003ff024b29: Status 404 returned error can't find the container with id 84c34807070fefe9b1a0003064e58b8330626026209773a7b916c003ff024b29 Jul 16 12:21:11.948576 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.948552 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lxqfm"] Jul 16 12:21:11.951028 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:11.950991 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce77094_7be6_4e19_9926_b7cc33b9fff3.slice/crio-bbd370b463d717dc38c1e057fd2b583dec6eda5208e5283d7a6f65b076540302 WatchSource:0}: Error finding container bbd370b463d717dc38c1e057fd2b583dec6eda5208e5283d7a6f65b076540302: Status 404 returned error can't find the container with id bbd370b463d717dc38c1e057fd2b583dec6eda5208e5283d7a6f65b076540302 Jul 16 12:21:11.962837 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:11.962775 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svqkk"] Jul 16 12:21:11.966423 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:11.966392 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4fe502_f835_4090_82fe_ed50ad79af7d.slice/crio-061024afac83043fefe82479cd56198cd5148bd30c529e67595e4b82b93889d1 WatchSource:0}: Error finding container 061024afac83043fefe82479cd56198cd5148bd30c529e67595e4b82b93889d1: Status 404 returned error can't find the container with id 061024afac83043fefe82479cd56198cd5148bd30c529e67595e4b82b93889d1 Jul 16 12:21:12.179146 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.179120 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:21:12.179335 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.179224 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5x9lg" event={"ID":"90df5fb6-dd25-4493-ba24-73892e0c372e","Type":"ContainerStarted","Data":"d04bd6b1f39b59814d69c738f66b4ff6e9ff838a0710b6f10754a073046c1ef4"} Jul 16 12:21:12.179549 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.179519 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:21:12.180681 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.180639 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6246f" event={"ID":"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01","Type":"ContainerStarted","Data":"84c34807070fefe9b1a0003064e58b8330626026209773a7b916c003ff024b29"} Jul 16 12:21:12.182344 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.182321 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svqkk" event={"ID":"5a4fe502-f835-4090-82fe-ed50ad79af7d","Type":"ContainerStarted","Data":"ae0c676345b85f457971db3e3bf279f753e032083e978312187863d1a1a78772"} Jul 16 12:21:12.182492 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.182363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svqkk" event={"ID":"5a4fe502-f835-4090-82fe-ed50ad79af7d","Type":"ContainerStarted","Data":"061024afac83043fefe82479cd56198cd5148bd30c529e67595e4b82b93889d1"} Jul 16 12:21:12.182492 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.182391 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:21:12.183628 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.183607 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxqfm" event={"ID":"8ce77094-7be6-4e19-9926-b7cc33b9fff3","Type":"ContainerStarted","Data":"bbd370b463d717dc38c1e057fd2b583dec6eda5208e5283d7a6f65b076540302"} Jul 16 12:21:12.198868 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.198810 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-5x9lg" podStartSLOduration=23.633052538 podStartE2EDuration="26.198791579s" totalImagesPullingTime="2.565739041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:12.198094222 +0000 UTC m=+67.050295051" watchObservedRunningTime="2026-07-16 12:21:12.198791579 +0000 UTC m=+67.050992389" Jul 16 12:21:12.216629 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.216558 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-svqkk" podStartSLOduration=66.216536656 podStartE2EDuration="1m6.216536656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:12.214698377 +0000 UTC m=+67.066899189" watchObservedRunningTime="2026-07-16 12:21:12.216536656 +0000 UTC m=+67.068737474" Jul 16 12:21:12.417386 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.417350 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:21:12.417578 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.417415 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:21:12.419870 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.419833 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc2a9eea-8c67-4488-a4c4-0426dcdbe012-metrics-tls\") pod \"dns-default-djqx8\" (UID: \"cc2a9eea-8c67-4488-a4c4-0426dcdbe012\") " pod="openshift-dns/dns-default-djqx8" Jul 16 12:21:12.419870 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.419851 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"image-registry-674f575bbd-4962w\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:21:12.554903 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.554838 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-drrn2\"" Jul 16 12:21:12.562967 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.562922 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:21:12.575473 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.575433 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-drvvw\"" Jul 16 12:21:12.585675 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.585617 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-djqx8" Jul 16 12:21:12.587015 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.586960 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-5x9lg" Jul 16 12:21:12.790722 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.790676 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-674f575bbd-4962w"] Jul 16 12:21:12.794638 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:12.794596 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aaaae00_5d99_4149_8347_aba5bc6a4426.slice/crio-96fea32a7d402357db1a697b90f13831c7d845e6aa9beff6cfb6fa09100e0358 WatchSource:0}: Error finding container 96fea32a7d402357db1a697b90f13831c7d845e6aa9beff6cfb6fa09100e0358: Status 404 returned error can't find the container with id 96fea32a7d402357db1a697b90f13831c7d845e6aa9beff6cfb6fa09100e0358 Jul 16 12:21:12.812903 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:12.812709 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-djqx8"] Jul 16 12:21:12.816338 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:12.816305 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2a9eea_8c67_4488_a4c4_0426dcdbe012.slice/crio-876d4011877e358dbda0a6d563440b9e6381cd90f530751b9a11e3576a01875e WatchSource:0}: Error finding container 876d4011877e358dbda0a6d563440b9e6381cd90f530751b9a11e3576a01875e: Status 404 returned error can't find the container with id 876d4011877e358dbda0a6d563440b9e6381cd90f530751b9a11e3576a01875e Jul 16 12:21:13.190653 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:13.190606 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-djqx8" event={"ID":"cc2a9eea-8c67-4488-a4c4-0426dcdbe012","Type":"ContainerStarted","Data":"876d4011877e358dbda0a6d563440b9e6381cd90f530751b9a11e3576a01875e"} Jul 16 12:21:13.194286 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:13.194242 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-674f575bbd-4962w" event={"ID":"0aaaae00-5d99-4149-8347-aba5bc6a4426","Type":"ContainerStarted","Data":"073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b"} Jul 16 12:21:13.194453 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:13.194298 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-674f575bbd-4962w" event={"ID":"0aaaae00-5d99-4149-8347-aba5bc6a4426","Type":"ContainerStarted","Data":"96fea32a7d402357db1a697b90f13831c7d845e6aa9beff6cfb6fa09100e0358"} Jul 16 12:21:13.195062 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:13.195013 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:21:13.230894 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:13.230809 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-674f575bbd-4962w" podStartSLOduration=67.230783234 podStartE2EDuration="1m7.230783234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:13.22941963 +0000 UTC m=+68.081620443" watchObservedRunningTime="2026-07-16 12:21:13.230783234 +0000 UTC m=+68.082984046" Jul 16 12:21:14.200908 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:14.200851 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxqfm" event={"ID":"8ce77094-7be6-4e19-9926-b7cc33b9fff3","Type":"ContainerStarted","Data":"3d332399cd521e5649d65d7de1d72730d98de47cac6c95decf578e78b678e8d6"} Jul 16 12:21:14.201633 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:14.200931 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxqfm" event={"ID":"8ce77094-7be6-4e19-9926-b7cc33b9fff3","Type":"ContainerStarted","Data":"3ed76b5cb576dd99fddadab0ae53e311eb53aa738d9d70f4ef3ecd1433b144ee"} Jul 16 12:21:14.219737 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:14.219660 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lxqfm" podStartSLOduration=66.451807393 podStartE2EDuration="1m8.219612215s" totalImagesPullingTime="1.767804822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:14.218777205 +0000 UTC m=+69.070978016" watchObservedRunningTime="2026-07-16 12:21:14.219612215 +0000 UTC m=+69.071813026" Jul 16 12:21:16.661108 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.661074 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:21:16.661452 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.661130 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:16.661452 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.661170 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:16.661939 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.661910 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2141df0-1926-4524-9c52-14cf694c6022-service-ca-bundle\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:16.663891 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.663852 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2141df0-1926-4524-9c52-14cf694c6022-metrics-certs\") pod \"router-default-5f8649488-lw5qn\" (UID: \"e2141df0-1926-4524-9c52-14cf694c6022\") " pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:16.663956 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.663854 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xlts4\" (UID: \"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:21:16.759073 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.758863 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nprhb\"" Jul 16 12:21:16.767546 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.767314 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" Jul 16 12:21:16.770035 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.770008 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9dcsb\"" Jul 16 12:21:16.777641 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.777569 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:16.958932 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.958896 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4"] Jul 16 12:21:16.962292 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:16.962263 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dbcfdf1_3184_47bf_bcd0_d6f73bf8ccad.slice/crio-bf048116ab5f6133eb25d9fd17e4c030cdcb88b478b7522ca24fa1c56f4238c3 WatchSource:0}: Error finding container bf048116ab5f6133eb25d9fd17e4c030cdcb88b478b7522ca24fa1c56f4238c3: Status 404 returned error can't find the container with id bf048116ab5f6133eb25d9fd17e4c030cdcb88b478b7522ca24fa1c56f4238c3 Jul 16 12:21:16.980161 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:16.980130 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f8649488-lw5qn"] Jul 16 12:21:16.983132 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:16.983102 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2141df0_1926_4524_9c52_14cf694c6022.slice/crio-3462c04bc75c91a208527f13d2502d1be45579b43be765f01f3c417f7db36f05 WatchSource:0}: Error finding container 3462c04bc75c91a208527f13d2502d1be45579b43be765f01f3c417f7db36f05: Status 404 returned error can't find the container with id 3462c04bc75c91a208527f13d2502d1be45579b43be765f01f3c417f7db36f05 Jul 16 12:21:17.216278 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.216192 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6246f" event={"ID":"3d1c8afb-3295-4ea3-94cd-73ae61d2fb01","Type":"ContainerStarted","Data":"4469e2e096d3377002a0a1cd7b11b38e11bc95cac12951437a5f032febaae948"} Jul 16 12:21:17.218280 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.218246 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-djqx8" event={"ID":"cc2a9eea-8c67-4488-a4c4-0426dcdbe012","Type":"ContainerStarted","Data":"459387e5a246c36bba51e51d2294db3f6d996aebfbde55cc76fb4adc5fe69ef3"} Jul 16 12:21:17.218443 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.218316 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-djqx8" Jul 16 12:21:17.218443 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.218343 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-djqx8" event={"ID":"cc2a9eea-8c67-4488-a4c4-0426dcdbe012","Type":"ContainerStarted","Data":"8ebd1c9319bc782b5ec90f1809da4569e5a712489584d054761823da5d5961d7"} Jul 16 12:21:17.219487 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.219454 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" event={"ID":"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad","Type":"ContainerStarted","Data":"bf048116ab5f6133eb25d9fd17e4c030cdcb88b478b7522ca24fa1c56f4238c3"} Jul 16 12:21:17.221102 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.221078 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f8649488-lw5qn" event={"ID":"e2141df0-1926-4524-9c52-14cf694c6022","Type":"ContainerStarted","Data":"95cbbc348691af594defcdaff7d06517e179d2fc8aad2b94a5cf508ca8507cd5"} Jul 16 12:21:17.221209 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.221114 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f8649488-lw5qn" event={"ID":"e2141df0-1926-4524-9c52-14cf694c6022","Type":"ContainerStarted","Data":"3462c04bc75c91a208527f13d2502d1be45579b43be765f01f3c417f7db36f05"} Jul 16 12:21:17.233343 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.233280 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6246f" podStartSLOduration=66.492502034 podStartE2EDuration="1m11.233261127s" totalImagesPullingTime="4.740759093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:17.232134109 +0000 UTC m=+72.084334921" watchObservedRunningTime="2026-07-16 12:21:17.233261127 +0000 UTC m=+72.085461984" Jul 16 12:21:17.251024 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.250969 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-djqx8" podStartSLOduration=33.414091812 podStartE2EDuration="37.250949186s" totalImagesPullingTime="3.836857374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:17.250128873 +0000 UTC m=+72.102329687" watchObservedRunningTime="2026-07-16 12:21:17.250949186 +0000 UTC m=+72.103149997" Jul 16 12:21:17.273560 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.273503 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f8649488-lw5qn" podStartSLOduration=33.273484841 podStartE2EDuration="33.273484841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:17.272308433 +0000 UTC m=+72.124509263" watchObservedRunningTime="2026-07-16 12:21:17.273484841 +0000 UTC m=+72.125685630" Jul 16 12:21:17.467999 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.467857 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:21:17.470360 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.470338 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a60b1c19-f45b-46dc-b2e4-072948cf5785-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-265jd\" (UID: \"a60b1c19-f45b-46dc-b2e4-072948cf5785\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:21:17.730908 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.730803 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zf5xf\"" Jul 16 12:21:17.739032 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.738991 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" Jul 16 12:21:17.778440 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.778408 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:17.781450 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.781417 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:17.902578 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:17.902543 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd"] Jul 16 12:21:18.226744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:18.226701 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" event={"ID":"a60b1c19-f45b-46dc-b2e4-072948cf5785","Type":"ContainerStarted","Data":"3dbe934912c519d010a7645ceb3ba08c976def4721abc7b643e49862bd0a7c5a"} Jul 16 12:21:18.227128 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:18.227094 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:18.228539 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:18.228516 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f8649488-lw5qn" Jul 16 12:21:19.232349 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:19.232315 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" event={"ID":"3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad","Type":"ContainerStarted","Data":"8239edfab7234f36892afb807803df3d1dba7d22eb56af6c9b40470594a2aba6"} Jul 16 12:21:19.261215 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:19.261153 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xlts4" podStartSLOduration=33.589349163 podStartE2EDuration="35.261127211s" totalImagesPullingTime="1.671778048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:19.260595807 +0000 UTC m=+74.112796618" watchObservedRunningTime="2026-07-16 12:21:19.261127211 +0000 UTC m=+74.113328024" Jul 16 12:21:21.241570 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:21.241512 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" event={"ID":"a60b1c19-f45b-46dc-b2e4-072948cf5785","Type":"ContainerStarted","Data":"06b4317c646255bc4fe89dc36b58765325e4b7a33f9e88765dcea42f85f13832"} Jul 16 12:21:21.241570 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:21.241578 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" event={"ID":"a60b1c19-f45b-46dc-b2e4-072948cf5785","Type":"ContainerStarted","Data":"a02b34e3b58601a6bc1c276b9444e52d2dec0da0c0d9c281ae06a281219e647f"} Jul 16 12:21:21.260967 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:21.260911 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-265jd" podStartSLOduration=34.056878407 podStartE2EDuration="36.26089408s" totalImagesPullingTime="2.204015673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:21.258784283 +0000 UTC m=+76.110985116" watchObservedRunningTime="2026-07-16 12:21:21.26089408 +0000 UTC m=+76.113094881" Jul 16 12:21:21.302844 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:21.302803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:21:21.305124 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:21.305095 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82gfb\" (UID: \"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03\") " pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:21:21.526035 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:21.525952 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tkvf\"" Jul 16 12:21:21.534315 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:21.534289 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-82gfb" Jul 16 12:21:21.707342 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:21.707312 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-82gfb"] Jul 16 12:21:21.709915 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:21.709860 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e0a4d6_a94b_4b9c_8ac8_b95e00a87d03.slice/crio-9108b933c1452b1c9ec6ef7dde5d33aea9a24ccde9110df37f7839d614343462 WatchSource:0}: Error finding container 9108b933c1452b1c9ec6ef7dde5d33aea9a24ccde9110df37f7839d614343462: Status 404 returned error can't find the container with id 9108b933c1452b1c9ec6ef7dde5d33aea9a24ccde9110df37f7839d614343462 Jul 16 12:21:22.249459 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.249372 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-82gfb" event={"ID":"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03","Type":"ContainerStarted","Data":"9108b933c1452b1c9ec6ef7dde5d33aea9a24ccde9110df37f7839d614343462"} Jul 16 12:21:22.986944 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.986908 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k"] Jul 16 12:21:22.989163 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.989136 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" Jul 16 12:21:22.991766 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.991728 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 12:21:22.992316 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.992133 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 12:21:22.992316 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.992193 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz"] Jul 16 12:21:22.993293 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.993080 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-c2wck\"" Jul 16 12:21:22.993293 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.993093 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 12:21:22.993618 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.993592 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 12:21:22.994365 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.994344 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:22.996983 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:22.996956 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 12:21:23.002898 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.000125 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v"] Jul 16 12:21:23.017839 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.017690 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k"] Jul 16 12:21:23.017839 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.017736 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz"] Jul 16 12:21:23.018092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.017849 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.019238 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.018425 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v"] Jul 16 12:21:23.019238 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.018920 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0dcb5501-79e4-4266-b19c-05851a8abb0c-klusterlet-config\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.019238 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.018998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwfx6\" (UniqueName: \"kubernetes.io/projected/0dcb5501-79e4-4266-b19c-05851a8abb0c-kube-api-access-fwfx6\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.019238 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.019034 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-967f5f9fd-6n82k\" (UID: \"dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" Jul 16 12:21:23.019238 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.019065 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpnqk\" (UniqueName: \"kubernetes.io/projected/dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6-kube-api-access-zpnqk\") pod \"managed-serviceaccount-addon-agent-967f5f9fd-6n82k\" (UID: \"dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" Jul 16 12:21:23.019238 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.019123 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dcb5501-79e4-4266-b19c-05851a8abb0c-tmp\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.020979 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.020947 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 16 12:21:23.021244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.021220 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 16 12:21:23.021244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.021236 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 16 12:21:23.021522 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.021502 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 16 12:21:23.083368 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.083243 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-294g4"] Jul 16 12:21:23.085894 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.085845 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" Jul 16 12:21:23.089070 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.089034 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 16 12:21:23.089070 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.089046 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n296n\"" Jul 16 12:21:23.089383 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.089363 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 16 12:21:23.094312 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.093912 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-x9fmw"] Jul 16 12:21:23.096377 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.096353 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-x9fmw" Jul 16 12:21:23.096377 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.096369 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7"] Jul 16 12:21:23.099219 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.098761 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" Jul 16 12:21:23.101386 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.101220 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 12:21:23.101386 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.101322 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4ldjk\"" Jul 16 12:21:23.101939 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.101729 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 12:21:23.101939 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.101735 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gw54l\"" Jul 16 12:21:23.102109 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.102014 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 12:21:23.103297 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.103219 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-294g4"] Jul 16 12:21:23.109731 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.109660 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7"] Jul 16 12:21:23.112322 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.112303 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-x9fmw"] Jul 16 12:21:23.119756 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.119728 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.119770 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bd93d9-9fc5-44d5-b607-1a4de8544511-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.119814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dcb5501-79e4-4266-b19c-05851a8abb0c-tmp\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.119850 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c640aa2-f5aa-4bec-8081-6c4310467b05-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-294g4\" (UID: \"0c640aa2-f5aa-4bec-8081-6c4310467b05\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.119900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0dcb5501-79e4-4266-b19c-05851a8abb0c-klusterlet-config\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.119939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c640aa2-f5aa-4bec-8081-6c4310467b05-nginx-conf\") pod \"networking-console-plugin-6cf856758c-294g4\" (UID: \"0c640aa2-f5aa-4bec-8081-6c4310467b05\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120097 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1afae13-8665-4f63-bd94-06be57bdf4e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wtjp7\" (UID: \"a1afae13-8665-4f63-bd94-06be57bdf4e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-hub\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120224 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120259 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwfx6\" (UniqueName: \"kubernetes.io/projected/0dcb5501-79e4-4266-b19c-05851a8abb0c-kube-api-access-fwfx6\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120297 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-967f5f9fd-6n82k\" (UID: \"dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" Jul 16 12:21:23.120398 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120357 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpnqk\" (UniqueName: \"kubernetes.io/projected/dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6-kube-api-access-zpnqk\") pod \"managed-serviceaccount-addon-agent-967f5f9fd-6n82k\" (UID: \"dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" Jul 16 12:21:23.120996 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbtpt\" (UniqueName: \"kubernetes.io/projected/62175354-1513-4ce2-bf86-3c4a1755bd54-kube-api-access-fbtpt\") pod \"downloads-68c9cbb497-x9fmw\" (UID: \"62175354-1513-4ce2-bf86-3c4a1755bd54\") " pod="openshift-console/downloads-68c9cbb497-x9fmw" Jul 16 12:21:23.120996 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120437 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dcb5501-79e4-4266-b19c-05851a8abb0c-tmp\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.120996 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120460 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g2pt\" (UniqueName: \"kubernetes.io/projected/12bd93d9-9fc5-44d5-b607-1a4de8544511-kube-api-access-6g2pt\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.120996 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.120571 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-ca\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.125049 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.124992 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0dcb5501-79e4-4266-b19c-05851a8abb0c-klusterlet-config\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.125710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.125684 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-967f5f9fd-6n82k\" (UID: \"dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" Jul 16 12:21:23.130606 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.130579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpnqk\" (UniqueName: \"kubernetes.io/projected/dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6-kube-api-access-zpnqk\") pod \"managed-serviceaccount-addon-agent-967f5f9fd-6n82k\" (UID: \"dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" Jul 16 12:21:23.131812 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.131785 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwfx6\" (UniqueName: \"kubernetes.io/projected/0dcb5501-79e4-4266-b19c-05851a8abb0c-kube-api-access-fwfx6\") pod \"klusterlet-addon-workmgr-648cbf7894-mftsz\" (UID: \"0dcb5501-79e4-4266-b19c-05851a8abb0c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.221128 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.221128 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221133 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbtpt\" (UniqueName: \"kubernetes.io/projected/62175354-1513-4ce2-bf86-3c4a1755bd54-kube-api-access-fbtpt\") pod \"downloads-68c9cbb497-x9fmw\" (UID: \"62175354-1513-4ce2-bf86-3c4a1755bd54\") " pod="openshift-console/downloads-68c9cbb497-x9fmw" Jul 16 12:21:23.221404 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221162 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2pt\" (UniqueName: \"kubernetes.io/projected/12bd93d9-9fc5-44d5-b607-1a4de8544511-kube-api-access-6g2pt\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.221404 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221200 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-ca\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.221404 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221254 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.221404 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221292 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bd93d9-9fc5-44d5-b607-1a4de8544511-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.221404 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221339 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c640aa2-f5aa-4bec-8081-6c4310467b05-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-294g4\" (UID: \"0c640aa2-f5aa-4bec-8081-6c4310467b05\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" Jul 16 12:21:23.221404 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221374 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c640aa2-f5aa-4bec-8081-6c4310467b05-nginx-conf\") pod \"networking-console-plugin-6cf856758c-294g4\" (UID: \"0c640aa2-f5aa-4bec-8081-6c4310467b05\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" Jul 16 12:21:23.221404 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221399 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1afae13-8665-4f63-bd94-06be57bdf4e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wtjp7\" (UID: \"a1afae13-8665-4f63-bd94-06be57bdf4e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" Jul 16 12:21:23.221749 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.221432 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-hub\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.222392 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.222333 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bd93d9-9fc5-44d5-b607-1a4de8544511-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.222734 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.222675 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c640aa2-f5aa-4bec-8081-6c4310467b05-nginx-conf\") pod \"networking-console-plugin-6cf856758c-294g4\" (UID: \"0c640aa2-f5aa-4bec-8081-6c4310467b05\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" Jul 16 12:21:23.224602 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.224296 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-ca\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.224602 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.224455 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.224602 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.224465 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c640aa2-f5aa-4bec-8081-6c4310467b05-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-294g4\" (UID: \"0c640aa2-f5aa-4bec-8081-6c4310467b05\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" Jul 16 12:21:23.224602 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.224568 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.225805 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.225776 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1afae13-8665-4f63-bd94-06be57bdf4e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wtjp7\" (UID: \"a1afae13-8665-4f63-bd94-06be57bdf4e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" Jul 16 12:21:23.225983 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.225963 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/12bd93d9-9fc5-44d5-b607-1a4de8544511-hub\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.239781 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.239702 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2pt\" (UniqueName: \"kubernetes.io/projected/12bd93d9-9fc5-44d5-b607-1a4de8544511-kube-api-access-6g2pt\") pod \"cluster-proxy-proxy-agent-5bf58b54c6-d2x8v\" (UID: \"12bd93d9-9fc5-44d5-b607-1a4de8544511\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.241289 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.241257 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbtpt\" (UniqueName: \"kubernetes.io/projected/62175354-1513-4ce2-bf86-3c4a1755bd54-kube-api-access-fbtpt\") pod \"downloads-68c9cbb497-x9fmw\" (UID: \"62175354-1513-4ce2-bf86-3c4a1755bd54\") " pod="openshift-console/downloads-68c9cbb497-x9fmw" Jul 16 12:21:23.317004 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.316963 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" Jul 16 12:21:23.328148 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.328042 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:23.337509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.337431 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" Jul 16 12:21:23.413529 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.412835 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" Jul 16 12:21:23.425083 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.424853 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-x9fmw" Jul 16 12:21:23.451887 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.451610 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" Jul 16 12:21:23.503623 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.503006 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k"] Jul 16 12:21:23.516007 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:23.515963 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcffd49e_41e3_4a7b_bd4c_4caf711ba6c6.slice/crio-a7d13ff7281f3efa073e34c4469d365df86984bc19a55b9fc2560a63027a477d WatchSource:0}: Error finding container a7d13ff7281f3efa073e34c4469d365df86984bc19a55b9fc2560a63027a477d: Status 404 returned error can't find the container with id a7d13ff7281f3efa073e34c4469d365df86984bc19a55b9fc2560a63027a477d Jul 16 12:21:23.547333 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.547243 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz"] Jul 16 12:21:23.560309 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.557649 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v"] Jul 16 12:21:23.566438 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:23.566397 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12bd93d9_9fc5_44d5_b607_1a4de8544511.slice/crio-8c5839b2c82fba0cda85a3b3390c115a92cc784136766eba7c7095cc1abcde8a WatchSource:0}: Error finding container 8c5839b2c82fba0cda85a3b3390c115a92cc784136766eba7c7095cc1abcde8a: Status 404 returned error can't find the container with id 8c5839b2c82fba0cda85a3b3390c115a92cc784136766eba7c7095cc1abcde8a Jul 16 12:21:23.643064 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.643029 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-x9fmw"] Jul 16 12:21:23.647960 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:23.647922 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62175354_1513_4ce2_bf86_3c4a1755bd54.slice/crio-4edfbdfa7f427d4dd9af39e56ffcdd37eeb4853b6a353cb99773a15784fc4511 WatchSource:0}: Error finding container 4edfbdfa7f427d4dd9af39e56ffcdd37eeb4853b6a353cb99773a15784fc4511: Status 404 returned error can't find the container with id 4edfbdfa7f427d4dd9af39e56ffcdd37eeb4853b6a353cb99773a15784fc4511 Jul 16 12:21:23.660548 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.660512 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-294g4"] Jul 16 12:21:23.664234 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:23.664189 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c640aa2_f5aa_4bec_8081_6c4310467b05.slice/crio-e7b5cb57135ddb5cbc771e5f146371f8d99d380a726e89e36f2e22b0c5617201 WatchSource:0}: Error finding container e7b5cb57135ddb5cbc771e5f146371f8d99d380a726e89e36f2e22b0c5617201: Status 404 returned error can't find the container with id e7b5cb57135ddb5cbc771e5f146371f8d99d380a726e89e36f2e22b0c5617201 Jul 16 12:21:23.870346 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:23.870313 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7"] Jul 16 12:21:23.873075 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:23.873031 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1afae13_8665_4f63_bd94_06be57bdf4e2.slice/crio-29171458b3e37868681d51b731e90a2f657d2d2d11b3bf8fa092bfe4e65ff00f WatchSource:0}: Error finding container 29171458b3e37868681d51b731e90a2f657d2d2d11b3bf8fa092bfe4e65ff00f: Status 404 returned error can't find the container with id 29171458b3e37868681d51b731e90a2f657d2d2d11b3bf8fa092bfe4e65ff00f Jul 16 12:21:24.260448 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.260330 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" event={"ID":"dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6","Type":"ContainerStarted","Data":"a7d13ff7281f3efa073e34c4469d365df86984bc19a55b9fc2560a63027a477d"} Jul 16 12:21:24.262011 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.261909 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" event={"ID":"0dcb5501-79e4-4266-b19c-05851a8abb0c","Type":"ContainerStarted","Data":"02e0c2f1b6d5bdb32eeb00f323ac02e598e89cb27534c1c1d0e522f3918f9e2d"} Jul 16 12:21:24.265254 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.265210 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" event={"ID":"0c640aa2-f5aa-4bec-8081-6c4310467b05","Type":"ContainerStarted","Data":"e7b5cb57135ddb5cbc771e5f146371f8d99d380a726e89e36f2e22b0c5617201"} Jul 16 12:21:24.267566 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.267501 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" event={"ID":"12bd93d9-9fc5-44d5-b607-1a4de8544511","Type":"ContainerStarted","Data":"8c5839b2c82fba0cda85a3b3390c115a92cc784136766eba7c7095cc1abcde8a"} Jul 16 12:21:24.270060 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.269991 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" event={"ID":"a1afae13-8665-4f63-bd94-06be57bdf4e2","Type":"ContainerStarted","Data":"29171458b3e37868681d51b731e90a2f657d2d2d11b3bf8fa092bfe4e65ff00f"} Jul 16 12:21:24.272336 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.272250 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-x9fmw" event={"ID":"62175354-1513-4ce2-bf86-3c4a1755bd54","Type":"ContainerStarted","Data":"4edfbdfa7f427d4dd9af39e56ffcdd37eeb4853b6a353cb99773a15784fc4511"} Jul 16 12:21:24.502743 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.501695 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bdc767856-9h58s"] Jul 16 12:21:24.513180 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.511472 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.514292 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.514174 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdc767856-9h58s"] Jul 16 12:21:24.514818 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.514639 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 12:21:24.514818 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.514650 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 12:21:24.515010 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.514957 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-snwwc\"" Jul 16 12:21:24.516145 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.515476 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 12:21:24.516145 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.515525 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 12:21:24.516145 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.515476 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 12:21:24.536749 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.534163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-serving-cert\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.536749 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.534229 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-oauth-config\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.536749 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.534287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-service-ca\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.536749 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.534320 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s9tf\" (UniqueName: \"kubernetes.io/projected/f18df02a-d0c8-4115-851e-0e95eff25244-kube-api-access-9s9tf\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.536749 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.534372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-oauth-serving-cert\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.536749 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.534428 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-console-config\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.636726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.635893 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-oauth-serving-cert\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.636726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.635985 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-console-config\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.636726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.636025 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-serving-cert\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.636726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.636066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-oauth-config\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.636726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.636110 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-service-ca\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.636726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.636170 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s9tf\" (UniqueName: \"kubernetes.io/projected/f18df02a-d0c8-4115-851e-0e95eff25244-kube-api-access-9s9tf\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.636726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.636661 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-oauth-serving-cert\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.636726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.636688 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-service-ca\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.637307 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.636821 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-console-config\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.639280 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.639239 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-oauth-config\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.639280 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.639272 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-serving-cert\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.646120 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.646092 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s9tf\" (UniqueName: \"kubernetes.io/projected/f18df02a-d0c8-4115-851e-0e95eff25244-kube-api-access-9s9tf\") pod \"console-bdc767856-9h58s\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:24.825921 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:24.825835 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:27.230846 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:27.229843 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-djqx8" Jul 16 12:21:29.433906 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:29.433668 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdc767856-9h58s"] Jul 16 12:21:31.268563 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:31.268516 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18df02a_d0c8_4115_851e_0e95eff25244.slice/crio-381d67c7e009f81fab058df5b50ff71ab60243b8aa884273194eac861c770463 WatchSource:0}: Error finding container 381d67c7e009f81fab058df5b50ff71ab60243b8aa884273194eac861c770463: Status 404 returned error can't find the container with id 381d67c7e009f81fab058df5b50ff71ab60243b8aa884273194eac861c770463 Jul 16 12:21:31.314910 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:31.314847 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdc767856-9h58s" event={"ID":"f18df02a-d0c8-4115-851e-0e95eff25244","Type":"ContainerStarted","Data":"381d67c7e009f81fab058df5b50ff71ab60243b8aa884273194eac861c770463"} Jul 16 12:21:32.569244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:32.569192 2570 patch_prober.go:28] interesting pod/image-registry-674f575bbd-4962w container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 12:21:32.569700 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:32.569270 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-674f575bbd-4962w" podUID="0aaaae00-5d99-4149-8347-aba5bc6a4426" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 12:21:34.341236 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.341137 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-82gfb" event={"ID":"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03","Type":"ContainerStarted","Data":"8df237b28e230aefb8697938ca10632c2cf095b6d6fe4ceb881c360d93d30b70"} Jul 16 12:21:34.343916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.343857 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" event={"ID":"0dcb5501-79e4-4266-b19c-05851a8abb0c","Type":"ContainerStarted","Data":"10f137b42740c2fc153566fb717f0dc189d9134604395f26542793aeece51249"} Jul 16 12:21:34.344773 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.344538 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:34.346072 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.346013 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" Jul 16 12:21:34.349919 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.349699 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" event={"ID":"0c640aa2-f5aa-4bec-8081-6c4310467b05","Type":"ContainerStarted","Data":"1930d0aef14856e0f39ccdf07e0d3146802ee831fc643ff018c6f4d4764d4c76"} Jul 16 12:21:34.352662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.352633 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" event={"ID":"12bd93d9-9fc5-44d5-b607-1a4de8544511","Type":"ContainerStarted","Data":"ab539db0dbf201bbf9bcb8627fc55bc90c56bba34eae33e7b12d3512f915c545"} Jul 16 12:21:34.355361 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.355334 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" event={"ID":"a1afae13-8665-4f63-bd94-06be57bdf4e2","Type":"ContainerStarted","Data":"cfb3a7530bed95b35a28d811c0281392ed7374183e2b1ab1cea9b17bd9067114"} Jul 16 12:21:34.356320 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.356302 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" Jul 16 12:21:34.357816 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.357729 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" event={"ID":"dcffd49e-41e3-4a7b-bd4c-4caf711ba6c6","Type":"ContainerStarted","Data":"9de002d026b17290baf94f8ab5d5f70b584c0c439003f5546fc78b18411a7668"} Jul 16 12:21:34.363563 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.363534 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" Jul 16 12:21:34.365462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.365315 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648cbf7894-mftsz" podStartSLOduration=1.777811655 podStartE2EDuration="12.365294361s" totalImagesPullingTime="10.587482706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:34.36284202 +0000 UTC m=+89.215042851" watchObservedRunningTime="2026-07-16 12:21:34.365294361 +0000 UTC m=+89.217495174" Jul 16 12:21:34.382189 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.382080 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wtjp7" podStartSLOduration=6.012542695 podStartE2EDuration="11.382057204s" totalImagesPullingTime="5.369514509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:34.381113221 +0000 UTC m=+89.233314052" watchObservedRunningTime="2026-07-16 12:21:34.382057204 +0000 UTC m=+89.234258017" Jul 16 12:21:34.420170 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.419795 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-294g4" podStartSLOduration=0.959569683 podStartE2EDuration="11.419771408s" totalImagesPullingTime="10.460201725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:34.417446243 +0000 UTC m=+89.269647074" watchObservedRunningTime="2026-07-16 12:21:34.419771408 +0000 UTC m=+89.271972211" Jul 16 12:21:34.436743 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:34.436176 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-967f5f9fd-6n82k" podStartSLOduration=1.83527005 podStartE2EDuration="12.43615378s" totalImagesPullingTime="10.60088373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:34.434489064 +0000 UTC m=+89.286689901" watchObservedRunningTime="2026-07-16 12:21:34.43615378 +0000 UTC m=+89.288354594" Jul 16 12:21:35.213260 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:35.213226 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:21:35.369777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:35.369738 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" event={"ID":"12bd93d9-9fc5-44d5-b607-1a4de8544511","Type":"ContainerStarted","Data":"04493a42e4b7510a53b44cbc0cf9788d2476a3031bbea55ade074610ddec6f4a"} Jul 16 12:21:35.370321 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:35.369793 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" event={"ID":"12bd93d9-9fc5-44d5-b607-1a4de8544511","Type":"ContainerStarted","Data":"a5879935024ea1dc9b1fcc667ef2a256a5a670f3b1363c7d78fc5aec993b9261"} Jul 16 12:21:35.395213 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:35.394975 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bf58b54c6-d2x8v" podStartSLOduration=2.808198945 podStartE2EDuration="13.394950422s" totalImagesPullingTime="10.586751477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:35.394647452 +0000 UTC m=+90.246848266" watchObservedRunningTime="2026-07-16 12:21:35.394950422 +0000 UTC m=+90.247151233" Jul 16 12:21:41.756262 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:41.756224 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bdc767856-9h58s"] Jul 16 12:21:43.197982 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:43.197950 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-svqkk" Jul 16 12:21:43.767905 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:43.767819 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vf972"] Jul 16 12:21:43.938275 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:43.937992 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:43.941250 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:43.941165 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 12:21:43.941250 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:43.941190 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 12:21:43.943176 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:43.942012 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 12:21:43.943176 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:43.942251 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5n6tr\"" Jul 16 12:21:43.943454 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:43.943438 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 12:21:44.027215 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027119 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-wtmp\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.027215 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027209 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-tls\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.027463 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.027463 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027291 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-accelerators-collector-config\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.027463 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027382 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h2hc\" (UniqueName: \"kubernetes.io/projected/eb9aa115-01de-4eb3-8ba4-28d9688fda43-kube-api-access-5h2hc\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.027619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027471 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb9aa115-01de-4eb3-8ba4-28d9688fda43-metrics-client-ca\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.027619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-sys\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.027619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027538 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-textfile\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.027619 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.027573 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-root\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.128962 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.128917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-tls\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.128978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129028 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-accelerators-collector-config\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129059 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h2hc\" (UniqueName: \"kubernetes.io/projected/eb9aa115-01de-4eb3-8ba4-28d9688fda43-kube-api-access-5h2hc\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129099 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb9aa115-01de-4eb3-8ba4-28d9688fda43-metrics-client-ca\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129136 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-sys\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-textfile\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129511 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-root\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129511 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129233 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-wtmp\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129511 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129428 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-wtmp\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.129511 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129482 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-sys\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.130184 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129869 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb9aa115-01de-4eb3-8ba4-28d9688fda43-root\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.130184 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.129980 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb9aa115-01de-4eb3-8ba4-28d9688fda43-metrics-client-ca\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.130184 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.130012 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-accelerators-collector-config\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.130461 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.130245 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-textfile\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.132639 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.132583 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.133079 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.133050 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb9aa115-01de-4eb3-8ba4-28d9688fda43-node-exporter-tls\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.145405 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.145335 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h2hc\" (UniqueName: \"kubernetes.io/projected/eb9aa115-01de-4eb3-8ba4-28d9688fda43-kube-api-access-5h2hc\") pod \"node-exporter-vf972\" (UID: \"eb9aa115-01de-4eb3-8ba4-28d9688fda43\") " pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:44.253167 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:44.253124 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vf972" Jul 16 12:21:47.493897 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:21:47.493847 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9aa115_01de_4eb3_8ba4_28d9688fda43.slice/crio-fdefc9391c057dba108cee511a42ad1ba936890a747dd9c8821e13fdb48f08f8 WatchSource:0}: Error finding container fdefc9391c057dba108cee511a42ad1ba936890a747dd9c8821e13fdb48f08f8: Status 404 returned error can't find the container with id fdefc9391c057dba108cee511a42ad1ba936890a747dd9c8821e13fdb48f08f8 Jul 16 12:21:48.444934 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:48.443111 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-82gfb" event={"ID":"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03","Type":"ContainerStarted","Data":"4d236ad7731484258d518836165ae54986e30994e00be583fc36e8a93a40b619"} Jul 16 12:21:48.451374 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:48.448524 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-x9fmw" event={"ID":"62175354-1513-4ce2-bf86-3c4a1755bd54","Type":"ContainerStarted","Data":"376838439bc6a6614c3361c3c61ca6df23158d1589ed30a5401321ef73be7f8f"} Jul 16 12:21:48.451374 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:48.449558 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-x9fmw" Jul 16 12:21:48.459116 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:48.459045 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf972" event={"ID":"eb9aa115-01de-4eb3-8ba4-28d9688fda43","Type":"ContainerStarted","Data":"fdefc9391c057dba108cee511a42ad1ba936890a747dd9c8821e13fdb48f08f8"} Jul 16 12:21:48.462509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:48.462003 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdc767856-9h58s" event={"ID":"f18df02a-d0c8-4115-851e-0e95eff25244","Type":"ContainerStarted","Data":"3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01"} Jul 16 12:21:48.462509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:48.462378 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-x9fmw" Jul 16 12:21:48.505860 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:48.505795 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-x9fmw" podStartSLOduration=1.66571179 podStartE2EDuration="25.50576812s" totalImagesPullingTime="23.84005633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:48.482785522 +0000 UTC m=+103.334986334" watchObservedRunningTime="2026-07-16 12:21:48.50576812 +0000 UTC m=+103.357968933" Jul 16 12:21:48.531024 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:48.530615 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bdc767856-9h58s" podStartSLOduration=8.309794836 podStartE2EDuration="24.530588027s" totalImagesPullingTime="16.220793191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:48.530081084 +0000 UTC m=+103.382281895" watchObservedRunningTime="2026-07-16 12:21:48.530588027 +0000 UTC m=+103.382788838" Jul 16 12:21:50.476948 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:50.476903 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf972" event={"ID":"eb9aa115-01de-4eb3-8ba4-28d9688fda43","Type":"ContainerStarted","Data":"c49b53288b0df25c3966ed4270d2b463e86db2f2abf15f326f83d9c3e8937712"} Jul 16 12:21:50.915317 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:50.914676 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-674f575bbd-4962w"] Jul 16 12:21:53.498992 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:53.498946 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-82gfb" event={"ID":"26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03","Type":"ContainerStarted","Data":"d0aa9f2651d29dc8c992afd890a3ae61a2c29526194863fe53ff4ed2192870e9"} Jul 16 12:21:53.501542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:53.501503 2570 generic.go:356] "Generic (PLEG): container finished" podID="eb9aa115-01de-4eb3-8ba4-28d9688fda43" containerID="c49b53288b0df25c3966ed4270d2b463e86db2f2abf15f326f83d9c3e8937712" exitCode=0 Jul 16 12:21:53.501703 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:53.501588 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf972" event={"ID":"eb9aa115-01de-4eb3-8ba4-28d9688fda43","Type":"ContainerDied","Data":"c49b53288b0df25c3966ed4270d2b463e86db2f2abf15f326f83d9c3e8937712"} Jul 16 12:21:53.524059 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:53.523993 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-82gfb" podStartSLOduration=33.545564813 podStartE2EDuration="1m4.523971076s" totalImagesPullingTime="30.978406263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:53.522084781 +0000 UTC m=+108.374285594" watchObservedRunningTime="2026-07-16 12:21:53.523971076 +0000 UTC m=+108.376171889" Jul 16 12:21:54.509280 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:54.509238 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf972" event={"ID":"eb9aa115-01de-4eb3-8ba4-28d9688fda43","Type":"ContainerStarted","Data":"b224958ab7f85c0059fd70bec29da1e7f9ce75b74f7ce734dac5a4825131edd5"} Jul 16 12:21:54.509758 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:54.509316 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf972" event={"ID":"eb9aa115-01de-4eb3-8ba4-28d9688fda43","Type":"ContainerStarted","Data":"f65d841882fc97e7d0a63ba4b2e53f52b895ab964229d44ce643f6275572f0e5"} Jul 16 12:21:54.533763 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:54.533697 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vf972" podStartSLOduration=8.784456967 podStartE2EDuration="11.533671432s" totalImagesPullingTime="2.642440892s" totalInitContainerRuntime="106.773573ms" isStatefulPod=true podCreationTimestamp="2026-07-16 12:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:54.532434689 +0000 UTC m=+109.384635519" watchObservedRunningTime="2026-07-16 12:21:54.533671432 +0000 UTC m=+109.385872268" Jul 16 12:21:54.827009 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:54.826966 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:21:59.533096 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:59.533053 2570 generic.go:356] "Generic (PLEG): container finished" podID="179cd1bb-64f3-4af6-927b-58ee4e78cf15" containerID="c308dba13f58a6782ff2b7ee94ed8de87dae0cd5d5f787437d45fab702a5bec8" exitCode=0 Jul 16 12:21:59.533626 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:59.533127 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-twttw" event={"ID":"179cd1bb-64f3-4af6-927b-58ee4e78cf15","Type":"ContainerDied","Data":"c308dba13f58a6782ff2b7ee94ed8de87dae0cd5d5f787437d45fab702a5bec8"} Jul 16 12:21:59.533626 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:21:59.533514 2570 scope.go:117] "RemoveContainer" containerID="c308dba13f58a6782ff2b7ee94ed8de87dae0cd5d5f787437d45fab702a5bec8" Jul 16 12:22:00.539318 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:00.539278 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-twttw" event={"ID":"179cd1bb-64f3-4af6-927b-58ee4e78cf15","Type":"ContainerStarted","Data":"1507f19d6158d3cb240fae08a293acfc3398c344339351b783ff2062456d093a"} Jul 16 12:22:08.575344 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:08.575302 2570 generic.go:356] "Generic (PLEG): container finished" podID="0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d" containerID="ddb892c4a9f6d7a0220a1fffc1ce4433bbb1b7e986c5044f580075708bee8fd1" exitCode=0 Jul 16 12:22:08.575858 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:08.575354 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" event={"ID":"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d","Type":"ContainerDied","Data":"ddb892c4a9f6d7a0220a1fffc1ce4433bbb1b7e986c5044f580075708bee8fd1"} Jul 16 12:22:08.575858 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:08.575772 2570 scope.go:117] "RemoveContainer" containerID="ddb892c4a9f6d7a0220a1fffc1ce4433bbb1b7e986c5044f580075708bee8fd1" Jul 16 12:22:09.581949 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:09.581911 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2tnsk" event={"ID":"0431c17e-7a15-4fbc-bf4a-0cc2e5f34a0d","Type":"ContainerStarted","Data":"2294a8d95e9fa9e3ccbc94d3ea52d8ecb8dda02b54be5b4f7a8c07ef812a01b2"} Jul 16 12:22:13.491616 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.491531 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bdc767856-9h58s" podUID="f18df02a-d0c8-4115-851e-0e95eff25244" containerName="console" containerID="cri-o://3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01" gracePeriod=15 Jul 16 12:22:13.808481 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.808448 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:22:13.896582 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.896552 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-service-ca\") pod \"f18df02a-d0c8-4115-851e-0e95eff25244\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " Jul 16 12:22:13.896770 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.896617 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-oauth-serving-cert\") pod \"f18df02a-d0c8-4115-851e-0e95eff25244\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " Jul 16 12:22:13.896770 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.896653 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-serving-cert\") pod \"f18df02a-d0c8-4115-851e-0e95eff25244\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " Jul 16 12:22:13.896770 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.896683 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-console-config\") pod \"f18df02a-d0c8-4115-851e-0e95eff25244\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " Jul 16 12:22:13.896770 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.896711 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-oauth-config\") pod \"f18df02a-d0c8-4115-851e-0e95eff25244\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " Jul 16 12:22:13.896770 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.896761 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s9tf\" (UniqueName: \"kubernetes.io/projected/f18df02a-d0c8-4115-851e-0e95eff25244-kube-api-access-9s9tf\") pod \"f18df02a-d0c8-4115-851e-0e95eff25244\" (UID: \"f18df02a-d0c8-4115-851e-0e95eff25244\") " Jul 16 12:22:13.897064 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.897008 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-service-ca" (OuterVolumeSpecName: "service-ca") pod "f18df02a-d0c8-4115-851e-0e95eff25244" (UID: "f18df02a-d0c8-4115-851e-0e95eff25244"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:22:13.897166 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.897120 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f18df02a-d0c8-4115-851e-0e95eff25244" (UID: "f18df02a-d0c8-4115-851e-0e95eff25244"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:22:13.897342 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.897283 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-oauth-serving-cert\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:13.897342 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.897308 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-service-ca\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:13.897477 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.897350 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-console-config" (OuterVolumeSpecName: "console-config") pod "f18df02a-d0c8-4115-851e-0e95eff25244" (UID: "f18df02a-d0c8-4115-851e-0e95eff25244"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:22:13.900082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.900047 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f18df02a-d0c8-4115-851e-0e95eff25244" (UID: "f18df02a-d0c8-4115-851e-0e95eff25244"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:22:13.900203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.900146 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f18df02a-d0c8-4115-851e-0e95eff25244-kube-api-access-9s9tf" (OuterVolumeSpecName: "kube-api-access-9s9tf") pod "f18df02a-d0c8-4115-851e-0e95eff25244" (UID: "f18df02a-d0c8-4115-851e-0e95eff25244"). InnerVolumeSpecName "kube-api-access-9s9tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:22:13.900203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.900188 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f18df02a-d0c8-4115-851e-0e95eff25244" (UID: "f18df02a-d0c8-4115-851e-0e95eff25244"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:22:13.997821 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.997783 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-serving-cert\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:13.998016 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.997826 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18df02a-d0c8-4115-851e-0e95eff25244-console-config\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:13.998016 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.997843 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18df02a-d0c8-4115-851e-0e95eff25244-console-oauth-config\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:13.998016 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:13.997860 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s9tf\" (UniqueName: \"kubernetes.io/projected/f18df02a-d0c8-4115-851e-0e95eff25244-kube-api-access-9s9tf\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:14.610229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.610191 2570 generic.go:356] "Generic (PLEG): container finished" podID="b58c4c06-bf79-45c4-9be0-f303f5b942c6" containerID="d378771bfcfc2a75c42e71b3ebca2f7268fadbee7b4ad312efed2ea56e4aefe2" exitCode=0 Jul 16 12:22:14.610758 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.610276 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" event={"ID":"b58c4c06-bf79-45c4-9be0-f303f5b942c6","Type":"ContainerDied","Data":"d378771bfcfc2a75c42e71b3ebca2f7268fadbee7b4ad312efed2ea56e4aefe2"} Jul 16 12:22:14.610758 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.610676 2570 scope.go:117] "RemoveContainer" containerID="d378771bfcfc2a75c42e71b3ebca2f7268fadbee7b4ad312efed2ea56e4aefe2" Jul 16 12:22:14.611812 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.611786 2570 generic.go:356] "Generic (PLEG): container finished" podID="f18df02a-d0c8-4115-851e-0e95eff25244" containerID="3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01" exitCode=0 Jul 16 12:22:14.611950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.611849 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdc767856-9h58s" Jul 16 12:22:14.611950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.611868 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdc767856-9h58s" event={"ID":"f18df02a-d0c8-4115-851e-0e95eff25244","Type":"ContainerDied","Data":"3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01"} Jul 16 12:22:14.611950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.611937 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdc767856-9h58s" event={"ID":"f18df02a-d0c8-4115-851e-0e95eff25244","Type":"ContainerDied","Data":"381d67c7e009f81fab058df5b50ff71ab60243b8aa884273194eac861c770463"} Jul 16 12:22:14.612071 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.611958 2570 scope.go:117] "RemoveContainer" containerID="3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01" Jul 16 12:22:14.638402 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.638357 2570 scope.go:117] "RemoveContainer" containerID="3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01" Jul 16 12:22:14.639064 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:22:14.639023 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01\": container with ID starting with 3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01 not found: ID does not exist" containerID="3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01" Jul 16 12:22:14.639179 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.639080 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01"} err="failed to get container status \"3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01\": rpc error: code = NotFound desc = could not find container \"3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01\": container with ID starting with 3b410de9fb7b6715677c17bfdaf3d42697a39bb34357b36bad372b0471734a01 not found: ID does not exist" Jul 16 12:22:14.645677 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.645645 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bdc767856-9h58s"] Jul 16 12:22:14.653738 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:14.653702 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bdc767856-9h58s"] Jul 16 12:22:15.619066 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:15.619029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qx8sm" event={"ID":"b58c4c06-bf79-45c4-9be0-f303f5b942c6","Type":"ContainerStarted","Data":"864ed25fb3f38390eee5d8a4f14623fed836e2ca001b4d84473173132f6c1bd7"} Jul 16 12:22:15.823784 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:15.823743 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f18df02a-d0c8-4115-851e-0e95eff25244" path="/var/lib/kubelet/pods/f18df02a-d0c8-4115-851e-0e95eff25244/volumes" Jul 16 12:22:15.949183 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:15.949074 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-674f575bbd-4962w" podUID="0aaaae00-5d99-4149-8347-aba5bc6a4426" containerName="registry" containerID="cri-o://073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b" gracePeriod=30 Jul 16 12:22:16.245717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.245678 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:22:16.319389 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319350 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-trusted-ca\") pod \"0aaaae00-5d99-4149-8347-aba5bc6a4426\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " Jul 16 12:22:16.319389 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319396 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0aaaae00-5d99-4149-8347-aba5bc6a4426-ca-trust-extracted\") pod \"0aaaae00-5d99-4149-8347-aba5bc6a4426\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " Jul 16 12:22:16.319659 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319445 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-certificates\") pod \"0aaaae00-5d99-4149-8347-aba5bc6a4426\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " Jul 16 12:22:16.319659 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319480 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt7kf\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-kube-api-access-kt7kf\") pod \"0aaaae00-5d99-4149-8347-aba5bc6a4426\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " Jul 16 12:22:16.319659 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319532 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-installation-pull-secrets\") pod \"0aaaae00-5d99-4149-8347-aba5bc6a4426\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " Jul 16 12:22:16.319659 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319570 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-bound-sa-token\") pod \"0aaaae00-5d99-4149-8347-aba5bc6a4426\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " Jul 16 12:22:16.319659 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319600 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-image-registry-private-configuration\") pod \"0aaaae00-5d99-4149-8347-aba5bc6a4426\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " Jul 16 12:22:16.319659 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319636 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") pod \"0aaaae00-5d99-4149-8347-aba5bc6a4426\" (UID: \"0aaaae00-5d99-4149-8347-aba5bc6a4426\") " Jul 16 12:22:16.319976 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319835 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0aaaae00-5d99-4149-8347-aba5bc6a4426" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:22:16.319976 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.319898 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0aaaae00-5d99-4149-8347-aba5bc6a4426" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:22:16.322698 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.322658 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0aaaae00-5d99-4149-8347-aba5bc6a4426" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:22:16.322698 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.322672 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0aaaae00-5d99-4149-8347-aba5bc6a4426" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:22:16.322925 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.322759 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0aaaae00-5d99-4149-8347-aba5bc6a4426" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:22:16.322925 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.322824 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0aaaae00-5d99-4149-8347-aba5bc6a4426" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:22:16.322925 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.322865 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-kube-api-access-kt7kf" (OuterVolumeSpecName: "kube-api-access-kt7kf") pod "0aaaae00-5d99-4149-8347-aba5bc6a4426" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426"). InnerVolumeSpecName "kube-api-access-kt7kf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:22:16.328404 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.328373 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aaaae00-5d99-4149-8347-aba5bc6a4426-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0aaaae00-5d99-4149-8347-aba5bc6a4426" (UID: "0aaaae00-5d99-4149-8347-aba5bc6a4426"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:22:16.420542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.420499 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0aaaae00-5d99-4149-8347-aba5bc6a4426-ca-trust-extracted\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:16.420542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.420532 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-certificates\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:16.420542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.420543 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt7kf\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-kube-api-access-kt7kf\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:16.420542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.420551 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-installation-pull-secrets\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:16.420826 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.420562 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-bound-sa-token\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:16.420826 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.420572 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0aaaae00-5d99-4149-8347-aba5bc6a4426-image-registry-private-configuration\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:16.420826 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.420580 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0aaaae00-5d99-4149-8347-aba5bc6a4426-registry-tls\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:16.420826 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.420588 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0aaaae00-5d99-4149-8347-aba5bc6a4426-trusted-ca\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:22:16.631639 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.631593 2570 generic.go:356] "Generic (PLEG): container finished" podID="0aaaae00-5d99-4149-8347-aba5bc6a4426" containerID="073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b" exitCode=0 Jul 16 12:22:16.632184 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.631657 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674f575bbd-4962w" Jul 16 12:22:16.632184 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.631662 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-674f575bbd-4962w" event={"ID":"0aaaae00-5d99-4149-8347-aba5bc6a4426","Type":"ContainerDied","Data":"073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b"} Jul 16 12:22:16.632184 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.631734 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-674f575bbd-4962w" event={"ID":"0aaaae00-5d99-4149-8347-aba5bc6a4426","Type":"ContainerDied","Data":"96fea32a7d402357db1a697b90f13831c7d845e6aa9beff6cfb6fa09100e0358"} Jul 16 12:22:16.632184 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.631759 2570 scope.go:117] "RemoveContainer" containerID="073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b" Jul 16 12:22:16.640766 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.640746 2570 scope.go:117] "RemoveContainer" containerID="073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b" Jul 16 12:22:16.641076 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:22:16.641053 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b\": container with ID starting with 073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b not found: ID does not exist" containerID="073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b" Jul 16 12:22:16.641161 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.641088 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b"} err="failed to get container status \"073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b\": rpc error: code = NotFound desc = could not find container \"073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b\": container with ID starting with 073e4769797592d3c0892f645396e2d04bdb343071cdcec15c3191d35706894b not found: ID does not exist" Jul 16 12:22:16.654789 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.654752 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-674f575bbd-4962w"] Jul 16 12:22:16.660958 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:16.660930 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-674f575bbd-4962w"] Jul 16 12:22:17.823530 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:22:17.823495 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aaaae00-5d99-4149-8347-aba5bc6a4426" path="/var/lib/kubelet/pods/0aaaae00-5d99-4149-8347-aba5bc6a4426/volumes" Jul 16 12:25:05.629324 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:05.629293 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:25:05.632800 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:05.632770 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:25:05.638894 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:05.638856 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:25:05.641533 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:05.641444 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 12:25:05.643785 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:05.643762 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:25:23.522568 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.522525 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn"] Jul 16 12:25:23.524995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.522854 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aaaae00-5d99-4149-8347-aba5bc6a4426" containerName="registry" Jul 16 12:25:23.524995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.522864 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aaaae00-5d99-4149-8347-aba5bc6a4426" containerName="registry" Jul 16 12:25:23.524995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.522902 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18df02a-d0c8-4115-851e-0e95eff25244" containerName="console" Jul 16 12:25:23.524995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.522909 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18df02a-d0c8-4115-851e-0e95eff25244" containerName="console" Jul 16 12:25:23.524995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.522960 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aaaae00-5d99-4149-8347-aba5bc6a4426" containerName="registry" Jul 16 12:25:23.524995 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.522970 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f18df02a-d0c8-4115-851e-0e95eff25244" containerName="console" Jul 16 12:25:23.525869 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.525850 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.532102 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.532070 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 12:25:23.532292 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.532084 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 12:25:23.532292 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.532211 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 12:25:23.532292 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.532210 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 12:25:23.536607 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.536582 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rxvlt\"" Jul 16 12:25:23.547228 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.547197 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn"] Jul 16 12:25:23.649260 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.649216 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0370cf94-99db-4105-8810-1a406b604241-webhook-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.649260 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.649265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0370cf94-99db-4105-8810-1a406b604241-tmp\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.649477 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.649314 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0370cf94-99db-4105-8810-1a406b604241-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.649477 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.649354 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0370cf94-99db-4105-8810-1a406b604241-manifests\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.649477 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.649399 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bswbb\" (UniqueName: \"kubernetes.io/projected/0370cf94-99db-4105-8810-1a406b604241-kube-api-access-bswbb\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.749833 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.749788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bswbb\" (UniqueName: \"kubernetes.io/projected/0370cf94-99db-4105-8810-1a406b604241-kube-api-access-bswbb\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.750067 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.749847 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0370cf94-99db-4105-8810-1a406b604241-webhook-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.750067 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.749871 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0370cf94-99db-4105-8810-1a406b604241-tmp\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.750067 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.749912 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0370cf94-99db-4105-8810-1a406b604241-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.750067 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.749944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0370cf94-99db-4105-8810-1a406b604241-manifests\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.750570 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.750531 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0370cf94-99db-4105-8810-1a406b604241-manifests\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.752627 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.752591 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0370cf94-99db-4105-8810-1a406b604241-webhook-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.752806 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.752781 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0370cf94-99db-4105-8810-1a406b604241-tmp\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.753067 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.753046 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0370cf94-99db-4105-8810-1a406b604241-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.760821 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.760795 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bswbb\" (UniqueName: \"kubernetes.io/projected/0370cf94-99db-4105-8810-1a406b604241-kube-api-access-bswbb\") pod \"opendatahub-operator-controller-manager-87d97db45-r7xcn\" (UID: \"0370cf94-99db-4105-8810-1a406b604241\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.836972 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.836928 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:23.982492 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.982347 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn"] Jul 16 12:25:23.985246 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:25:23.985211 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0370cf94_99db_4105_8810_1a406b604241.slice/crio-c6b6f41af0f0231bd269d99416a29daa81fac0bf6d050d70c8a92f60472be93d WatchSource:0}: Error finding container c6b6f41af0f0231bd269d99416a29daa81fac0bf6d050d70c8a92f60472be93d: Status 404 returned error can't find the container with id c6b6f41af0f0231bd269d99416a29daa81fac0bf6d050d70c8a92f60472be93d Jul 16 12:25:23.987004 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:23.986974 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:25:24.408937 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:24.408897 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" event={"ID":"0370cf94-99db-4105-8810-1a406b604241","Type":"ContainerStarted","Data":"c6b6f41af0f0231bd269d99416a29daa81fac0bf6d050d70c8a92f60472be93d"} Jul 16 12:25:27.425584 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:27.425543 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" event={"ID":"0370cf94-99db-4105-8810-1a406b604241","Type":"ContainerStarted","Data":"e39731ce89ed061d033ec2273acaeaaf87fac637f250c032b996afd82d9e0bed"} Jul 16 12:25:29.436953 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:29.436918 2570 generic.go:356] "Generic (PLEG): container finished" podID="0370cf94-99db-4105-8810-1a406b604241" containerID="e39731ce89ed061d033ec2273acaeaaf87fac637f250c032b996afd82d9e0bed" exitCode=0 Jul 16 12:25:29.437392 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:29.436979 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" event={"ID":"0370cf94-99db-4105-8810-1a406b604241","Type":"ContainerDied","Data":"e39731ce89ed061d033ec2273acaeaaf87fac637f250c032b996afd82d9e0bed"} Jul 16 12:25:30.443309 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:30.443269 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" event={"ID":"0370cf94-99db-4105-8810-1a406b604241","Type":"ContainerStarted","Data":"f5ac79ca600ffa249ccb0bb7fa8dcdaf1cd0eac37fc57bf862b4033116fa6d89"} Jul 16 12:25:30.443827 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:30.443503 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:30.469932 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:30.469855 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" podStartSLOduration=2.780034841 podStartE2EDuration="7.469835983s" totalImagesPullingTime="3.545663004s" totalInitContainerRuntime="1.144138138s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:30.467950288 +0000 UTC m=+325.320151118" watchObservedRunningTime="2026-07-16 12:25:30.469835983 +0000 UTC m=+325.322036794" Jul 16 12:25:41.450189 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:41.450153 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-r7xcn" Jul 16 12:25:43.140727 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.140683 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl"] Jul 16 12:25:43.154095 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.154057 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.159238 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.159203 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 16 12:25:43.159471 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.159448 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl"] Jul 16 12:25:43.164539 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.164512 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sgkfp\"" Jul 16 12:25:43.164791 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.164768 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 16 12:25:43.317822 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.317786 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59dc9047-afce-4fdb-bfb7-ea6f39a397de-tmp\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.318082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.317923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnjf4\" (UniqueName: \"kubernetes.io/projected/59dc9047-afce-4fdb-bfb7-ea6f39a397de-kube-api-access-vnjf4\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.318082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.317958 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dc9047-afce-4fdb-bfb7-ea6f39a397de-tls-certs\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.418789 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.418681 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnjf4\" (UniqueName: \"kubernetes.io/projected/59dc9047-afce-4fdb-bfb7-ea6f39a397de-kube-api-access-vnjf4\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.418789 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.418721 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dc9047-afce-4fdb-bfb7-ea6f39a397de-tls-certs\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.418789 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.418764 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59dc9047-afce-4fdb-bfb7-ea6f39a397de-tmp\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.421255 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.421226 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59dc9047-afce-4fdb-bfb7-ea6f39a397de-tmp\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.421582 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.421558 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dc9047-afce-4fdb-bfb7-ea6f39a397de-tls-certs\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.433002 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.432973 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnjf4\" (UniqueName: \"kubernetes.io/projected/59dc9047-afce-4fdb-bfb7-ea6f39a397de-kube-api-access-vnjf4\") pod \"kube-auth-proxy-5f5767f667-gp5fl\" (UID: \"59dc9047-afce-4fdb-bfb7-ea6f39a397de\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.465694 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.465646 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" Jul 16 12:25:43.496854 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.496813 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cs5hs"] Jul 16 12:25:43.500679 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.500653 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:43.503358 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.503333 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 16 12:25:43.503503 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.503419 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qntnt\"" Jul 16 12:25:43.510222 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.510189 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cs5hs"] Jul 16 12:25:43.620151 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.620109 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80496865-9ce1-4ccc-8d6f-cc448df57433-cert\") pod \"odh-model-controller-7998c67dc4-cs5hs\" (UID: \"80496865-9ce1-4ccc-8d6f-cc448df57433\") " pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:43.620371 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.620264 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzbk7\" (UniqueName: \"kubernetes.io/projected/80496865-9ce1-4ccc-8d6f-cc448df57433-kube-api-access-kzbk7\") pod \"odh-model-controller-7998c67dc4-cs5hs\" (UID: \"80496865-9ce1-4ccc-8d6f-cc448df57433\") " pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:43.621539 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.621514 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl"] Jul 16 12:25:43.624028 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:25:43.623999 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dc9047_afce_4fdb_bfb7_ea6f39a397de.slice/crio-a14b6e4035b52702879f08cccd129c90635041c5026b5fef2af24f921094bb0f WatchSource:0}: Error finding container a14b6e4035b52702879f08cccd129c90635041c5026b5fef2af24f921094bb0f: Status 404 returned error can't find the container with id a14b6e4035b52702879f08cccd129c90635041c5026b5fef2af24f921094bb0f Jul 16 12:25:43.721042 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.720933 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzbk7\" (UniqueName: \"kubernetes.io/projected/80496865-9ce1-4ccc-8d6f-cc448df57433-kube-api-access-kzbk7\") pod \"odh-model-controller-7998c67dc4-cs5hs\" (UID: \"80496865-9ce1-4ccc-8d6f-cc448df57433\") " pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:43.721042 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.721019 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80496865-9ce1-4ccc-8d6f-cc448df57433-cert\") pod \"odh-model-controller-7998c67dc4-cs5hs\" (UID: \"80496865-9ce1-4ccc-8d6f-cc448df57433\") " pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:43.721259 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:25:43.721156 2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 16 12:25:43.721259 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:25:43.721232 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80496865-9ce1-4ccc-8d6f-cc448df57433-cert podName:80496865-9ce1-4ccc-8d6f-cc448df57433 nodeName:}" failed. No retries permitted until 2026-07-16 12:25:44.221211652 +0000 UTC m=+339.073412453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80496865-9ce1-4ccc-8d6f-cc448df57433-cert") pod "odh-model-controller-7998c67dc4-cs5hs" (UID: "80496865-9ce1-4ccc-8d6f-cc448df57433") : secret "odh-model-controller-webhook-cert" not found Jul 16 12:25:43.732294 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:43.732262 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzbk7\" (UniqueName: \"kubernetes.io/projected/80496865-9ce1-4ccc-8d6f-cc448df57433-kube-api-access-kzbk7\") pod \"odh-model-controller-7998c67dc4-cs5hs\" (UID: \"80496865-9ce1-4ccc-8d6f-cc448df57433\") " pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:44.143397 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.143360 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdbxl"] Jul 16 12:25:44.147243 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.147217 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:44.151505 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.151476 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-r86nl\"" Jul 16 12:25:44.151668 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.151649 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 16 12:25:44.171686 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.171647 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdbxl"] Jul 16 12:25:44.225269 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.225232 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80496865-9ce1-4ccc-8d6f-cc448df57433-cert\") pod \"odh-model-controller-7998c67dc4-cs5hs\" (UID: \"80496865-9ce1-4ccc-8d6f-cc448df57433\") " pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:44.227855 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.227830 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80496865-9ce1-4ccc-8d6f-cc448df57433-cert\") pod \"odh-model-controller-7998c67dc4-cs5hs\" (UID: \"80496865-9ce1-4ccc-8d6f-cc448df57433\") " pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:44.326609 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.326568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50bccda8-a710-4b15-8daf-ddb5827605c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdbxl\" (UID: \"50bccda8-a710-4b15-8daf-ddb5827605c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:44.326609 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.326609 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhphk\" (UniqueName: \"kubernetes.io/projected/50bccda8-a710-4b15-8daf-ddb5827605c6-kube-api-access-mhphk\") pod \"model-serving-api-54d89bd5fc-vdbxl\" (UID: \"50bccda8-a710-4b15-8daf-ddb5827605c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:44.416679 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.416589 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:44.427982 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.427942 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50bccda8-a710-4b15-8daf-ddb5827605c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdbxl\" (UID: \"50bccda8-a710-4b15-8daf-ddb5827605c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:44.428169 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.428046 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhphk\" (UniqueName: \"kubernetes.io/projected/50bccda8-a710-4b15-8daf-ddb5827605c6-kube-api-access-mhphk\") pod \"model-serving-api-54d89bd5fc-vdbxl\" (UID: \"50bccda8-a710-4b15-8daf-ddb5827605c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:44.431709 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.431642 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50bccda8-a710-4b15-8daf-ddb5827605c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdbxl\" (UID: \"50bccda8-a710-4b15-8daf-ddb5827605c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:44.440419 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.440350 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhphk\" (UniqueName: \"kubernetes.io/projected/50bccda8-a710-4b15-8daf-ddb5827605c6-kube-api-access-mhphk\") pod \"model-serving-api-54d89bd5fc-vdbxl\" (UID: \"50bccda8-a710-4b15-8daf-ddb5827605c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:44.458138 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.458049 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:44.509259 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.509214 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" event={"ID":"59dc9047-afce-4fdb-bfb7-ea6f39a397de","Type":"ContainerStarted","Data":"a14b6e4035b52702879f08cccd129c90635041c5026b5fef2af24f921094bb0f"} Jul 16 12:25:44.600116 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.600008 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cs5hs"] Jul 16 12:25:44.602545 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:25:44.602506 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80496865_9ce1_4ccc_8d6f_cc448df57433.slice/crio-8eaca0f07f9b254baaaf81dbe8e3319bb30ba26abb28947f55ffba952fc5edea WatchSource:0}: Error finding container 8eaca0f07f9b254baaaf81dbe8e3319bb30ba26abb28947f55ffba952fc5edea: Status 404 returned error can't find the container with id 8eaca0f07f9b254baaaf81dbe8e3319bb30ba26abb28947f55ffba952fc5edea Jul 16 12:25:44.640680 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.640615 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdbxl"] Jul 16 12:25:44.644072 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:25:44.644028 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bccda8_a710_4b15_8daf_ddb5827605c6.slice/crio-72eaa8f8533b358edd188eab89d5b301294d2d5de7887b9d497dc07c04c54598 WatchSource:0}: Error finding container 72eaa8f8533b358edd188eab89d5b301294d2d5de7887b9d497dc07c04c54598: Status 404 returned error can't find the container with id 72eaa8f8533b358edd188eab89d5b301294d2d5de7887b9d497dc07c04c54598 Jul 16 12:25:44.692233 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.691967 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9"] Jul 16 12:25:44.697381 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.697175 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.699942 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.699916 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 12:25:44.700090 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.699978 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 12:25:44.700090 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.700010 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hqjbr\"" Jul 16 12:25:44.700216 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.699918 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 12:25:44.700316 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.700296 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 12:25:44.705917 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.705866 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9"] Jul 16 12:25:44.832909 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.832853 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.833075 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.832927 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b883c62d-e426-455e-8d47-65456e61307e-local-certs\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.833075 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.832959 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.833075 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.833055 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-istio-token\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.833182 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.833093 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-cacerts\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.833182 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.833113 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.833241 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.833179 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8wnq\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-kube-api-access-w8wnq\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.934375 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.934325 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-istio-token\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.934585 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.934405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-cacerts\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.934585 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.934434 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.934585 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.934486 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8wnq\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-kube-api-access-w8wnq\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.934585 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.934543 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.934585 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.934574 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b883c62d-e426-455e-8d47-65456e61307e-local-certs\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.934846 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.934615 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.935476 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.935416 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.937533 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.937503 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-cacerts\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.937671 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.937587 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b883c62d-e426-455e-8d47-65456e61307e-local-certs\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.937671 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.937618 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.937671 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.937649 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.943228 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.943159 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-istio-token\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:44.943451 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:44.943427 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8wnq\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-kube-api-access-w8wnq\") pod \"istiod-openshift-gateway-7574459656-cd9v9\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:45.011545 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:45.011503 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:45.157631 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:45.157595 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9"] Jul 16 12:25:45.160992 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:25:45.160965 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb883c62d_e426_455e_8d47_65456e61307e.slice/crio-e157f4566ba6aa3288f87d1b744c82e90cb06f9835be81abd52874b1e877b7da WatchSource:0}: Error finding container e157f4566ba6aa3288f87d1b744c82e90cb06f9835be81abd52874b1e877b7da: Status 404 returned error can't find the container with id e157f4566ba6aa3288f87d1b744c82e90cb06f9835be81abd52874b1e877b7da Jul 16 12:25:45.518932 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:45.518791 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" event={"ID":"80496865-9ce1-4ccc-8d6f-cc448df57433","Type":"ContainerStarted","Data":"8eaca0f07f9b254baaaf81dbe8e3319bb30ba26abb28947f55ffba952fc5edea"} Jul 16 12:25:45.521114 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:45.521023 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" event={"ID":"50bccda8-a710-4b15-8daf-ddb5827605c6","Type":"ContainerStarted","Data":"72eaa8f8533b358edd188eab89d5b301294d2d5de7887b9d497dc07c04c54598"} Jul 16 12:25:45.524260 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:45.524200 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" event={"ID":"b883c62d-e426-455e-8d47-65456e61307e","Type":"ContainerStarted","Data":"e157f4566ba6aa3288f87d1b744c82e90cb06f9835be81abd52874b1e877b7da"} Jul 16 12:25:49.750515 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:49.750477 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:25:49.750811 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:49.750548 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:25:50.552791 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.552744 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" event={"ID":"80496865-9ce1-4ccc-8d6f-cc448df57433","Type":"ContainerStarted","Data":"4606b8762c5f9542965c8c8db18cb8185a0150a285dbda025d4238e2684334d6"} Jul 16 12:25:50.553022 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.552824 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:25:50.554483 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.554455 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" event={"ID":"50bccda8-a710-4b15-8daf-ddb5827605c6","Type":"ContainerStarted","Data":"351c60c7f813e639785e02e418e0544cbbb02f9f7776d5db1e7ce3f6db0d6a69"} Jul 16 12:25:50.554621 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.554511 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:25:50.556200 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.556157 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" event={"ID":"59dc9047-afce-4fdb-bfb7-ea6f39a397de","Type":"ContainerStarted","Data":"797b3e17f0e669411b784bd1c21ec8142359f141c91c610e8b0a97b6b1dc6f59"} Jul 16 12:25:50.559240 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.558366 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" event={"ID":"b883c62d-e426-455e-8d47-65456e61307e","Type":"ContainerStarted","Data":"7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0"} Jul 16 12:25:50.559240 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.559176 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:50.561290 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.561256 2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cd9v9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 12:25:50.561417 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.561311 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" podUID="b883c62d-e426-455e-8d47-65456e61307e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 12:25:50.580242 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.580187 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" podStartSLOduration=2.425620898 podStartE2EDuration="7.58017122s" totalImagesPullingTime="5.154550322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:50.577928524 +0000 UTC m=+345.430129354" watchObservedRunningTime="2026-07-16 12:25:50.58017122 +0000 UTC m=+345.432372008" Jul 16 12:25:50.601322 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.601254 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" podStartSLOduration=1.507090431 podStartE2EDuration="6.601238564s" totalImagesPullingTime="5.094148133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:50.600097902 +0000 UTC m=+345.452298736" watchObservedRunningTime="2026-07-16 12:25:50.601238564 +0000 UTC m=+345.453439374" Jul 16 12:25:50.622239 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.622172 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f5767f667-gp5fl" podStartSLOduration=1.50734283 podStartE2EDuration="7.622151923s" totalImagesPullingTime="6.114809093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:50.621733805 +0000 UTC m=+345.473934642" watchObservedRunningTime="2026-07-16 12:25:50.622151923 +0000 UTC m=+345.474352734" Jul 16 12:25:50.653513 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:50.653437 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" podStartSLOduration=2.066233771 podStartE2EDuration="6.653411839s" totalImagesPullingTime="4.587178068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:50.651586976 +0000 UTC m=+345.503787816" watchObservedRunningTime="2026-07-16 12:25:50.653411839 +0000 UTC m=+345.505612651" Jul 16 12:25:51.564126 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:51.564095 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:25:53.478717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.478680 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk"] Jul 16 12:25:53.483523 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.483495 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:53.486364 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.486341 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 16 12:25:53.486364 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.486355 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-px5dq\"" Jul 16 12:25:53.494716 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.494686 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk"] Jul 16 12:25:53.510730 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.510695 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhqhw\" (UniqueName: \"kubernetes.io/projected/63143e74-a1d3-4430-acc0-e98d3c5e180e-kube-api-access-bhqhw\") pod \"kserve-controller-manager-d6f4b65b8-xqwnk\" (UID: \"63143e74-a1d3-4430-acc0-e98d3c5e180e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:53.511001 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.510744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63143e74-a1d3-4430-acc0-e98d3c5e180e-cert\") pod \"kserve-controller-manager-d6f4b65b8-xqwnk\" (UID: \"63143e74-a1d3-4430-acc0-e98d3c5e180e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:53.612057 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.612012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhqhw\" (UniqueName: \"kubernetes.io/projected/63143e74-a1d3-4430-acc0-e98d3c5e180e-kube-api-access-bhqhw\") pod \"kserve-controller-manager-d6f4b65b8-xqwnk\" (UID: \"63143e74-a1d3-4430-acc0-e98d3c5e180e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:53.612287 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.612078 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63143e74-a1d3-4430-acc0-e98d3c5e180e-cert\") pod \"kserve-controller-manager-d6f4b65b8-xqwnk\" (UID: \"63143e74-a1d3-4430-acc0-e98d3c5e180e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:53.612287 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:25:53.612210 2570 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 16 12:25:53.612472 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:25:53.612455 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63143e74-a1d3-4430-acc0-e98d3c5e180e-cert podName:63143e74-a1d3-4430-acc0-e98d3c5e180e nodeName:}" failed. No retries permitted until 2026-07-16 12:25:54.112272018 +0000 UTC m=+348.964472819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/63143e74-a1d3-4430-acc0-e98d3c5e180e-cert") pod "kserve-controller-manager-d6f4b65b8-xqwnk" (UID: "63143e74-a1d3-4430-acc0-e98d3c5e180e") : secret "kserve-webhook-server-cert" not found Jul 16 12:25:53.621673 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:53.621636 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhqhw\" (UniqueName: \"kubernetes.io/projected/63143e74-a1d3-4430-acc0-e98d3c5e180e-kube-api-access-bhqhw\") pod \"kserve-controller-manager-d6f4b65b8-xqwnk\" (UID: \"63143e74-a1d3-4430-acc0-e98d3c5e180e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:54.116290 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:54.116242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63143e74-a1d3-4430-acc0-e98d3c5e180e-cert\") pod \"kserve-controller-manager-d6f4b65b8-xqwnk\" (UID: \"63143e74-a1d3-4430-acc0-e98d3c5e180e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:54.118825 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:54.118795 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63143e74-a1d3-4430-acc0-e98d3c5e180e-cert\") pod \"kserve-controller-manager-d6f4b65b8-xqwnk\" (UID: \"63143e74-a1d3-4430-acc0-e98d3c5e180e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:54.395610 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:54.395512 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:54.547888 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:54.547847 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk"] Jul 16 12:25:54.549442 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:25:54.549415 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63143e74_a1d3_4430_acc0_e98d3c5e180e.slice/crio-b30eb513806f4d8828eb45406899381fc496f8cff9f8a3bb2d353d7d48a6c47d WatchSource:0}: Error finding container b30eb513806f4d8828eb45406899381fc496f8cff9f8a3bb2d353d7d48a6c47d: Status 404 returned error can't find the container with id b30eb513806f4d8828eb45406899381fc496f8cff9f8a3bb2d353d7d48a6c47d Jul 16 12:25:54.583520 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:54.583477 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" event={"ID":"63143e74-a1d3-4430-acc0-e98d3c5e180e","Type":"ContainerStarted","Data":"b30eb513806f4d8828eb45406899381fc496f8cff9f8a3bb2d353d7d48a6c47d"} Jul 16 12:25:57.613684 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:57.613575 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" event={"ID":"63143e74-a1d3-4430-acc0-e98d3c5e180e","Type":"ContainerStarted","Data":"fb3ae11f752914c715432113228b3986c0cb549d5dd122736b18c1a710032c1c"} Jul 16 12:25:57.613684 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:57.613648 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:25:57.631430 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:25:57.631369 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" podStartSLOduration=2.325553026 podStartE2EDuration="4.631348786s" totalImagesPullingTime="2.30579576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:57.63002727 +0000 UTC m=+352.482228099" watchObservedRunningTime="2026-07-16 12:25:57.631348786 +0000 UTC m=+352.483549596" Jul 16 12:26:01.566208 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:01.566171 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-cs5hs" Jul 16 12:26:01.568337 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:01.568314 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vdbxl" Jul 16 12:26:05.032765 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.032720 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9"] Jul 16 12:26:05.033255 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.032985 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" podUID="b883c62d-e426-455e-8d47-65456e61307e" containerName="discovery" containerID="cri-o://7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0" gracePeriod=30 Jul 16 12:26:05.301574 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.301543 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:26:05.422975 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.422934 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8wnq\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-kube-api-access-w8wnq\") pod \"b883c62d-e426-455e-8d47-65456e61307e\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " Jul 16 12:26:05.423164 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.423138 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-dns-cert\") pod \"b883c62d-e426-455e-8d47-65456e61307e\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " Jul 16 12:26:05.423208 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.423177 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-istio-token\") pod \"b883c62d-e426-455e-8d47-65456e61307e\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " Jul 16 12:26:05.423242 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.423219 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-ca-configmap\") pod \"b883c62d-e426-455e-8d47-65456e61307e\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " Jul 16 12:26:05.423277 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.423254 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-kubeconfig\") pod \"b883c62d-e426-455e-8d47-65456e61307e\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " Jul 16 12:26:05.423320 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.423303 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b883c62d-e426-455e-8d47-65456e61307e-local-certs\") pod \"b883c62d-e426-455e-8d47-65456e61307e\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " Jul 16 12:26:05.423371 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.423351 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-cacerts\") pod \"b883c62d-e426-455e-8d47-65456e61307e\" (UID: \"b883c62d-e426-455e-8d47-65456e61307e\") " Jul 16 12:26:05.423684 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.423653 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b883c62d-e426-455e-8d47-65456e61307e" (UID: "b883c62d-e426-455e-8d47-65456e61307e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:26:05.425542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.425518 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-kube-api-access-w8wnq" (OuterVolumeSpecName: "kube-api-access-w8wnq") pod "b883c62d-e426-455e-8d47-65456e61307e" (UID: "b883c62d-e426-455e-8d47-65456e61307e"). InnerVolumeSpecName "kube-api-access-w8wnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:26:05.425677 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.425582 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b883c62d-e426-455e-8d47-65456e61307e" (UID: "b883c62d-e426-455e-8d47-65456e61307e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:26:05.425737 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.425687 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b883c62d-e426-455e-8d47-65456e61307e" (UID: "b883c62d-e426-455e-8d47-65456e61307e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:26:05.425787 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.425764 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b883c62d-e426-455e-8d47-65456e61307e" (UID: "b883c62d-e426-455e-8d47-65456e61307e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:26:05.425832 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.425772 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b883c62d-e426-455e-8d47-65456e61307e-local-certs" (OuterVolumeSpecName: "local-certs") pod "b883c62d-e426-455e-8d47-65456e61307e" (UID: "b883c62d-e426-455e-8d47-65456e61307e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:26:05.425923 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.425904 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-cacerts" (OuterVolumeSpecName: "cacerts") pod "b883c62d-e426-455e-8d47-65456e61307e" (UID: "b883c62d-e426-455e-8d47-65456e61307e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:26:05.524502 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.524458 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-dns-cert\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:26:05.524502 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.524493 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-istio-token\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:26:05.524502 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.524506 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b883c62d-e426-455e-8d47-65456e61307e-istio-csr-ca-configmap\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:26:05.524757 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.524521 2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-istio-kubeconfig\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:26:05.524757 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.524532 2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b883c62d-e426-455e-8d47-65456e61307e-local-certs\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:26:05.524757 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.524543 2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b883c62d-e426-455e-8d47-65456e61307e-cacerts\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:26:05.524757 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.524555 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8wnq\" (UniqueName: \"kubernetes.io/projected/b883c62d-e426-455e-8d47-65456e61307e-kube-api-access-w8wnq\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:26:05.653088 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.653051 2570 generic.go:356] "Generic (PLEG): container finished" podID="b883c62d-e426-455e-8d47-65456e61307e" containerID="7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0" exitCode=0 Jul 16 12:26:05.653262 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.653118 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" Jul 16 12:26:05.653262 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.653131 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" event={"ID":"b883c62d-e426-455e-8d47-65456e61307e","Type":"ContainerDied","Data":"7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0"} Jul 16 12:26:05.653262 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.653176 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9" event={"ID":"b883c62d-e426-455e-8d47-65456e61307e","Type":"ContainerDied","Data":"e157f4566ba6aa3288f87d1b744c82e90cb06f9835be81abd52874b1e877b7da"} Jul 16 12:26:05.653262 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.653200 2570 scope.go:117] "RemoveContainer" containerID="7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0" Jul 16 12:26:05.662795 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.662775 2570 scope.go:117] "RemoveContainer" containerID="7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0" Jul 16 12:26:05.663115 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:26:05.663092 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0\": container with ID starting with 7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0 not found: ID does not exist" containerID="7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0" Jul 16 12:26:05.663211 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.663123 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0"} err="failed to get container status \"7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0\": rpc error: code = NotFound desc = could not find container \"7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0\": container with ID starting with 7aa7ad73fc55c3712bcd6c9aeebf9ed42495b435eb61f99ee99c6f80f61de5f0 not found: ID does not exist" Jul 16 12:26:05.676918 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.676885 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9"] Jul 16 12:26:05.683949 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.683870 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cd9v9"] Jul 16 12:26:05.824142 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:05.824104 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b883c62d-e426-455e-8d47-65456e61307e" path="/var/lib/kubelet/pods/b883c62d-e426-455e-8d47-65456e61307e/volumes" Jul 16 12:26:28.623432 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:28.623397 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xqwnk" Jul 16 12:26:44.608312 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.608266 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2scpj"] Jul 16 12:26:44.608825 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.608780 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b883c62d-e426-455e-8d47-65456e61307e" containerName="discovery" Jul 16 12:26:44.608825 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.608801 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b883c62d-e426-455e-8d47-65456e61307e" containerName="discovery" Jul 16 12:26:44.608990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.608957 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b883c62d-e426-455e-8d47-65456e61307e" containerName="discovery" Jul 16 12:26:44.614849 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.614822 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" Jul 16 12:26:44.617924 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.617893 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 12:26:44.617924 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.617903 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 12:26:44.618716 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.618688 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-tkvgf\"" Jul 16 12:26:44.621934 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.621901 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2scpj"] Jul 16 12:26:44.639677 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.639640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/1c80c5f0-0667-4b46-b8fa-10a32b98f10e-kube-api-access-8st8j\") pod \"kuadrant-operator-catalog-2scpj\" (UID: \"1c80c5f0-0667-4b46-b8fa-10a32b98f10e\") " pod="kuadrant-system/kuadrant-operator-catalog-2scpj" Jul 16 12:26:44.740282 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.740233 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/1c80c5f0-0667-4b46-b8fa-10a32b98f10e-kube-api-access-8st8j\") pod \"kuadrant-operator-catalog-2scpj\" (UID: \"1c80c5f0-0667-4b46-b8fa-10a32b98f10e\") " pod="kuadrant-system/kuadrant-operator-catalog-2scpj" Jul 16 12:26:44.750116 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.750074 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/1c80c5f0-0667-4b46-b8fa-10a32b98f10e-kube-api-access-8st8j\") pod \"kuadrant-operator-catalog-2scpj\" (UID: \"1c80c5f0-0667-4b46-b8fa-10a32b98f10e\") " pod="kuadrant-system/kuadrant-operator-catalog-2scpj" Jul 16 12:26:44.927821 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.927720 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" Jul 16 12:26:44.976722 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:44.976682 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2scpj"] Jul 16 12:26:45.074230 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.074198 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2scpj"] Jul 16 12:26:45.076507 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:26:45.076475 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c80c5f0_0667_4b46_b8fa_10a32b98f10e.slice/crio-c3b4c059aa1cc79d628371ab76e3daea526bd1c52bca2f62fb4276c9ad352880 WatchSource:0}: Error finding container c3b4c059aa1cc79d628371ab76e3daea526bd1c52bca2f62fb4276c9ad352880: Status 404 returned error can't find the container with id c3b4c059aa1cc79d628371ab76e3daea526bd1c52bca2f62fb4276c9ad352880 Jul 16 12:26:45.187008 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.186909 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ljmk2"] Jul 16 12:26:45.193990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.193951 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:26:45.200917 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.200868 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ljmk2"] Jul 16 12:26:45.244595 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.244548 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-954mg\" (UniqueName: \"kubernetes.io/projected/9a2b8396-e9c4-46db-8fd5-61bd54680ba6-kube-api-access-954mg\") pod \"kuadrant-operator-catalog-ljmk2\" (UID: \"9a2b8396-e9c4-46db-8fd5-61bd54680ba6\") " pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:26:45.345848 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.345798 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954mg\" (UniqueName: \"kubernetes.io/projected/9a2b8396-e9c4-46db-8fd5-61bd54680ba6-kube-api-access-954mg\") pod \"kuadrant-operator-catalog-ljmk2\" (UID: \"9a2b8396-e9c4-46db-8fd5-61bd54680ba6\") " pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:26:45.356021 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.355991 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-954mg\" (UniqueName: \"kubernetes.io/projected/9a2b8396-e9c4-46db-8fd5-61bd54680ba6-kube-api-access-954mg\") pod \"kuadrant-operator-catalog-ljmk2\" (UID: \"9a2b8396-e9c4-46db-8fd5-61bd54680ba6\") " pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:26:45.505965 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.505839 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:26:45.650601 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.650567 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ljmk2"] Jul 16 12:26:45.652480 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:26:45.652451 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2b8396_e9c4_46db_8fd5_61bd54680ba6.slice/crio-ce2da417a3205e1ebf18f541a44c78f0710769cbcaf15254de62a1a1b3ac5398 WatchSource:0}: Error finding container ce2da417a3205e1ebf18f541a44c78f0710769cbcaf15254de62a1a1b3ac5398: Status 404 returned error can't find the container with id ce2da417a3205e1ebf18f541a44c78f0710769cbcaf15254de62a1a1b3ac5398 Jul 16 12:26:45.836616 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.836579 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" event={"ID":"1c80c5f0-0667-4b46-b8fa-10a32b98f10e","Type":"ContainerStarted","Data":"c3b4c059aa1cc79d628371ab76e3daea526bd1c52bca2f62fb4276c9ad352880"} Jul 16 12:26:45.837647 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:45.837621 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" event={"ID":"9a2b8396-e9c4-46db-8fd5-61bd54680ba6","Type":"ContainerStarted","Data":"ce2da417a3205e1ebf18f541a44c78f0710769cbcaf15254de62a1a1b3ac5398"} Jul 16 12:26:47.850532 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:47.850495 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" event={"ID":"1c80c5f0-0667-4b46-b8fa-10a32b98f10e","Type":"ContainerStarted","Data":"9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d"} Jul 16 12:26:47.851044 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:47.850542 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" podUID="1c80c5f0-0667-4b46-b8fa-10a32b98f10e" containerName="registry-server" containerID="cri-o://9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d" gracePeriod=2 Jul 16 12:26:47.852257 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:47.852229 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" event={"ID":"9a2b8396-e9c4-46db-8fd5-61bd54680ba6","Type":"ContainerStarted","Data":"fe03c59ee386149ab3e81c3fa2af63670038f4a453dda042b8e4df73f1c8a53e"} Jul 16 12:26:47.867351 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:47.867293 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" podStartSLOduration=1.369805361 podStartE2EDuration="3.867271236s" totalImagesPullingTime="2.497465875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:26:47.866983247 +0000 UTC m=+402.719184091" watchObservedRunningTime="2026-07-16 12:26:47.867271236 +0000 UTC m=+402.719472047" Jul 16 12:26:47.882340 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:47.882289 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" podStartSLOduration=0.964510814 podStartE2EDuration="2.882271765s" totalImagesPullingTime="1.917760951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:26:47.881460642 +0000 UTC m=+402.733661488" watchObservedRunningTime="2026-07-16 12:26:47.882271765 +0000 UTC m=+402.734472575" Jul 16 12:26:48.102556 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.102472 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" Jul 16 12:26:48.174116 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.174074 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/1c80c5f0-0667-4b46-b8fa-10a32b98f10e-kube-api-access-8st8j\") pod \"1c80c5f0-0667-4b46-b8fa-10a32b98f10e\" (UID: \"1c80c5f0-0667-4b46-b8fa-10a32b98f10e\") " Jul 16 12:26:48.176361 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.176329 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c80c5f0-0667-4b46-b8fa-10a32b98f10e-kube-api-access-8st8j" (OuterVolumeSpecName: "kube-api-access-8st8j") pod "1c80c5f0-0667-4b46-b8fa-10a32b98f10e" (UID: "1c80c5f0-0667-4b46-b8fa-10a32b98f10e"). InnerVolumeSpecName "kube-api-access-8st8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:26:48.275343 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.275296 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/1c80c5f0-0667-4b46-b8fa-10a32b98f10e-kube-api-access-8st8j\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:26:48.857866 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.857757 2570 generic.go:356] "Generic (PLEG): container finished" podID="1c80c5f0-0667-4b46-b8fa-10a32b98f10e" containerID="9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d" exitCode=0 Jul 16 12:26:48.857866 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.857804 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" Jul 16 12:26:48.857866 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.857850 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" event={"ID":"1c80c5f0-0667-4b46-b8fa-10a32b98f10e","Type":"ContainerDied","Data":"9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d"} Jul 16 12:26:48.858485 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.857931 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2scpj" event={"ID":"1c80c5f0-0667-4b46-b8fa-10a32b98f10e","Type":"ContainerDied","Data":"c3b4c059aa1cc79d628371ab76e3daea526bd1c52bca2f62fb4276c9ad352880"} Jul 16 12:26:48.858485 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.857961 2570 scope.go:117] "RemoveContainer" containerID="9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d" Jul 16 12:26:48.867677 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.867655 2570 scope.go:117] "RemoveContainer" containerID="9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d" Jul 16 12:26:48.867988 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:26:48.867964 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d\": container with ID starting with 9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d not found: ID does not exist" containerID="9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d" Jul 16 12:26:48.868069 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.868002 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d"} err="failed to get container status \"9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d\": rpc error: code = NotFound desc = could not find container \"9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d\": container with ID starting with 9afbbade0aaf4eff4445ab7f5d1a0137e547818c32085b91bf91f7b7ed40001d not found: ID does not exist" Jul 16 12:26:48.879779 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.879743 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2scpj"] Jul 16 12:26:48.883786 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:48.883754 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2scpj"] Jul 16 12:26:49.829506 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:49.829468 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c80c5f0-0667-4b46-b8fa-10a32b98f10e" path="/var/lib/kubelet/pods/1c80c5f0-0667-4b46-b8fa-10a32b98f10e/volumes" Jul 16 12:26:55.506258 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:55.506198 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:26:55.506258 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:55.506273 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:26:55.529751 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:55.529722 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:26:55.913611 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:26:55.913576 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ljmk2" Jul 16 12:27:13.523954 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.523892 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-656594f667-p44nr"] Jul 16 12:27:13.524440 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.524346 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c80c5f0-0667-4b46-b8fa-10a32b98f10e" containerName="registry-server" Jul 16 12:27:13.524440 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.524363 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c80c5f0-0667-4b46-b8fa-10a32b98f10e" containerName="registry-server" Jul 16 12:27:13.524519 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.524457 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c80c5f0-0667-4b46-b8fa-10a32b98f10e" containerName="registry-server" Jul 16 12:27:13.529074 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.529046 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.531973 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.531950 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 12:27:13.533261 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.533225 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 12:27:13.533427 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.533408 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 12:27:13.533581 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.533554 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 12:27:13.533699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.533680 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-snwwc\"" Jul 16 12:27:13.533775 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.533746 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 12:27:13.537627 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.537600 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 12:27:13.540732 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.540712 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656594f667-p44nr"] Jul 16 12:27:13.595168 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.595134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-service-ca\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.595372 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.595177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2rh8\" (UniqueName: \"kubernetes.io/projected/2239b9ac-1706-415f-b90b-dec3cdd4dd69-kube-api-access-n2rh8\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.595372 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.595209 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-config\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.595372 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.595248 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-oauth-serving-cert\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.595372 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.595287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-serving-cert\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.595372 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.595318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-oauth-config\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.595372 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.595347 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-trusted-ca-bundle\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.696507 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.696468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-service-ca\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.696507 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.696507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2rh8\" (UniqueName: \"kubernetes.io/projected/2239b9ac-1706-415f-b90b-dec3cdd4dd69-kube-api-access-n2rh8\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.696741 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.696545 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-config\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.696741 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.696630 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-oauth-serving-cert\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.696851 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.696802 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-serving-cert\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.696944 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.696869 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-oauth-config\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.697003 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.696967 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-trusted-ca-bundle\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.697416 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.697390 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-config\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.697530 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.697390 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-service-ca\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.697530 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.697469 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-oauth-serving-cert\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.697994 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.697971 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2239b9ac-1706-415f-b90b-dec3cdd4dd69-trusted-ca-bundle\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.699403 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.699380 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-serving-cert\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.699495 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.699385 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2239b9ac-1706-415f-b90b-dec3cdd4dd69-console-oauth-config\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.705396 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.705365 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2rh8\" (UniqueName: \"kubernetes.io/projected/2239b9ac-1706-415f-b90b-dec3cdd4dd69-kube-api-access-n2rh8\") pod \"console-656594f667-p44nr\" (UID: \"2239b9ac-1706-415f-b90b-dec3cdd4dd69\") " pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.840615 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.840576 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:13.987364 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:13.987337 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656594f667-p44nr"] Jul 16 12:27:13.989694 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:27:13.989663 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2239b9ac_1706_415f_b90b_dec3cdd4dd69.slice/crio-8f4988ff3b3196c517bad8dcc969f4915d010baf8a6f8ede6ca910599fe6afb3 WatchSource:0}: Error finding container 8f4988ff3b3196c517bad8dcc969f4915d010baf8a6f8ede6ca910599fe6afb3: Status 404 returned error can't find the container with id 8f4988ff3b3196c517bad8dcc969f4915d010baf8a6f8ede6ca910599fe6afb3 Jul 16 12:27:14.981771 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:14.981729 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656594f667-p44nr" event={"ID":"2239b9ac-1706-415f-b90b-dec3cdd4dd69","Type":"ContainerStarted","Data":"a6b5785143d579ff5876c098a33d88a7174e4f449df1d0a86239cf58c4d5e1f2"} Jul 16 12:27:14.982231 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:14.981799 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656594f667-p44nr" event={"ID":"2239b9ac-1706-415f-b90b-dec3cdd4dd69","Type":"ContainerStarted","Data":"8f4988ff3b3196c517bad8dcc969f4915d010baf8a6f8ede6ca910599fe6afb3"} Jul 16 12:27:15.005509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:15.005456 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-656594f667-p44nr" podStartSLOduration=2.005439678 podStartE2EDuration="2.005439678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:15.003902104 +0000 UTC m=+429.856102922" watchObservedRunningTime="2026-07-16 12:27:15.005439678 +0000 UTC m=+429.857640488" Jul 16 12:27:17.646161 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.646119 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt"] Jul 16 12:27:17.650794 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.650770 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:17.653381 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.653353 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5grhs\"" Jul 16 12:27:17.662498 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.662440 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt"] Jul 16 12:27:17.732867 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.732820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwjr\" (UniqueName: \"kubernetes.io/projected/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-kube-api-access-mdwjr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-glwqt\" (UID: \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:17.733084 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.732982 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-glwqt\" (UID: \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:17.834244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.834198 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwjr\" (UniqueName: \"kubernetes.io/projected/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-kube-api-access-mdwjr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-glwqt\" (UID: \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:17.834450 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.834310 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-glwqt\" (UID: \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:17.834729 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.834704 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-glwqt\" (UID: \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:17.843264 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.843233 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwjr\" (UniqueName: \"kubernetes.io/projected/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-kube-api-access-mdwjr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-glwqt\" (UID: \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:17.962703 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:17.962604 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:18.103785 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:18.103756 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt"] Jul 16 12:27:18.106577 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:27:18.106536 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12a0faf_1ee9_46d6_902a_4d51327b6b0e.slice/crio-223211c66eb0ff073c6e4f8d6b21799dd8fd2be6c3cee0b836c537289c84afc1 WatchSource:0}: Error finding container 223211c66eb0ff073c6e4f8d6b21799dd8fd2be6c3cee0b836c537289c84afc1: Status 404 returned error can't find the container with id 223211c66eb0ff073c6e4f8d6b21799dd8fd2be6c3cee0b836c537289c84afc1 Jul 16 12:27:19.003307 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:19.003267 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" event={"ID":"e12a0faf-1ee9-46d6-902a-4d51327b6b0e","Type":"ContainerStarted","Data":"223211c66eb0ff073c6e4f8d6b21799dd8fd2be6c3cee0b836c537289c84afc1"} Jul 16 12:27:20.199130 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.199091 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m"] Jul 16 12:27:20.202826 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.202799 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" Jul 16 12:27:20.206377 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.206340 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rllzj\"" Jul 16 12:27:20.220591 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.215190 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m"] Jul 16 12:27:20.358797 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.358744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d7zc\" (UniqueName: \"kubernetes.io/projected/0c2f49f9-7c56-4ff6-913e-b0503bef685d-kube-api-access-9d7zc\") pod \"authorino-operator-75cc8d5cb7-qfs4m\" (UID: \"0c2f49f9-7c56-4ff6-913e-b0503bef685d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" Jul 16 12:27:20.459973 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.459825 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d7zc\" (UniqueName: \"kubernetes.io/projected/0c2f49f9-7c56-4ff6-913e-b0503bef685d-kube-api-access-9d7zc\") pod \"authorino-operator-75cc8d5cb7-qfs4m\" (UID: \"0c2f49f9-7c56-4ff6-913e-b0503bef685d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" Jul 16 12:27:20.474548 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.474509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d7zc\" (UniqueName: \"kubernetes.io/projected/0c2f49f9-7c56-4ff6-913e-b0503bef685d-kube-api-access-9d7zc\") pod \"authorino-operator-75cc8d5cb7-qfs4m\" (UID: \"0c2f49f9-7c56-4ff6-913e-b0503bef685d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" Jul 16 12:27:20.522222 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.522181 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" Jul 16 12:27:20.690352 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:20.689254 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m"] Jul 16 12:27:20.692536 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:27:20.692502 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2f49f9_7c56_4ff6_913e_b0503bef685d.slice/crio-a7edbc2767cd334764c91fdad6c28335d196964f9aee35aa8df1b86073188902 WatchSource:0}: Error finding container a7edbc2767cd334764c91fdad6c28335d196964f9aee35aa8df1b86073188902: Status 404 returned error can't find the container with id a7edbc2767cd334764c91fdad6c28335d196964f9aee35aa8df1b86073188902 Jul 16 12:27:21.014536 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:21.014490 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" event={"ID":"0c2f49f9-7c56-4ff6-913e-b0503bef685d","Type":"ContainerStarted","Data":"a7edbc2767cd334764c91fdad6c28335d196964f9aee35aa8df1b86073188902"} Jul 16 12:27:22.339747 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:22.339713 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6"] Jul 16 12:27:22.343453 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:22.343428 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:22.345960 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:22.345930 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9psf8\"" Jul 16 12:27:22.355493 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:22.355464 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6"] Jul 16 12:27:22.479207 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:22.479163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfq4h\" (UniqueName: \"kubernetes.io/projected/e3277d53-5ace-4838-9798-c25012e7aaa3-kube-api-access-qfq4h\") pod \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" (UID: \"e3277d53-5ace-4838-9798-c25012e7aaa3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:22.580517 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:22.580472 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfq4h\" (UniqueName: \"kubernetes.io/projected/e3277d53-5ace-4838-9798-c25012e7aaa3-kube-api-access-qfq4h\") pod \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" (UID: \"e3277d53-5ace-4838-9798-c25012e7aaa3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:22.590835 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:22.590764 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfq4h\" (UniqueName: \"kubernetes.io/projected/e3277d53-5ace-4838-9798-c25012e7aaa3-kube-api-access-qfq4h\") pod \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" (UID: \"e3277d53-5ace-4838-9798-c25012e7aaa3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:22.659319 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:22.659279 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:23.841137 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:23.841100 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:23.841632 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:23.841196 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:23.847005 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:23.846975 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:24.039093 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:24.039057 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-656594f667-p44nr" Jul 16 12:27:24.511108 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:24.511083 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6"] Jul 16 12:27:24.514010 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:27:24.513977 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3277d53_5ace_4838_9798_c25012e7aaa3.slice/crio-a2fe4cbc66ea6a258f3cf9bd1c5283d664047a676b9336911b4f7025b32fe535 WatchSource:0}: Error finding container a2fe4cbc66ea6a258f3cf9bd1c5283d664047a676b9336911b4f7025b32fe535: Status 404 returned error can't find the container with id a2fe4cbc66ea6a258f3cf9bd1c5283d664047a676b9336911b4f7025b32fe535 Jul 16 12:27:25.044035 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:25.043997 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" event={"ID":"e3277d53-5ace-4838-9798-c25012e7aaa3","Type":"ContainerStarted","Data":"a2fe4cbc66ea6a258f3cf9bd1c5283d664047a676b9336911b4f7025b32fe535"} Jul 16 12:27:25.045670 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:25.045644 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" event={"ID":"0c2f49f9-7c56-4ff6-913e-b0503bef685d","Type":"ContainerStarted","Data":"bf9c324f04e36283a3ce4c05b9099ff58079e1069e9125ae90e6a566440e4858"} Jul 16 12:27:25.045814 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:25.045740 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" Jul 16 12:27:25.047423 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:25.047399 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" event={"ID":"e12a0faf-1ee9-46d6-902a-4d51327b6b0e","Type":"ContainerStarted","Data":"0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2"} Jul 16 12:27:25.047498 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:25.047489 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:25.067473 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:25.067424 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" podStartSLOduration=1.356555454 podStartE2EDuration="5.067408257s" totalImagesPullingTime="3.710852803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:25.066085827 +0000 UTC m=+439.918286638" watchObservedRunningTime="2026-07-16 12:27:25.067408257 +0000 UTC m=+439.919609068" Jul 16 12:27:25.092867 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:25.092802 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" podStartSLOduration=1.8382306000000002 podStartE2EDuration="8.092782838s" totalImagesPullingTime="6.254552238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:25.090586946 +0000 UTC m=+439.942787775" watchObservedRunningTime="2026-07-16 12:27:25.092782838 +0000 UTC m=+439.944983649" Jul 16 12:27:27.060018 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:27.059981 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" event={"ID":"e3277d53-5ace-4838-9798-c25012e7aaa3","Type":"ContainerStarted","Data":"18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42"} Jul 16 12:27:27.060449 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:27.060131 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:27.079176 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:27.079121 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" podStartSLOduration=3.311823489 podStartE2EDuration="5.079100356s" totalImagesPullingTime="1.767276867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:27.077729025 +0000 UTC m=+441.929929852" watchObservedRunningTime="2026-07-16 12:27:27.079100356 +0000 UTC m=+441.931301166" Jul 16 12:27:36.054777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:36.054744 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qfs4m" Jul 16 12:27:36.055314 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:36.054821 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:37.805150 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.805114 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt"] Jul 16 12:27:37.805701 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.805338 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" podUID="e12a0faf-1ee9-46d6-902a-4d51327b6b0e" containerName="manager" containerID="cri-o://0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2" gracePeriod=2 Jul 16 12:27:37.811963 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.811933 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt"] Jul 16 12:27:37.814222 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:37.814172 2570 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-glwqt\": pods \"kuadrant-operator-controller-manager-8684c9ff49-glwqt\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:37.826743 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.826712 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6"] Jul 16 12:27:37.827315 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.827283 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" containerName="manager" containerID="cri-o://18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42" gracePeriod=2 Jul 16 12:27:37.829443 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:37.829397 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:37.829555 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.829481 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6"] Jul 16 12:27:37.833329 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.833058 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl"] Jul 16 12:27:37.833610 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.833587 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" containerName="manager" Jul 16 12:27:37.833610 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.833613 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" containerName="manager" Jul 16 12:27:37.833755 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.833632 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e12a0faf-1ee9-46d6-902a-4d51327b6b0e" containerName="manager" Jul 16 12:27:37.833755 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.833642 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e12a0faf-1ee9-46d6-902a-4d51327b6b0e" containerName="manager" Jul 16 12:27:37.834101 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.833768 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e12a0faf-1ee9-46d6-902a-4d51327b6b0e" containerName="manager" Jul 16 12:27:37.834101 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.833787 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" containerName="manager" Jul 16 12:27:37.842705 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.842678 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:37.845385 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.845339 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf"] Jul 16 12:27:37.845971 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:37.845935 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:37.850768 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.850742 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl"] Jul 16 12:27:37.850923 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.850856 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" Jul 16 12:27:37.862002 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.861973 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf"] Jul 16 12:27:37.872139 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:37.872098 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:37.918540 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.918504 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g7zx\" (UniqueName: \"kubernetes.io/projected/02fbb8df-a4b3-4d01-a52b-20283b574bb1-kube-api-access-2g7zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q94kl\" (UID: \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:37.918739 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.918593 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c7s7\" (UniqueName: \"kubernetes.io/projected/b38bba01-87d4-4c6c-8d3d-3ae93770e703-kube-api-access-8c7s7\") pod \"limitador-operator-controller-manager-859d7b78bd-pftcf\" (UID: \"b38bba01-87d4-4c6c-8d3d-3ae93770e703\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" Jul 16 12:27:37.918739 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:37.918696 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02fbb8df-a4b3-4d01-a52b-20283b574bb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q94kl\" (UID: \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:38.019402 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.019366 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c7s7\" (UniqueName: \"kubernetes.io/projected/b38bba01-87d4-4c6c-8d3d-3ae93770e703-kube-api-access-8c7s7\") pod \"limitador-operator-controller-manager-859d7b78bd-pftcf\" (UID: \"b38bba01-87d4-4c6c-8d3d-3ae93770e703\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" Jul 16 12:27:38.019575 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.019424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02fbb8df-a4b3-4d01-a52b-20283b574bb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q94kl\" (UID: \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:38.019575 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.019500 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7zx\" (UniqueName: \"kubernetes.io/projected/02fbb8df-a4b3-4d01-a52b-20283b574bb1-kube-api-access-2g7zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q94kl\" (UID: \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:38.019938 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.019857 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02fbb8df-a4b3-4d01-a52b-20283b574bb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q94kl\" (UID: \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:38.028678 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.028636 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c7s7\" (UniqueName: \"kubernetes.io/projected/b38bba01-87d4-4c6c-8d3d-3ae93770e703-kube-api-access-8c7s7\") pod \"limitador-operator-controller-manager-859d7b78bd-pftcf\" (UID: \"b38bba01-87d4-4c6c-8d3d-3ae93770e703\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" Jul 16 12:27:38.028950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.028925 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7zx\" (UniqueName: \"kubernetes.io/projected/02fbb8df-a4b3-4d01-a52b-20283b574bb1-kube-api-access-2g7zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q94kl\" (UID: \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:38.092310 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.092280 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:38.094538 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.094514 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.094713 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.094687 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.096783 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.096755 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.116785 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.116749 2570 generic.go:356] "Generic (PLEG): container finished" podID="e12a0faf-1ee9-46d6-902a-4d51327b6b0e" containerID="0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2" exitCode=0 Jul 16 12:27:38.116986 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.116795 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-glwqt" Jul 16 12:27:38.116986 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.116844 2570 scope.go:117] "RemoveContainer" containerID="0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2" Jul 16 12:27:38.118187 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.118166 2570 generic.go:356] "Generic (PLEG): container finished" podID="e3277d53-5ace-4838-9798-c25012e7aaa3" containerID="18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42" exitCode=0 Jul 16 12:27:38.118276 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.118211 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.119401 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.119377 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.120575 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.120560 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdwjr\" (UniqueName: \"kubernetes.io/projected/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-kube-api-access-mdwjr\") pod \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\" (UID: \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\") " Jul 16 12:27:38.120731 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.120719 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfq4h\" (UniqueName: \"kubernetes.io/projected/e3277d53-5ace-4838-9798-c25012e7aaa3-kube-api-access-qfq4h\") pod \"e3277d53-5ace-4838-9798-c25012e7aaa3\" (UID: \"e3277d53-5ace-4838-9798-c25012e7aaa3\") " Jul 16 12:27:38.120770 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.120746 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-extensions-socket-volume\") pod \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\" (UID: \"e12a0faf-1ee9-46d6-902a-4d51327b6b0e\") " Jul 16 12:27:38.121360 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.121337 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e12a0faf-1ee9-46d6-902a-4d51327b6b0e" (UID: "e12a0faf-1ee9-46d6-902a-4d51327b6b0e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:27:38.121613 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.121575 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.122937 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.122904 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-kube-api-access-mdwjr" (OuterVolumeSpecName: "kube-api-access-mdwjr") pod "e12a0faf-1ee9-46d6-902a-4d51327b6b0e" (UID: "e12a0faf-1ee9-46d6-902a-4d51327b6b0e"). InnerVolumeSpecName "kube-api-access-mdwjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:27:38.122937 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.122913 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3277d53-5ace-4838-9798-c25012e7aaa3-kube-api-access-qfq4h" (OuterVolumeSpecName: "kube-api-access-qfq4h") pod "e3277d53-5ace-4838-9798-c25012e7aaa3" (UID: "e3277d53-5ace-4838-9798-c25012e7aaa3"). InnerVolumeSpecName "kube-api-access-qfq4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:27:38.126679 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.126661 2570 scope.go:117] "RemoveContainer" containerID="0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2" Jul 16 12:27:38.127033 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.127014 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2\": container with ID starting with 0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2 not found: ID does not exist" containerID="0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2" Jul 16 12:27:38.127092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.127043 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2"} err="failed to get container status \"0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2\": rpc error: code = NotFound desc = could not find container \"0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2\": container with ID starting with 0e842ef9155c67458d67c2da9a335497265012075c26d0365e928877442d6de2 not found: ID does not exist" Jul 16 12:27:38.127092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.127062 2570 scope.go:117] "RemoveContainer" containerID="18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42" Jul 16 12:27:38.136100 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.136080 2570 scope.go:117] "RemoveContainer" containerID="18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42" Jul 16 12:27:38.136423 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.136403 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42\": container with ID starting with 18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42 not found: ID does not exist" containerID="18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42" Jul 16 12:27:38.136474 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.136433 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42"} err="failed to get container status \"18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42\": rpc error: code = NotFound desc = could not find container \"18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42\": container with ID starting with 18242e37b0dd08bce141d7c83deadc628c1fcd1671fbaf17cf1a2e76fbac1d42 not found: ID does not exist" Jul 16 12:27:38.222045 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.221999 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfq4h\" (UniqueName: \"kubernetes.io/projected/e3277d53-5ace-4838-9798-c25012e7aaa3-kube-api-access-qfq4h\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:27:38.222045 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.222038 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-extensions-socket-volume\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:27:38.222045 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.222047 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdwjr\" (UniqueName: \"kubernetes.io/projected/e12a0faf-1ee9-46d6-902a-4d51327b6b0e-kube-api-access-mdwjr\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:27:38.237459 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.237421 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:38.244844 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.244814 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" Jul 16 12:27:38.397954 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.397919 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl"] Jul 16 12:27:38.399177 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:27:38.399146 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02fbb8df_a4b3_4d01_a52b_20283b574bb1.slice/crio-0f573f3b95cddbfce566f4f719ab87576ee7a4865fd0f41c3d796e0c48922936 WatchSource:0}: Error finding container 0f573f3b95cddbfce566f4f719ab87576ee7a4865fd0f41c3d796e0c48922936: Status 404 returned error can't find the container with id 0f573f3b95cddbfce566f4f719ab87576ee7a4865fd0f41c3d796e0c48922936 Jul 16 12:27:38.412003 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.411972 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf"] Jul 16 12:27:38.414925 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:27:38.414858 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38bba01_87d4_4c6c_8d3d_3ae93770e703.slice/crio-eb171bb507d1703fa729cb85b1e2f475bbbe1c3ded2c11ec062a96b899e845cf WatchSource:0}: Error finding container eb171bb507d1703fa729cb85b1e2f475bbbe1c3ded2c11ec062a96b899e845cf: Status 404 returned error can't find the container with id eb171bb507d1703fa729cb85b1e2f475bbbe1c3ded2c11ec062a96b899e845cf Jul 16 12:27:38.446279 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.446240 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.448496 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.448464 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.838867 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.838829 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g"] Jul 16 12:27:38.844299 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.844263 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:38.846949 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:38.846907 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:38.855093 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.855058 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g"] Jul 16 12:27:38.928054 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.928011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671aaa5c-c78f-4398-a226-4d7dbcc65da4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bwf8g\" (UID: \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:38.928054 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:38.928063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rz94\" (UniqueName: \"kubernetes.io/projected/671aaa5c-c78f-4398-a226-4d7dbcc65da4-kube-api-access-8rz94\") pod \"kuadrant-operator-controller-manager-86878c769f-bwf8g\" (UID: \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:39.028563 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.028523 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671aaa5c-c78f-4398-a226-4d7dbcc65da4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bwf8g\" (UID: \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:39.028727 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.028577 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rz94\" (UniqueName: \"kubernetes.io/projected/671aaa5c-c78f-4398-a226-4d7dbcc65da4-kube-api-access-8rz94\") pod \"kuadrant-operator-controller-manager-86878c769f-bwf8g\" (UID: \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:39.029031 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.029009 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671aaa5c-c78f-4398-a226-4d7dbcc65da4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bwf8g\" (UID: \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:39.039273 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.039240 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rz94\" (UniqueName: \"kubernetes.io/projected/671aaa5c-c78f-4398-a226-4d7dbcc65da4-kube-api-access-8rz94\") pod \"kuadrant-operator-controller-manager-86878c769f-bwf8g\" (UID: \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:39.125700 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.125589 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" event={"ID":"b38bba01-87d4-4c6c-8d3d-3ae93770e703","Type":"ContainerStarted","Data":"13777bf3d6947130525c07c84c0a4f0b09597c81f24713504599906979d42524"} Jul 16 12:27:39.125700 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.125650 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" event={"ID":"b38bba01-87d4-4c6c-8d3d-3ae93770e703","Type":"ContainerStarted","Data":"eb171bb507d1703fa729cb85b1e2f475bbbe1c3ded2c11ec062a96b899e845cf"} Jul 16 12:27:39.125959 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.125777 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" Jul 16 12:27:39.128324 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.128287 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" event={"ID":"02fbb8df-a4b3-4d01-a52b-20283b574bb1","Type":"ContainerStarted","Data":"eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910"} Jul 16 12:27:39.128472 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.128347 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" event={"ID":"02fbb8df-a4b3-4d01-a52b-20283b574bb1","Type":"ContainerStarted","Data":"0f573f3b95cddbfce566f4f719ab87576ee7a4865fd0f41c3d796e0c48922936"} Jul 16 12:27:39.128472 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.128378 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:39.144146 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.144078 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" podStartSLOduration=2.144060305 podStartE2EDuration="2.144060305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:39.142437376 +0000 UTC m=+453.994638206" watchObservedRunningTime="2026-07-16 12:27:39.144060305 +0000 UTC m=+453.996261117" Jul 16 12:27:39.144579 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:39.144552 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:39.155350 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.155316 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:39.166198 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.166134 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" podStartSLOduration=2.166114955 podStartE2EDuration="2.166114955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:39.165849823 +0000 UTC m=+454.018050636" watchObservedRunningTime="2026-07-16 12:27:39.166114955 +0000 UTC m=+454.018315763" Jul 16 12:27:39.168048 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:39.168018 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rjxk6\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rjxk6" Jul 16 12:27:39.310169 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.310142 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g"] Jul 16 12:27:39.312706 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:27:39.312677 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671aaa5c_c78f_4398_a226_4d7dbcc65da4.slice/crio-61a490e765e63b3271e3688ea62bbd6a3dcb03e67719556df9eed80e38a089c8 WatchSource:0}: Error finding container 61a490e765e63b3271e3688ea62bbd6a3dcb03e67719556df9eed80e38a089c8: Status 404 returned error can't find the container with id 61a490e765e63b3271e3688ea62bbd6a3dcb03e67719556df9eed80e38a089c8 Jul 16 12:27:39.829146 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.829103 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e12a0faf-1ee9-46d6-902a-4d51327b6b0e" path="/var/lib/kubelet/pods/e12a0faf-1ee9-46d6-902a-4d51327b6b0e/volumes" Jul 16 12:27:39.829542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:39.829521 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3277d53-5ace-4838-9798-c25012e7aaa3" path="/var/lib/kubelet/pods/e3277d53-5ace-4838-9798-c25012e7aaa3/volumes" Jul 16 12:27:40.135844 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:40.135737 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" event={"ID":"671aaa5c-c78f-4398-a226-4d7dbcc65da4","Type":"ContainerStarted","Data":"81e8cb4934093fcd8f24b8e517d922f4e4dd74e8793d072eca5cd3d817775a9f"} Jul 16 12:27:40.136239 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:40.136112 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:40.136239 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:40.136161 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" event={"ID":"671aaa5c-c78f-4398-a226-4d7dbcc65da4","Type":"ContainerStarted","Data":"61a490e765e63b3271e3688ea62bbd6a3dcb03e67719556df9eed80e38a089c8"} Jul 16 12:27:40.160379 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:40.160323 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" podStartSLOduration=2.160304898 podStartE2EDuration="2.160304898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:40.159154159 +0000 UTC m=+455.011354972" watchObservedRunningTime="2026-07-16 12:27:40.160304898 +0000 UTC m=+455.012505710" Jul 16 12:27:50.137849 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:50.137812 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pftcf" Jul 16 12:27:50.138304 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:50.137918 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:51.143947 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.143907 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:27:51.195635 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.195598 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl"] Jul 16 12:27:51.195887 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.195825 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" podUID="02fbb8df-a4b3-4d01-a52b-20283b574bb1" containerName="manager" containerID="cri-o://eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910" gracePeriod=10 Jul 16 12:27:51.453656 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.453628 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:51.541073 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.541037 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g7zx\" (UniqueName: \"kubernetes.io/projected/02fbb8df-a4b3-4d01-a52b-20283b574bb1-kube-api-access-2g7zx\") pod \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\" (UID: \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\") " Jul 16 12:27:51.541242 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.541088 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02fbb8df-a4b3-4d01-a52b-20283b574bb1-extensions-socket-volume\") pod \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\" (UID: \"02fbb8df-a4b3-4d01-a52b-20283b574bb1\") " Jul 16 12:27:51.541503 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.541480 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02fbb8df-a4b3-4d01-a52b-20283b574bb1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "02fbb8df-a4b3-4d01-a52b-20283b574bb1" (UID: "02fbb8df-a4b3-4d01-a52b-20283b574bb1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:27:51.543415 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.543386 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02fbb8df-a4b3-4d01-a52b-20283b574bb1-kube-api-access-2g7zx" (OuterVolumeSpecName: "kube-api-access-2g7zx") pod "02fbb8df-a4b3-4d01-a52b-20283b574bb1" (UID: "02fbb8df-a4b3-4d01-a52b-20283b574bb1"). InnerVolumeSpecName "kube-api-access-2g7zx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:27:51.642723 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.642671 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02fbb8df-a4b3-4d01-a52b-20283b574bb1-extensions-socket-volume\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:27:51.642723 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:51.642709 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g7zx\" (UniqueName: \"kubernetes.io/projected/02fbb8df-a4b3-4d01-a52b-20283b574bb1-kube-api-access-2g7zx\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:27:52.200639 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.200539 2570 generic.go:356] "Generic (PLEG): container finished" podID="02fbb8df-a4b3-4d01-a52b-20283b574bb1" containerID="eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910" exitCode=0 Jul 16 12:27:52.200639 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.200581 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" Jul 16 12:27:52.200639 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.200629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" event={"ID":"02fbb8df-a4b3-4d01-a52b-20283b574bb1","Type":"ContainerDied","Data":"eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910"} Jul 16 12:27:52.201172 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.200683 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl" event={"ID":"02fbb8df-a4b3-4d01-a52b-20283b574bb1","Type":"ContainerDied","Data":"0f573f3b95cddbfce566f4f719ab87576ee7a4865fd0f41c3d796e0c48922936"} Jul 16 12:27:52.201172 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.200705 2570 scope.go:117] "RemoveContainer" containerID="eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910" Jul 16 12:27:52.209577 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.209558 2570 scope.go:117] "RemoveContainer" containerID="eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910" Jul 16 12:27:52.209907 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:27:52.209869 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910\": container with ID starting with eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910 not found: ID does not exist" containerID="eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910" Jul 16 12:27:52.209982 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.209918 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910"} err="failed to get container status \"eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910\": rpc error: code = NotFound desc = could not find container \"eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910\": container with ID starting with eb15a5f2944cc0f6481583fc921d58b9daa4f334ffd582f30470bc402d2bf910 not found: ID does not exist" Jul 16 12:27:52.224672 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.224634 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl"] Jul 16 12:27:52.228156 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:52.228123 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q94kl"] Jul 16 12:27:53.824681 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:27:53.824644 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02fbb8df-a4b3-4d01-a52b-20283b574bb1" path="/var/lib/kubelet/pods/02fbb8df-a4b3-4d01-a52b-20283b574bb1/volumes" Jul 16 12:28:09.597273 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.597230 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzq25"] Jul 16 12:28:09.597928 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.597807 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02fbb8df-a4b3-4d01-a52b-20283b574bb1" containerName="manager" Jul 16 12:28:09.597928 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.597830 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="02fbb8df-a4b3-4d01-a52b-20283b574bb1" containerName="manager" Jul 16 12:28:09.598097 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.597959 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="02fbb8df-a4b3-4d01-a52b-20283b574bb1" containerName="manager" Jul 16 12:28:09.602624 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.602596 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:09.605493 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.605467 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 16 12:28:09.605493 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.605470 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jrqsj\"" Jul 16 12:28:09.609910 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.609863 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzq25"] Jul 16 12:28:09.691074 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.691033 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzq25"] Jul 16 12:28:09.707236 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.707201 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-config-file\") pod \"limitador-limitador-64c94fd64f-zzq25\" (UID: \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:09.707425 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.707337 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5brpg\" (UniqueName: \"kubernetes.io/projected/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-kube-api-access-5brpg\") pod \"limitador-limitador-64c94fd64f-zzq25\" (UID: \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:09.808715 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.808670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5brpg\" (UniqueName: \"kubernetes.io/projected/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-kube-api-access-5brpg\") pod \"limitador-limitador-64c94fd64f-zzq25\" (UID: \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:09.808940 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.808726 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-config-file\") pod \"limitador-limitador-64c94fd64f-zzq25\" (UID: \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:09.809559 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.809532 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-config-file\") pod \"limitador-limitador-64c94fd64f-zzq25\" (UID: \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:09.817479 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.817454 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5brpg\" (UniqueName: \"kubernetes.io/projected/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-kube-api-access-5brpg\") pod \"limitador-limitador-64c94fd64f-zzq25\" (UID: \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:09.915142 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:09.915056 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:10.059292 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.059214 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzq25"] Jul 16 12:28:10.061690 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:28:10.061658 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0da2ddd_e375_4c7b_9413_9d124bff2bf2.slice/crio-7a7db6685c10e388273ceb217f9b2dc54da92cde721291d2410066a1d7a2cdd8 WatchSource:0}: Error finding container 7a7db6685c10e388273ceb217f9b2dc54da92cde721291d2410066a1d7a2cdd8: Status 404 returned error can't find the container with id 7a7db6685c10e388273ceb217f9b2dc54da92cde721291d2410066a1d7a2cdd8 Jul 16 12:28:10.297229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.297126 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" event={"ID":"d0da2ddd-e375-4c7b-9413-9d124bff2bf2","Type":"ContainerStarted","Data":"7a7db6685c10e388273ceb217f9b2dc54da92cde721291d2410066a1d7a2cdd8"} Jul 16 12:28:10.417200 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.417164 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lmz9p"] Jul 16 12:28:10.422366 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.422337 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lmz9p" Jul 16 12:28:10.425380 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.425355 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b5p6x\"" Jul 16 12:28:10.431200 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.431167 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmz9p"] Jul 16 12:28:10.515962 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.515907 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm9d5\" (UniqueName: \"kubernetes.io/projected/fe152c0a-2800-456e-a90b-d4966f3ff858-kube-api-access-mm9d5\") pod \"authorino-58cd955675-lmz9p\" (UID: \"fe152c0a-2800-456e-a90b-d4966f3ff858\") " pod="kuadrant-system/authorino-58cd955675-lmz9p" Jul 16 12:28:10.616832 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.616787 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm9d5\" (UniqueName: \"kubernetes.io/projected/fe152c0a-2800-456e-a90b-d4966f3ff858-kube-api-access-mm9d5\") pod \"authorino-58cd955675-lmz9p\" (UID: \"fe152c0a-2800-456e-a90b-d4966f3ff858\") " pod="kuadrant-system/authorino-58cd955675-lmz9p" Jul 16 12:28:10.628143 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.628110 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm9d5\" (UniqueName: \"kubernetes.io/projected/fe152c0a-2800-456e-a90b-d4966f3ff858-kube-api-access-mm9d5\") pod \"authorino-58cd955675-lmz9p\" (UID: \"fe152c0a-2800-456e-a90b-d4966f3ff858\") " pod="kuadrant-system/authorino-58cd955675-lmz9p" Jul 16 12:28:10.733750 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.733703 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lmz9p" Jul 16 12:28:10.872420 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:10.872393 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmz9p"] Jul 16 12:28:10.875121 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:28:10.875093 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe152c0a_2800_456e_a90b_d4966f3ff858.slice/crio-c7910afd95f3ae25795dffc228c838367245ee40cbb995fa2a15b35ddc2b9b51 WatchSource:0}: Error finding container c7910afd95f3ae25795dffc228c838367245ee40cbb995fa2a15b35ddc2b9b51: Status 404 returned error can't find the container with id c7910afd95f3ae25795dffc228c838367245ee40cbb995fa2a15b35ddc2b9b51 Jul 16 12:28:11.303066 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:11.302973 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lmz9p" event={"ID":"fe152c0a-2800-456e-a90b-d4966f3ff858","Type":"ContainerStarted","Data":"c7910afd95f3ae25795dffc228c838367245ee40cbb995fa2a15b35ddc2b9b51"} Jul 16 12:28:16.520730 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:16.520690 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmz9p"] Jul 16 12:28:17.338286 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:17.338249 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" event={"ID":"d0da2ddd-e375-4c7b-9413-9d124bff2bf2","Type":"ContainerStarted","Data":"120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0"} Jul 16 12:28:17.338466 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:17.338355 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:17.339695 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:17.339667 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lmz9p" event={"ID":"fe152c0a-2800-456e-a90b-d4966f3ff858","Type":"ContainerStarted","Data":"d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890"} Jul 16 12:28:17.370798 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:17.370742 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" podStartSLOduration=2.072113077 podStartE2EDuration="8.37072174s" totalImagesPullingTime="6.298608663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:28:17.354712504 +0000 UTC m=+492.206913334" watchObservedRunningTime="2026-07-16 12:28:17.37072174 +0000 UTC m=+492.222922562" Jul 16 12:28:18.344417 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:18.344375 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lmz9p" podUID="fe152c0a-2800-456e-a90b-d4966f3ff858" containerName="authorino" containerID="cri-o://d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890" gracePeriod=30 Jul 16 12:28:18.363375 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:18.363322 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lmz9p" podStartSLOduration=2.934812036 podStartE2EDuration="8.363304088s" totalImagesPullingTime="5.428492052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:28:17.369332771 +0000 UTC m=+492.221533582" watchObservedRunningTime="2026-07-16 12:28:18.363304088 +0000 UTC m=+493.215504899" Jul 16 12:28:18.610646 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:18.610566 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lmz9p" Jul 16 12:28:18.692944 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:18.692908 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm9d5\" (UniqueName: \"kubernetes.io/projected/fe152c0a-2800-456e-a90b-d4966f3ff858-kube-api-access-mm9d5\") pod \"fe152c0a-2800-456e-a90b-d4966f3ff858\" (UID: \"fe152c0a-2800-456e-a90b-d4966f3ff858\") " Jul 16 12:28:18.695042 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:18.695010 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe152c0a-2800-456e-a90b-d4966f3ff858-kube-api-access-mm9d5" (OuterVolumeSpecName: "kube-api-access-mm9d5") pod "fe152c0a-2800-456e-a90b-d4966f3ff858" (UID: "fe152c0a-2800-456e-a90b-d4966f3ff858"). InnerVolumeSpecName "kube-api-access-mm9d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:28:18.793644 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:18.793602 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm9d5\" (UniqueName: \"kubernetes.io/projected/fe152c0a-2800-456e-a90b-d4966f3ff858-kube-api-access-mm9d5\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:28:19.350846 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.350807 2570 generic.go:356] "Generic (PLEG): container finished" podID="fe152c0a-2800-456e-a90b-d4966f3ff858" containerID="d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890" exitCode=0 Jul 16 12:28:19.351308 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.350852 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lmz9p" Jul 16 12:28:19.351308 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.350917 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lmz9p" event={"ID":"fe152c0a-2800-456e-a90b-d4966f3ff858","Type":"ContainerDied","Data":"d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890"} Jul 16 12:28:19.351308 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.350961 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lmz9p" event={"ID":"fe152c0a-2800-456e-a90b-d4966f3ff858","Type":"ContainerDied","Data":"c7910afd95f3ae25795dffc228c838367245ee40cbb995fa2a15b35ddc2b9b51"} Jul 16 12:28:19.351308 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.350985 2570 scope.go:117] "RemoveContainer" containerID="d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890" Jul 16 12:28:19.360137 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.360116 2570 scope.go:117] "RemoveContainer" containerID="d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890" Jul 16 12:28:19.360426 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:28:19.360404 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890\": container with ID starting with d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890 not found: ID does not exist" containerID="d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890" Jul 16 12:28:19.360496 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.360433 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890"} err="failed to get container status \"d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890\": rpc error: code = NotFound desc = could not find container \"d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890\": container with ID starting with d3b46c42055bd1d6725da54c89163eafa457edeeb3c6afd9b3b73fa7bcdb8890 not found: ID does not exist" Jul 16 12:28:19.373641 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.373609 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmz9p"] Jul 16 12:28:19.375428 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.375405 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lmz9p"] Jul 16 12:28:19.824301 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:19.824271 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe152c0a-2800-456e-a90b-d4966f3ff858" path="/var/lib/kubelet/pods/fe152c0a-2800-456e-a90b-d4966f3ff858/volumes" Jul 16 12:28:27.508185 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:27.508140 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzq25"] Jul 16 12:28:27.508726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:27.508422 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" podUID="d0da2ddd-e375-4c7b-9413-9d124bff2bf2" containerName="limitador" containerID="cri-o://120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0" gracePeriod=30 Jul 16 12:28:27.510603 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:27.510577 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:28.068617 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.068595 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:28.160346 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.160305 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-config-file\") pod \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\" (UID: \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\") " Jul 16 12:28:28.160346 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.160360 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5brpg\" (UniqueName: \"kubernetes.io/projected/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-kube-api-access-5brpg\") pod \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\" (UID: \"d0da2ddd-e375-4c7b-9413-9d124bff2bf2\") " Jul 16 12:28:28.160733 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.160709 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-config-file" (OuterVolumeSpecName: "config-file") pod "d0da2ddd-e375-4c7b-9413-9d124bff2bf2" (UID: "d0da2ddd-e375-4c7b-9413-9d124bff2bf2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:28:28.162498 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.162479 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-kube-api-access-5brpg" (OuterVolumeSpecName: "kube-api-access-5brpg") pod "d0da2ddd-e375-4c7b-9413-9d124bff2bf2" (UID: "d0da2ddd-e375-4c7b-9413-9d124bff2bf2"). InnerVolumeSpecName "kube-api-access-5brpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:28:28.261036 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.260994 2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-config-file\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:28:28.261036 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.261027 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5brpg\" (UniqueName: \"kubernetes.io/projected/d0da2ddd-e375-4c7b-9413-9d124bff2bf2-kube-api-access-5brpg\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:28:28.397412 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.397308 2570 generic.go:356] "Generic (PLEG): container finished" podID="d0da2ddd-e375-4c7b-9413-9d124bff2bf2" containerID="120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0" exitCode=0 Jul 16 12:28:28.397412 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.397370 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" Jul 16 12:28:28.397412 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.397376 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" event={"ID":"d0da2ddd-e375-4c7b-9413-9d124bff2bf2","Type":"ContainerDied","Data":"120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0"} Jul 16 12:28:28.397700 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.397464 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzq25" event={"ID":"d0da2ddd-e375-4c7b-9413-9d124bff2bf2","Type":"ContainerDied","Data":"7a7db6685c10e388273ceb217f9b2dc54da92cde721291d2410066a1d7a2cdd8"} Jul 16 12:28:28.397700 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.397494 2570 scope.go:117] "RemoveContainer" containerID="120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0" Jul 16 12:28:28.407136 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.407108 2570 scope.go:117] "RemoveContainer" containerID="120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0" Jul 16 12:28:28.407442 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:28:28.407424 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0\": container with ID starting with 120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0 not found: ID does not exist" containerID="120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0" Jul 16 12:28:28.407493 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.407451 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0"} err="failed to get container status \"120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0\": rpc error: code = NotFound desc = could not find container \"120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0\": container with ID starting with 120b8ac2d0fd38bee677db474ac0ab00dfc318d6b6b0057c76d62eee10e737c0 not found: ID does not exist" Jul 16 12:28:28.419687 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.419644 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzq25"] Jul 16 12:28:28.423670 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:28.423640 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzq25"] Jul 16 12:28:29.824897 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:29.824839 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0da2ddd-e375-4c7b-9413-9d124bff2bf2" path="/var/lib/kubelet/pods/d0da2ddd-e375-4c7b-9413-9d124bff2bf2/volumes" Jul 16 12:28:31.420337 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.420300 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl"] Jul 16 12:28:31.420733 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.420709 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0da2ddd-e375-4c7b-9413-9d124bff2bf2" containerName="limitador" Jul 16 12:28:31.420733 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.420721 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0da2ddd-e375-4c7b-9413-9d124bff2bf2" containerName="limitador" Jul 16 12:28:31.420733 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.420731 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe152c0a-2800-456e-a90b-d4966f3ff858" containerName="authorino" Jul 16 12:28:31.420832 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.420738 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe152c0a-2800-456e-a90b-d4966f3ff858" containerName="authorino" Jul 16 12:28:31.420832 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.420797 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe152c0a-2800-456e-a90b-d4966f3ff858" containerName="authorino" Jul 16 12:28:31.420832 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.420804 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0da2ddd-e375-4c7b-9413-9d124bff2bf2" containerName="limitador" Jul 16 12:28:31.423989 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.423964 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:31.426890 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.426849 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 12:28:31.427030 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.426964 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mptn9\"" Jul 16 12:28:31.427030 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.426974 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 16 12:28:31.427955 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.427934 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 12:28:31.433662 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.433634 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl"] Jul 16 12:28:31.485748 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.485701 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/39b9746a-f486-4ec8-ba7f-cdaa71ee4b79-data\") pod \"postgres-69fb4594cf-gqvtl\" (UID: \"39b9746a-f486-4ec8-ba7f-cdaa71ee4b79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:31.485968 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.485758 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggs54\" (UniqueName: \"kubernetes.io/projected/39b9746a-f486-4ec8-ba7f-cdaa71ee4b79-kube-api-access-ggs54\") pod \"postgres-69fb4594cf-gqvtl\" (UID: \"39b9746a-f486-4ec8-ba7f-cdaa71ee4b79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:31.587106 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.587064 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/39b9746a-f486-4ec8-ba7f-cdaa71ee4b79-data\") pod \"postgres-69fb4594cf-gqvtl\" (UID: \"39b9746a-f486-4ec8-ba7f-cdaa71ee4b79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:31.587106 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.587125 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggs54\" (UniqueName: \"kubernetes.io/projected/39b9746a-f486-4ec8-ba7f-cdaa71ee4b79-kube-api-access-ggs54\") pod \"postgres-69fb4594cf-gqvtl\" (UID: \"39b9746a-f486-4ec8-ba7f-cdaa71ee4b79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:31.587478 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.587458 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/39b9746a-f486-4ec8-ba7f-cdaa71ee4b79-data\") pod \"postgres-69fb4594cf-gqvtl\" (UID: \"39b9746a-f486-4ec8-ba7f-cdaa71ee4b79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:31.598135 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.598105 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggs54\" (UniqueName: \"kubernetes.io/projected/39b9746a-f486-4ec8-ba7f-cdaa71ee4b79-kube-api-access-ggs54\") pod \"postgres-69fb4594cf-gqvtl\" (UID: \"39b9746a-f486-4ec8-ba7f-cdaa71ee4b79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:31.736604 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.736495 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:31.880940 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:31.880916 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl"] Jul 16 12:28:31.883481 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:28:31.883446 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b9746a_f486_4ec8_ba7f_cdaa71ee4b79.slice/crio-67f3ae6699da353a15ec10e93402223622684912557b2ea6e01074985cb5202a WatchSource:0}: Error finding container 67f3ae6699da353a15ec10e93402223622684912557b2ea6e01074985cb5202a: Status 404 returned error can't find the container with id 67f3ae6699da353a15ec10e93402223622684912557b2ea6e01074985cb5202a Jul 16 12:28:32.418951 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:32.418911 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" event={"ID":"39b9746a-f486-4ec8-ba7f-cdaa71ee4b79","Type":"ContainerStarted","Data":"67f3ae6699da353a15ec10e93402223622684912557b2ea6e01074985cb5202a"} Jul 16 12:28:37.459954 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:37.459910 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" event={"ID":"39b9746a-f486-4ec8-ba7f-cdaa71ee4b79","Type":"ContainerStarted","Data":"d6c2db97b5464061fce1d3aa496ba7e77005c0d0840e912d4b9a686634a3cbde"} Jul 16 12:28:37.460486 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:37.459988 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:37.477345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:37.477283 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" podStartSLOduration=1.589789395 podStartE2EDuration="6.477263921s" totalImagesPullingTime="4.887474526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:28:37.475213337 +0000 UTC m=+512.327414150" watchObservedRunningTime="2026-07-16 12:28:37.477263921 +0000 UTC m=+512.329464773" Jul 16 12:28:43.496071 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:43.496040 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqvtl" Jul 16 12:28:44.124205 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.124164 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnkx6"] Jul 16 12:28:44.132180 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.132150 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" Jul 16 12:28:44.134810 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.134779 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b5p6x\"" Jul 16 12:28:44.140742 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.140035 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnkx6"] Jul 16 12:28:44.198760 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.198713 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkwx4\" (UniqueName: \"kubernetes.io/projected/efc592a2-291e-40e7-9a49-febe3284dc6e-kube-api-access-nkwx4\") pod \"authorino-5d4b67c446-vnkx6\" (UID: \"efc592a2-291e-40e7-9a49-febe3284dc6e\") " pod="kuadrant-system/authorino-5d4b67c446-vnkx6" Jul 16 12:28:44.300497 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.300452 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkwx4\" (UniqueName: \"kubernetes.io/projected/efc592a2-291e-40e7-9a49-febe3284dc6e-kube-api-access-nkwx4\") pod \"authorino-5d4b67c446-vnkx6\" (UID: \"efc592a2-291e-40e7-9a49-febe3284dc6e\") " pod="kuadrant-system/authorino-5d4b67c446-vnkx6" Jul 16 12:28:44.309203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.309164 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkwx4\" (UniqueName: \"kubernetes.io/projected/efc592a2-291e-40e7-9a49-febe3284dc6e-kube-api-access-nkwx4\") pod \"authorino-5d4b67c446-vnkx6\" (UID: \"efc592a2-291e-40e7-9a49-febe3284dc6e\") " pod="kuadrant-system/authorino-5d4b67c446-vnkx6" Jul 16 12:28:44.374182 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.374140 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnkx6"] Jul 16 12:28:44.374493 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.374448 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" Jul 16 12:28:44.402477 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.402443 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69544b9496-dt59f"] Jul 16 12:28:44.408304 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.408272 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69544b9496-dt59f" Jul 16 12:28:44.414889 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.414848 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69544b9496-dt59f"] Jul 16 12:28:44.502565 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.502525 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt4g4\" (UniqueName: \"kubernetes.io/projected/93593093-a56c-4526-b807-d05161ac9891-kube-api-access-jt4g4\") pod \"authorino-69544b9496-dt59f\" (UID: \"93593093-a56c-4526-b807-d05161ac9891\") " pod="kuadrant-system/authorino-69544b9496-dt59f" Jul 16 12:28:44.528041 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.528014 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnkx6"] Jul 16 12:28:44.530583 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:28:44.530555 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefc592a2_291e_40e7_9a49_febe3284dc6e.slice/crio-a534f9d0df9d71eeeca799418d23165f615eae6692de67ee626ff8178d342272 WatchSource:0}: Error finding container a534f9d0df9d71eeeca799418d23165f615eae6692de67ee626ff8178d342272: Status 404 returned error can't find the container with id a534f9d0df9d71eeeca799418d23165f615eae6692de67ee626ff8178d342272 Jul 16 12:28:44.604140 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.604094 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt4g4\" (UniqueName: \"kubernetes.io/projected/93593093-a56c-4526-b807-d05161ac9891-kube-api-access-jt4g4\") pod \"authorino-69544b9496-dt59f\" (UID: \"93593093-a56c-4526-b807-d05161ac9891\") " pod="kuadrant-system/authorino-69544b9496-dt59f" Jul 16 12:28:44.613208 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.613179 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt4g4\" (UniqueName: \"kubernetes.io/projected/93593093-a56c-4526-b807-d05161ac9891-kube-api-access-jt4g4\") pod \"authorino-69544b9496-dt59f\" (UID: \"93593093-a56c-4526-b807-d05161ac9891\") " pod="kuadrant-system/authorino-69544b9496-dt59f" Jul 16 12:28:44.660773 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.660675 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69544b9496-dt59f"] Jul 16 12:28:44.660986 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.660972 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69544b9496-dt59f" Jul 16 12:28:44.688492 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.688456 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bd7d7b4b4-ph8lf"] Jul 16 12:28:44.693891 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.693849 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:28:44.696270 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.696243 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 16 12:28:44.699351 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.699325 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd7d7b4b4-ph8lf"] Jul 16 12:28:44.805668 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.805626 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49b17c27-d9e8-4118-a065-31d8aebf7391-tls-cert\") pod \"authorino-5bd7d7b4b4-ph8lf\" (UID: \"49b17c27-d9e8-4118-a065-31d8aebf7391\") " pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:28:44.805823 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.805686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68dgf\" (UniqueName: \"kubernetes.io/projected/49b17c27-d9e8-4118-a065-31d8aebf7391-kube-api-access-68dgf\") pod \"authorino-5bd7d7b4b4-ph8lf\" (UID: \"49b17c27-d9e8-4118-a065-31d8aebf7391\") " pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:28:44.810905 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.810851 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69544b9496-dt59f"] Jul 16 12:28:44.812996 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:28:44.812967 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93593093_a56c_4526_b807_d05161ac9891.slice/crio-41315c8f3754cf6a517ee873e4c09b3d0e439b76366ed5ab172280f92902a6bc WatchSource:0}: Error finding container 41315c8f3754cf6a517ee873e4c09b3d0e439b76366ed5ab172280f92902a6bc: Status 404 returned error can't find the container with id 41315c8f3754cf6a517ee873e4c09b3d0e439b76366ed5ab172280f92902a6bc Jul 16 12:28:44.906315 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.906276 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49b17c27-d9e8-4118-a065-31d8aebf7391-tls-cert\") pod \"authorino-5bd7d7b4b4-ph8lf\" (UID: \"49b17c27-d9e8-4118-a065-31d8aebf7391\") " pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:28:44.906511 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.906365 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68dgf\" (UniqueName: \"kubernetes.io/projected/49b17c27-d9e8-4118-a065-31d8aebf7391-kube-api-access-68dgf\") pod \"authorino-5bd7d7b4b4-ph8lf\" (UID: \"49b17c27-d9e8-4118-a065-31d8aebf7391\") " pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:28:44.908899 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.908859 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49b17c27-d9e8-4118-a065-31d8aebf7391-tls-cert\") pod \"authorino-5bd7d7b4b4-ph8lf\" (UID: \"49b17c27-d9e8-4118-a065-31d8aebf7391\") " pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:28:44.914826 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:44.914769 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68dgf\" (UniqueName: \"kubernetes.io/projected/49b17c27-d9e8-4118-a065-31d8aebf7391-kube-api-access-68dgf\") pod \"authorino-5bd7d7b4b4-ph8lf\" (UID: \"49b17c27-d9e8-4118-a065-31d8aebf7391\") " pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:28:45.006227 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.006190 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:28:45.159258 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.159227 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd7d7b4b4-ph8lf"] Jul 16 12:28:45.160854 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:28:45.160823 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49b17c27_d9e8_4118_a065_31d8aebf7391.slice/crio-b6278c0b8e49bbb15a2c6363e81961e3bf3cd7c0bf58f57fe36987196bafefca WatchSource:0}: Error finding container b6278c0b8e49bbb15a2c6363e81961e3bf3cd7c0bf58f57fe36987196bafefca: Status 404 returned error can't find the container with id b6278c0b8e49bbb15a2c6363e81961e3bf3cd7c0bf58f57fe36987196bafefca Jul 16 12:28:45.501227 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.501131 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" event={"ID":"49b17c27-d9e8-4118-a065-31d8aebf7391","Type":"ContainerStarted","Data":"b6278c0b8e49bbb15a2c6363e81961e3bf3cd7c0bf58f57fe36987196bafefca"} Jul 16 12:28:45.502764 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.502734 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" event={"ID":"efc592a2-291e-40e7-9a49-febe3284dc6e","Type":"ContainerStarted","Data":"d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af"} Jul 16 12:28:45.502764 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.502747 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" podUID="efc592a2-291e-40e7-9a49-febe3284dc6e" containerName="authorino" containerID="cri-o://d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af" gracePeriod=30 Jul 16 12:28:45.503284 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.502776 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" event={"ID":"efc592a2-291e-40e7-9a49-febe3284dc6e","Type":"ContainerStarted","Data":"a534f9d0df9d71eeeca799418d23165f615eae6692de67ee626ff8178d342272"} Jul 16 12:28:45.504405 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.504379 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69544b9496-dt59f" event={"ID":"93593093-a56c-4526-b807-d05161ac9891","Type":"ContainerStarted","Data":"6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8"} Jul 16 12:28:45.504519 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.504416 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69544b9496-dt59f" event={"ID":"93593093-a56c-4526-b807-d05161ac9891","Type":"ContainerStarted","Data":"41315c8f3754cf6a517ee873e4c09b3d0e439b76366ed5ab172280f92902a6bc"} Jul 16 12:28:45.504519 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.504418 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-69544b9496-dt59f" podUID="93593093-a56c-4526-b807-d05161ac9891" containerName="authorino" containerID="cri-o://6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8" gracePeriod=30 Jul 16 12:28:45.520056 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.519994 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" podStartSLOduration=1.122179886 podStartE2EDuration="1.519967771s" totalImagesPullingTime="397.787885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:28:45.517460086 +0000 UTC m=+520.369660921" watchObservedRunningTime="2026-07-16 12:28:45.519967771 +0000 UTC m=+520.372168591" Jul 16 12:28:45.532453 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.532401 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69544b9496-dt59f" podStartSLOduration=1.168225072 podStartE2EDuration="1.53238193s" totalImagesPullingTime="364.156858ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:28:45.531423741 +0000 UTC m=+520.383624572" watchObservedRunningTime="2026-07-16 12:28:45.53238193 +0000 UTC m=+520.384582770" Jul 16 12:28:45.821053 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.821027 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" Jul 16 12:28:45.824350 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.824325 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69544b9496-dt59f" Jul 16 12:28:45.915701 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.915667 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkwx4\" (UniqueName: \"kubernetes.io/projected/efc592a2-291e-40e7-9a49-febe3284dc6e-kube-api-access-nkwx4\") pod \"efc592a2-291e-40e7-9a49-febe3284dc6e\" (UID: \"efc592a2-291e-40e7-9a49-febe3284dc6e\") " Jul 16 12:28:45.915701 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.915700 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt4g4\" (UniqueName: \"kubernetes.io/projected/93593093-a56c-4526-b807-d05161ac9891-kube-api-access-jt4g4\") pod \"93593093-a56c-4526-b807-d05161ac9891\" (UID: \"93593093-a56c-4526-b807-d05161ac9891\") " Jul 16 12:28:45.917728 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.917697 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc592a2-291e-40e7-9a49-febe3284dc6e-kube-api-access-nkwx4" (OuterVolumeSpecName: "kube-api-access-nkwx4") pod "efc592a2-291e-40e7-9a49-febe3284dc6e" (UID: "efc592a2-291e-40e7-9a49-febe3284dc6e"). InnerVolumeSpecName "kube-api-access-nkwx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:28:45.917862 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:45.917728 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93593093-a56c-4526-b807-d05161ac9891-kube-api-access-jt4g4" (OuterVolumeSpecName: "kube-api-access-jt4g4") pod "93593093-a56c-4526-b807-d05161ac9891" (UID: "93593093-a56c-4526-b807-d05161ac9891"). InnerVolumeSpecName "kube-api-access-jt4g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:28:46.017340 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.017290 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkwx4\" (UniqueName: \"kubernetes.io/projected/efc592a2-291e-40e7-9a49-febe3284dc6e-kube-api-access-nkwx4\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:28:46.017340 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.017334 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt4g4\" (UniqueName: \"kubernetes.io/projected/93593093-a56c-4526-b807-d05161ac9891-kube-api-access-jt4g4\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:28:46.511588 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.511551 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" event={"ID":"49b17c27-d9e8-4118-a065-31d8aebf7391","Type":"ContainerStarted","Data":"e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b"} Jul 16 12:28:46.512940 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.512914 2570 generic.go:356] "Generic (PLEG): container finished" podID="efc592a2-291e-40e7-9a49-febe3284dc6e" containerID="d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af" exitCode=0 Jul 16 12:28:46.513048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.512945 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" Jul 16 12:28:46.513048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.512996 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" event={"ID":"efc592a2-291e-40e7-9a49-febe3284dc6e","Type":"ContainerDied","Data":"d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af"} Jul 16 12:28:46.513048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.513033 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vnkx6" event={"ID":"efc592a2-291e-40e7-9a49-febe3284dc6e","Type":"ContainerDied","Data":"a534f9d0df9d71eeeca799418d23165f615eae6692de67ee626ff8178d342272"} Jul 16 12:28:46.513181 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.513060 2570 scope.go:117] "RemoveContainer" containerID="d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af" Jul 16 12:28:46.514438 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.514369 2570 generic.go:356] "Generic (PLEG): container finished" podID="93593093-a56c-4526-b807-d05161ac9891" containerID="6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8" exitCode=0 Jul 16 12:28:46.514438 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.514409 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69544b9496-dt59f" Jul 16 12:28:46.514556 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.514454 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69544b9496-dt59f" event={"ID":"93593093-a56c-4526-b807-d05161ac9891","Type":"ContainerDied","Data":"6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8"} Jul 16 12:28:46.514556 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.514495 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69544b9496-dt59f" event={"ID":"93593093-a56c-4526-b807-d05161ac9891","Type":"ContainerDied","Data":"41315c8f3754cf6a517ee873e4c09b3d0e439b76366ed5ab172280f92902a6bc"} Jul 16 12:28:46.522737 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.522715 2570 scope.go:117] "RemoveContainer" containerID="d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af" Jul 16 12:28:46.523101 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:28:46.523076 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af\": container with ID starting with d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af not found: ID does not exist" containerID="d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af" Jul 16 12:28:46.523203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.523109 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af"} err="failed to get container status \"d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af\": rpc error: code = NotFound desc = could not find container \"d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af\": container with ID starting with d434222955f4455cda78b13bd0c8c24e44ca54304e688391b1416808e5c628af not found: ID does not exist" Jul 16 12:28:46.523203 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.523135 2570 scope.go:117] "RemoveContainer" containerID="6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8" Jul 16 12:28:46.530175 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.530125 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" podStartSLOduration=2.128580993 podStartE2EDuration="2.530108962s" totalImagesPullingTime="401.527969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:28:46.527470955 +0000 UTC m=+521.379671805" watchObservedRunningTime="2026-07-16 12:28:46.530108962 +0000 UTC m=+521.382309751" Jul 16 12:28:46.532458 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.532438 2570 scope.go:117] "RemoveContainer" containerID="6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8" Jul 16 12:28:46.532766 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:28:46.532745 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8\": container with ID starting with 6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8 not found: ID does not exist" containerID="6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8" Jul 16 12:28:46.532808 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.532776 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8"} err="failed to get container status \"6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8\": rpc error: code = NotFound desc = could not find container \"6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8\": container with ID starting with 6c2ec1198d8f7e6103a57537af02be67035c318b6af977301d514cc078907da8 not found: ID does not exist" Jul 16 12:28:46.547401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.547368 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69544b9496-dt59f"] Jul 16 12:28:46.553966 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.553935 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69544b9496-dt59f"] Jul 16 12:28:46.572941 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.572868 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnkx6"] Jul 16 12:28:46.581414 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:46.581379 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnkx6"] Jul 16 12:28:47.824478 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:47.824441 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93593093-a56c-4526-b807-d05161ac9891" path="/var/lib/kubelet/pods/93593093-a56c-4526-b807-d05161ac9891/volumes" Jul 16 12:28:47.825009 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:28:47.824935 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc592a2-291e-40e7-9a49-febe3284dc6e" path="/var/lib/kubelet/pods/efc592a2-291e-40e7-9a49-febe3284dc6e/volumes" Jul 16 12:29:30.515993 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.515955 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk"] Jul 16 12:29:30.516586 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.516559 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc592a2-291e-40e7-9a49-febe3284dc6e" containerName="authorino" Jul 16 12:29:30.516586 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.516582 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc592a2-291e-40e7-9a49-febe3284dc6e" containerName="authorino" Jul 16 12:29:30.516685 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.516601 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93593093-a56c-4526-b807-d05161ac9891" containerName="authorino" Jul 16 12:29:30.516685 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.516608 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="93593093-a56c-4526-b807-d05161ac9891" containerName="authorino" Jul 16 12:29:30.516777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.516701 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="93593093-a56c-4526-b807-d05161ac9891" containerName="authorino" Jul 16 12:29:30.516777 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.516714 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc592a2-291e-40e7-9a49-febe3284dc6e" containerName="authorino" Jul 16 12:29:30.520055 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.520034 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:30.522537 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.522508 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 16 12:29:30.522537 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.522508 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dvntz\"" Jul 16 12:29:30.530278 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.530248 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk"] Jul 16 12:29:30.620310 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.620269 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c923913-477a-49e0-b1a9-e05942cb6d8e-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-lg2lk\" (UID: \"8c923913-477a-49e0-b1a9-e05942cb6d8e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:30.620504 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.620397 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn287\" (UniqueName: \"kubernetes.io/projected/8c923913-477a-49e0-b1a9-e05942cb6d8e-kube-api-access-nn287\") pod \"payload-pre-processing-74584bb9f8-lg2lk\" (UID: \"8c923913-477a-49e0-b1a9-e05942cb6d8e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:30.721547 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.721508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn287\" (UniqueName: \"kubernetes.io/projected/8c923913-477a-49e0-b1a9-e05942cb6d8e-kube-api-access-nn287\") pod \"payload-pre-processing-74584bb9f8-lg2lk\" (UID: \"8c923913-477a-49e0-b1a9-e05942cb6d8e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:30.721755 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.721578 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c923913-477a-49e0-b1a9-e05942cb6d8e-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-lg2lk\" (UID: \"8c923913-477a-49e0-b1a9-e05942cb6d8e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:30.722353 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.722330 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c923913-477a-49e0-b1a9-e05942cb6d8e-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-lg2lk\" (UID: \"8c923913-477a-49e0-b1a9-e05942cb6d8e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:30.730601 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.730563 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn287\" (UniqueName: \"kubernetes.io/projected/8c923913-477a-49e0-b1a9-e05942cb6d8e-kube-api-access-nn287\") pod \"payload-pre-processing-74584bb9f8-lg2lk\" (UID: \"8c923913-477a-49e0-b1a9-e05942cb6d8e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:30.832779 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.832735 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:30.981722 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:30.981612 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk"] Jul 16 12:29:30.984243 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:29:30.984209 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c923913_477a_49e0_b1a9_e05942cb6d8e.slice/crio-83978193f5c198537911bf5a8748edf4d55cee0a6e2147acaa97d492b305c709 WatchSource:0}: Error finding container 83978193f5c198537911bf5a8748edf4d55cee0a6e2147acaa97d492b305c709: Status 404 returned error can't find the container with id 83978193f5c198537911bf5a8748edf4d55cee0a6e2147acaa97d492b305c709 Jul 16 12:29:31.748804 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:31.748759 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" event={"ID":"8c923913-477a-49e0-b1a9-e05942cb6d8e","Type":"ContainerStarted","Data":"83978193f5c198537911bf5a8748edf4d55cee0a6e2147acaa97d492b305c709"} Jul 16 12:29:32.755388 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:32.755289 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" event={"ID":"8c923913-477a-49e0-b1a9-e05942cb6d8e","Type":"ContainerStarted","Data":"19df248de931e64451f2bce5a4c3d4c1e8ed4f9f7b31bec30e68e88b9577bac0"} Jul 16 12:29:32.755766 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:32.755419 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:32.773249 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:32.773189 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" podStartSLOduration=1.381828281 podStartE2EDuration="2.773169077s" totalImagesPullingTime="1.391340796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:29:32.772410353 +0000 UTC m=+567.624611182" watchObservedRunningTime="2026-07-16 12:29:32.773169077 +0000 UTC m=+567.625369887" Jul 16 12:29:43.763082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:43.763038 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-lg2lk" Jul 16 12:29:55.124675 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.124632 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb"] Jul 16 12:29:55.130997 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.130969 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.135022 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.134989 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-78wqk\"" Jul 16 12:29:55.135382 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.135161 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 12:29:55.136098 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.135504 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 12:29:55.136098 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.135653 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 16 12:29:55.147911 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.147859 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb"] Jul 16 12:29:55.249054 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.249013 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe6f42e2-4984-4cbb-9341-94ad16e5b676-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.249244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.249088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.249244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.249111 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.249244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.249132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.249244 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.249156 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9584s\" (UniqueName: \"kubernetes.io/projected/fe6f42e2-4984-4cbb-9341-94ad16e5b676-kube-api-access-9584s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.249386 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.249250 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.350669 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.350628 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.350669 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.350673 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.350966 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.350694 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.350966 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.350713 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9584s\" (UniqueName: \"kubernetes.io/projected/fe6f42e2-4984-4cbb-9341-94ad16e5b676-kube-api-access-9584s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.350966 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.350764 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.350966 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.350821 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe6f42e2-4984-4cbb-9341-94ad16e5b676-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.351160 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.351101 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.351214 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.351165 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.351285 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.351266 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.353170 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.353143 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe6f42e2-4984-4cbb-9341-94ad16e5b676-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.353567 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.353548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe6f42e2-4984-4cbb-9341-94ad16e5b676-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.359754 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.359717 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9584s\" (UniqueName: \"kubernetes.io/projected/fe6f42e2-4984-4cbb-9341-94ad16e5b676-kube-api-access-9584s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb\" (UID: \"fe6f42e2-4984-4cbb-9341-94ad16e5b676\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.447022 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.446926 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:29:55.606228 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.606198 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb"] Jul 16 12:29:55.608318 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:29:55.608287 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6f42e2_4984_4cbb_9341_94ad16e5b676.slice/crio-912c198b82b945e5fe4c19bd407496f271a837280fe5003056a4a7db9927405b WatchSource:0}: Error finding container 912c198b82b945e5fe4c19bd407496f271a837280fe5003056a4a7db9927405b: Status 404 returned error can't find the container with id 912c198b82b945e5fe4c19bd407496f271a837280fe5003056a4a7db9927405b Jul 16 12:29:55.874238 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:55.874012 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" event={"ID":"fe6f42e2-4984-4cbb-9341-94ad16e5b676","Type":"ContainerStarted","Data":"912c198b82b945e5fe4c19bd407496f271a837280fe5003056a4a7db9927405b"} Jul 16 12:29:56.880926 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:56.880862 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" event={"ID":"fe6f42e2-4984-4cbb-9341-94ad16e5b676","Type":"ContainerStarted","Data":"f57871464ce2d5fcb2b5af7a14be5bccc2bf3d5cd3f08aec97de6d85c027dd6c"} Jul 16 12:29:56.903008 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:29:56.902951 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" podStartSLOduration=0.755206379 podStartE2EDuration="1.90293265s" totalImagesPullingTime="1.147726271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:29:56.902243904 +0000 UTC m=+591.754444733" watchObservedRunningTime="2026-07-16 12:29:56.90293265 +0000 UTC m=+591.755133460" Jul 16 12:30:05.447811 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:05.447772 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:30:05.448278 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:05.447849 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:30:05.460849 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:05.460813 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:30:05.672316 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:05.672287 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:30:05.674592 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:05.674567 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:30:05.676440 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:05.676412 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:30:05.678549 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:05.678525 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:30:05.939401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:05.939367 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb" Jul 16 12:30:13.810157 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.810120 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85"] Jul 16 12:30:13.814330 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.814303 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:13.816992 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.816965 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 12:30:13.826090 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.826065 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85"] Jul 16 12:30:13.921310 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.921260 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc994784-e4c2-4701-a536-740fba4a23b6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:13.921517 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.921329 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:13.921517 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.921372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:13.921517 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.921487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4td6j\" (UniqueName: \"kubernetes.io/projected/bc994784-e4c2-4701-a536-740fba4a23b6-kube-api-access-4td6j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:13.921638 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.921526 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:13.921638 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:13.921584 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022258 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022209 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022258 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022257 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022549 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022304 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc994784-e4c2-4701-a536-740fba4a23b6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022549 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022329 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022549 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022549 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022413 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4td6j\" (UniqueName: \"kubernetes.io/projected/bc994784-e4c2-4701-a536-740fba4a23b6-kube-api-access-4td6j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022748 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022685 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022748 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022702 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.022848 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.022765 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.024601 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.024579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc994784-e4c2-4701-a536-740fba4a23b6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.024975 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.024955 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc994784-e4c2-4701-a536-740fba4a23b6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.032116 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.032087 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4td6j\" (UniqueName: \"kubernetes.io/projected/bc994784-e4c2-4701-a536-740fba4a23b6-kube-api-access-4td6j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6t85\" (UID: \"bc994784-e4c2-4701-a536-740fba4a23b6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.127387 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.127345 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:14.275523 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.275495 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85"] Jul 16 12:30:14.277381 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:30:14.277346 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc994784_e4c2_4701_a536_740fba4a23b6.slice/crio-66f4f11d4604e33fdbdbc08e456b074a3db36ccc743a73024d44e9eedcc89a75 WatchSource:0}: Error finding container 66f4f11d4604e33fdbdbc08e456b074a3db36ccc743a73024d44e9eedcc89a75: Status 404 returned error can't find the container with id 66f4f11d4604e33fdbdbc08e456b074a3db36ccc743a73024d44e9eedcc89a75 Jul 16 12:30:14.977202 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.977159 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" event={"ID":"bc994784-e4c2-4701-a536-740fba4a23b6","Type":"ContainerStarted","Data":"3a3ba5f937527813ee1b0e51c9ddc047b95d6541bee0bd7da9a84c986ff7fcd7"} Jul 16 12:30:14.977722 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.977261 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" event={"ID":"bc994784-e4c2-4701-a536-740fba4a23b6","Type":"ContainerStarted","Data":"66f4f11d4604e33fdbdbc08e456b074a3db36ccc743a73024d44e9eedcc89a75"} Jul 16 12:30:14.998258 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:14.998201 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" podStartSLOduration=1.776089837 podStartE2EDuration="1.998181345s" totalImagesPullingTime="222.091508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:14.995823762 +0000 UTC m=+609.848024574" watchObservedRunningTime="2026-07-16 12:30:14.998181345 +0000 UTC m=+609.850382156" Jul 16 12:30:24.127686 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:24.127643 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:24.130131 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:24.127710 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:24.142944 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:24.142911 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:30:25.043176 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:30:25.043138 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6t85" Jul 16 12:32:15.198221 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.198117 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-698684c77c-xbp9z"] Jul 16 12:32:15.201997 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.201970 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-698684c77c-xbp9z" Jul 16 12:32:15.218974 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.218939 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-698684c77c-xbp9z"] Jul 16 12:32:15.371547 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.371504 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xn47\" (UniqueName: \"kubernetes.io/projected/43b5d44c-fca9-4f6c-bede-f75327539e79-kube-api-access-9xn47\") pod \"authorino-698684c77c-xbp9z\" (UID: \"43b5d44c-fca9-4f6c-bede-f75327539e79\") " pod="kuadrant-system/authorino-698684c77c-xbp9z" Jul 16 12:32:15.371732 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.371590 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43b5d44c-fca9-4f6c-bede-f75327539e79-tls-cert\") pod \"authorino-698684c77c-xbp9z\" (UID: \"43b5d44c-fca9-4f6c-bede-f75327539e79\") " pod="kuadrant-system/authorino-698684c77c-xbp9z" Jul 16 12:32:15.472828 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.472726 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xn47\" (UniqueName: \"kubernetes.io/projected/43b5d44c-fca9-4f6c-bede-f75327539e79-kube-api-access-9xn47\") pod \"authorino-698684c77c-xbp9z\" (UID: \"43b5d44c-fca9-4f6c-bede-f75327539e79\") " pod="kuadrant-system/authorino-698684c77c-xbp9z" Jul 16 12:32:15.472828 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.472804 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43b5d44c-fca9-4f6c-bede-f75327539e79-tls-cert\") pod \"authorino-698684c77c-xbp9z\" (UID: \"43b5d44c-fca9-4f6c-bede-f75327539e79\") " pod="kuadrant-system/authorino-698684c77c-xbp9z" Jul 16 12:32:15.475441 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.475417 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43b5d44c-fca9-4f6c-bede-f75327539e79-tls-cert\") pod \"authorino-698684c77c-xbp9z\" (UID: \"43b5d44c-fca9-4f6c-bede-f75327539e79\") " pod="kuadrant-system/authorino-698684c77c-xbp9z" Jul 16 12:32:15.482438 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.482410 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xn47\" (UniqueName: \"kubernetes.io/projected/43b5d44c-fca9-4f6c-bede-f75327539e79-kube-api-access-9xn47\") pod \"authorino-698684c77c-xbp9z\" (UID: \"43b5d44c-fca9-4f6c-bede-f75327539e79\") " pod="kuadrant-system/authorino-698684c77c-xbp9z" Jul 16 12:32:15.511550 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.511515 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-698684c77c-xbp9z" Jul 16 12:32:15.661261 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.661237 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-698684c77c-xbp9z"] Jul 16 12:32:15.663406 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:32:15.663368 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43b5d44c_fca9_4f6c_bede_f75327539e79.slice/crio-f071f6b09ae9de76d5b9eafbc6c4f46d98824ade41baeb783988c2021089deef WatchSource:0}: Error finding container f071f6b09ae9de76d5b9eafbc6c4f46d98824ade41baeb783988c2021089deef: Status 404 returned error can't find the container with id f071f6b09ae9de76d5b9eafbc6c4f46d98824ade41baeb783988c2021089deef Jul 16 12:32:15.664807 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:15.664788 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:32:16.602525 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:16.602491 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-698684c77c-xbp9z" event={"ID":"43b5d44c-fca9-4f6c-bede-f75327539e79","Type":"ContainerStarted","Data":"30bfb143d873113e8e4cb02c01e152b14755f5ab776625489318c1faa205f92c"} Jul 16 12:32:16.602960 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:16.602539 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-698684c77c-xbp9z" event={"ID":"43b5d44c-fca9-4f6c-bede-f75327539e79","Type":"ContainerStarted","Data":"f071f6b09ae9de76d5b9eafbc6c4f46d98824ade41baeb783988c2021089deef"} Jul 16 12:32:16.627187 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:16.627099 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-698684c77c-xbp9z" podStartSLOduration=1.238520678 podStartE2EDuration="1.627073804s" totalImagesPullingTime="388.553126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:32:16.622843771 +0000 UTC m=+731.475044606" watchObservedRunningTime="2026-07-16 12:32:16.627073804 +0000 UTC m=+731.479274617" Jul 16 12:32:16.674681 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:16.674636 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bd7d7b4b4-ph8lf"] Jul 16 12:32:16.675188 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:16.675149 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" podUID="49b17c27-d9e8-4118-a065-31d8aebf7391" containerName="authorino" containerID="cri-o://e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b" gracePeriod=30 Jul 16 12:32:16.953044 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:16.953010 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:32:17.089219 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.089168 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49b17c27-d9e8-4118-a065-31d8aebf7391-tls-cert\") pod \"49b17c27-d9e8-4118-a065-31d8aebf7391\" (UID: \"49b17c27-d9e8-4118-a065-31d8aebf7391\") " Jul 16 12:32:17.089219 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.089225 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68dgf\" (UniqueName: \"kubernetes.io/projected/49b17c27-d9e8-4118-a065-31d8aebf7391-kube-api-access-68dgf\") pod \"49b17c27-d9e8-4118-a065-31d8aebf7391\" (UID: \"49b17c27-d9e8-4118-a065-31d8aebf7391\") " Jul 16 12:32:17.091403 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.091366 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b17c27-d9e8-4118-a065-31d8aebf7391-kube-api-access-68dgf" (OuterVolumeSpecName: "kube-api-access-68dgf") pod "49b17c27-d9e8-4118-a065-31d8aebf7391" (UID: "49b17c27-d9e8-4118-a065-31d8aebf7391"). InnerVolumeSpecName "kube-api-access-68dgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:32:17.101482 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.101447 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49b17c27-d9e8-4118-a065-31d8aebf7391-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "49b17c27-d9e8-4118-a065-31d8aebf7391" (UID: "49b17c27-d9e8-4118-a065-31d8aebf7391"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:32:17.190522 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.190422 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49b17c27-d9e8-4118-a065-31d8aebf7391-tls-cert\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:32:17.190522 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.190470 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68dgf\" (UniqueName: \"kubernetes.io/projected/49b17c27-d9e8-4118-a065-31d8aebf7391-kube-api-access-68dgf\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:32:17.609447 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.609411 2570 generic.go:356] "Generic (PLEG): container finished" podID="49b17c27-d9e8-4118-a065-31d8aebf7391" containerID="e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b" exitCode=0 Jul 16 12:32:17.609916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.609457 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" Jul 16 12:32:17.609916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.609501 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" event={"ID":"49b17c27-d9e8-4118-a065-31d8aebf7391","Type":"ContainerDied","Data":"e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b"} Jul 16 12:32:17.609916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.609547 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd7d7b4b4-ph8lf" event={"ID":"49b17c27-d9e8-4118-a065-31d8aebf7391","Type":"ContainerDied","Data":"b6278c0b8e49bbb15a2c6363e81961e3bf3cd7c0bf58f57fe36987196bafefca"} Jul 16 12:32:17.609916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.609571 2570 scope.go:117] "RemoveContainer" containerID="e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b" Jul 16 12:32:17.620412 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.620385 2570 scope.go:117] "RemoveContainer" containerID="e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b" Jul 16 12:32:17.620788 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:32:17.620762 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b\": container with ID starting with e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b not found: ID does not exist" containerID="e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b" Jul 16 12:32:17.620938 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.620796 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b"} err="failed to get container status \"e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b\": rpc error: code = NotFound desc = could not find container \"e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b\": container with ID starting with e85f51e10cdb063035fcfe2a058144cb64051ef19e5f396d6204cd8b3106507b not found: ID does not exist" Jul 16 12:32:17.641409 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.641364 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bd7d7b4b4-ph8lf"] Jul 16 12:32:17.646684 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.646655 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bd7d7b4b4-ph8lf"] Jul 16 12:32:17.825926 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:32:17.825865 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49b17c27-d9e8-4118-a065-31d8aebf7391" path="/var/lib/kubelet/pods/49b17c27-d9e8-4118-a065-31d8aebf7391/volumes" Jul 16 12:35:05.709948 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:35:05.709834 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:35:05.709948 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:35:05.709915 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:35:05.714216 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:35:05.714195 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:35:05.714394 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:35:05.714368 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:39:07.845343 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:07.845306 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g"] Jul 16 12:39:07.845942 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:07.845515 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" podUID="671aaa5c-c78f-4398-a226-4d7dbcc65da4" containerName="manager" containerID="cri-o://81e8cb4934093fcd8f24b8e517d922f4e4dd74e8793d072eca5cd3d817775a9f" gracePeriod=10 Jul 16 12:39:11.779254 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:11.779211 2570 generic.go:356] "Generic (PLEG): container finished" podID="671aaa5c-c78f-4398-a226-4d7dbcc65da4" containerID="81e8cb4934093fcd8f24b8e517d922f4e4dd74e8793d072eca5cd3d817775a9f" exitCode=0 Jul 16 12:39:11.779687 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:11.779290 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" event={"ID":"671aaa5c-c78f-4398-a226-4d7dbcc65da4","Type":"ContainerDied","Data":"81e8cb4934093fcd8f24b8e517d922f4e4dd74e8793d072eca5cd3d817775a9f"} Jul 16 12:39:11.820243 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:11.820215 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:39:11.921870 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:11.921765 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rz94\" (UniqueName: \"kubernetes.io/projected/671aaa5c-c78f-4398-a226-4d7dbcc65da4-kube-api-access-8rz94\") pod \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\" (UID: \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\") " Jul 16 12:39:11.922089 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:11.922009 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671aaa5c-c78f-4398-a226-4d7dbcc65da4-extensions-socket-volume\") pod \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\" (UID: \"671aaa5c-c78f-4398-a226-4d7dbcc65da4\") " Jul 16 12:39:11.922413 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:11.922388 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/671aaa5c-c78f-4398-a226-4d7dbcc65da4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "671aaa5c-c78f-4398-a226-4d7dbcc65da4" (UID: "671aaa5c-c78f-4398-a226-4d7dbcc65da4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:39:11.923992 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:11.923962 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/671aaa5c-c78f-4398-a226-4d7dbcc65da4-kube-api-access-8rz94" (OuterVolumeSpecName: "kube-api-access-8rz94") pod "671aaa5c-c78f-4398-a226-4d7dbcc65da4" (UID: "671aaa5c-c78f-4398-a226-4d7dbcc65da4"). InnerVolumeSpecName "kube-api-access-8rz94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:39:12.022714 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:12.022676 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rz94\" (UniqueName: \"kubernetes.io/projected/671aaa5c-c78f-4398-a226-4d7dbcc65da4-kube-api-access-8rz94\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:39:12.022714 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:12.022706 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671aaa5c-c78f-4398-a226-4d7dbcc65da4-extensions-socket-volume\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:39:12.785519 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:12.785490 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" Jul 16 12:39:12.786000 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:12.785485 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g" event={"ID":"671aaa5c-c78f-4398-a226-4d7dbcc65da4","Type":"ContainerDied","Data":"61a490e765e63b3271e3688ea62bbd6a3dcb03e67719556df9eed80e38a089c8"} Jul 16 12:39:12.786000 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:12.785635 2570 scope.go:117] "RemoveContainer" containerID="81e8cb4934093fcd8f24b8e517d922f4e4dd74e8793d072eca5cd3d817775a9f" Jul 16 12:39:12.813427 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:12.813395 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g"] Jul 16 12:39:12.817767 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:12.817737 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwf8g"] Jul 16 12:39:13.824655 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:39:13.824612 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="671aaa5c-c78f-4398-a226-4d7dbcc65da4" path="/var/lib/kubelet/pods/671aaa5c-c78f-4398-a226-4d7dbcc65da4/volumes" Jul 16 12:40:05.742334 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:05.742301 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:40:05.744980 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:05.744952 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:40:05.745844 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:05.745826 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:40:05.748493 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:05.748472 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:40:09.124194 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.124156 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx"] Jul 16 12:40:09.124597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.124560 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="671aaa5c-c78f-4398-a226-4d7dbcc65da4" containerName="manager" Jul 16 12:40:09.124597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.124570 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="671aaa5c-c78f-4398-a226-4d7dbcc65da4" containerName="manager" Jul 16 12:40:09.124597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.124579 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49b17c27-d9e8-4118-a065-31d8aebf7391" containerName="authorino" Jul 16 12:40:09.124597 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.124584 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="49b17c27-d9e8-4118-a065-31d8aebf7391" containerName="authorino" Jul 16 12:40:09.124735 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.124653 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="49b17c27-d9e8-4118-a065-31d8aebf7391" containerName="authorino" Jul 16 12:40:09.124735 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.124664 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="671aaa5c-c78f-4398-a226-4d7dbcc65da4" containerName="manager" Jul 16 12:40:09.128858 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.128839 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:09.131395 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.131373 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5grhs\"" Jul 16 12:40:09.138543 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.138514 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx"] Jul 16 12:40:09.144733 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.144701 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnq6\" (UniqueName: \"kubernetes.io/projected/c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473-kube-api-access-slnq6\") pod \"kuadrant-operator-controller-manager-86878c769f-4m7zx\" (UID: \"c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:09.144949 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.144784 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4m7zx\" (UID: \"c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:09.245524 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.245478 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnq6\" (UniqueName: \"kubernetes.io/projected/c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473-kube-api-access-slnq6\") pod \"kuadrant-operator-controller-manager-86878c769f-4m7zx\" (UID: \"c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:09.245736 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.245560 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4m7zx\" (UID: \"c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:09.246001 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.245981 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4m7zx\" (UID: \"c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:09.254583 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.254553 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnq6\" (UniqueName: \"kubernetes.io/projected/c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473-kube-api-access-slnq6\") pod \"kuadrant-operator-controller-manager-86878c769f-4m7zx\" (UID: \"c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:09.440301 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.440189 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:09.589465 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:09.589438 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx"] Jul 16 12:40:09.591841 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:40:09.591814 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ccefd3_86c5_4a8d_82f0_f5e8d51f6473.slice/crio-a47167c63afbc3b5572f0da6d554d26189423596543f40fe92c40aa9bc0b6e39 WatchSource:0}: Error finding container a47167c63afbc3b5572f0da6d554d26189423596543f40fe92c40aa9bc0b6e39: Status 404 returned error can't find the container with id a47167c63afbc3b5572f0da6d554d26189423596543f40fe92c40aa9bc0b6e39 Jul 16 12:40:10.087643 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:10.087595 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" event={"ID":"c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473","Type":"ContainerStarted","Data":"102e4c1db93e2f5e093547f95a2593705e10db908d92813a479a7a118b234e2a"} Jul 16 12:40:10.087847 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:10.087661 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" event={"ID":"c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473","Type":"ContainerStarted","Data":"a47167c63afbc3b5572f0da6d554d26189423596543f40fe92c40aa9bc0b6e39"} Jul 16 12:40:10.087847 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:10.087688 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:40:10.107966 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:10.107904 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" podStartSLOduration=1.107869964 podStartE2EDuration="1.107869964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:10.106143321 +0000 UTC m=+1204.958344150" watchObservedRunningTime="2026-07-16 12:40:10.107869964 +0000 UTC m=+1204.960070776" Jul 16 12:40:21.094497 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:40:21.094463 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m7zx" Jul 16 12:45:05.773728 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:45:05.773689 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:45:05.776984 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:45:05.776963 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:45:05.777990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:45:05.777965 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:45:05.781454 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:45:05.781430 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:46:39.217363 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.217328 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x"] Jul 16 12:46:39.221124 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.221099 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.223622 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.223591 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 12:46:39.223622 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.223591 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f5f31a77-openshift-default-dockercfg-9kh4x\"" Jul 16 12:46:39.235555 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.235526 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x"] Jul 16 12:46:39.318229 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318178 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-envoy\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.318656 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318293 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30afd424-350d-47fb-97e6-778338aaf74e-istio-podinfo\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.318656 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318503 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-certs\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.318656 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318558 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-data\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.318656 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318617 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30afd424-350d-47fb-97e6-778338aaf74e-istiod-ca-cert\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.318656 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-istio-token\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.319011 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318679 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfnwt\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-kube-api-access-bfnwt\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.319011 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-credential-socket\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.319011 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.318798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-socket\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.419744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.419701 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30afd424-350d-47fb-97e6-778338aaf74e-istiod-ca-cert\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.419744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.419755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-istio-token\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.419793 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfnwt\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-kube-api-access-bfnwt\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.419852 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-credential-socket\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.419940 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-socket\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.419987 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-envoy\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.420042 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30afd424-350d-47fb-97e6-778338aaf74e-istio-podinfo\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.420080 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-certs\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420165 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.420124 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-data\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420607 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.420580 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-data\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.420955 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.420929 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-credential-socket\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.421449 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.421419 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-certs\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.421709 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.421661 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30afd424-350d-47fb-97e6-778338aaf74e-istiod-ca-cert\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.422125 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.422084 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-socket\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.424543 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.424514 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-envoy\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.425095 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.425070 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30afd424-350d-47fb-97e6-778338aaf74e-istio-podinfo\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.434489 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.434452 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfnwt\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-kube-api-access-bfnwt\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.434699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.434590 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-istio-token\") pod \"e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.535389 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.535291 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:39.683566 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.683539 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x"] Jul 16 12:46:39.685695 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:46:39.685663 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30afd424_350d_47fb_97e6_778338aaf74e.slice/crio-7b28b0c6f666992fa50275646e99015f5a2973288d064ad3e4ab55ea89d79351 WatchSource:0}: Error finding container 7b28b0c6f666992fa50275646e99015f5a2973288d064ad3e4ab55ea89d79351: Status 404 returned error can't find the container with id 7b28b0c6f666992fa50275646e99015f5a2973288d064ad3e4ab55ea89d79351 Jul 16 12:46:39.688217 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:39.688187 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:46:40.116659 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:40.116624 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" event={"ID":"30afd424-350d-47fb-97e6-778338aaf74e","Type":"ContainerStarted","Data":"7b28b0c6f666992fa50275646e99015f5a2973288d064ad3e4ab55ea89d79351"} Jul 16 12:46:42.395788 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:42.395740 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:46:42.396153 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:42.395848 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:46:42.396153 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:42.395895 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:46:43.135290 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:43.135245 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" event={"ID":"30afd424-350d-47fb-97e6-778338aaf74e","Type":"ContainerStarted","Data":"1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1"} Jul 16 12:46:43.160641 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:43.160582 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" podStartSLOduration=1.4535859850000001 podStartE2EDuration="4.160561439s" totalImagesPullingTime="2.706975454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:43.159345555 +0000 UTC m=+1598.011546378" watchObservedRunningTime="2026-07-16 12:46:43.160561439 +0000 UTC m=+1598.012762249" Jul 16 12:46:43.535932 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:43.535798 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:43.541059 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:43.541027 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:44.152237 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:44.152198 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:44.222268 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:44.222225 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:44.878642 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:44.878605 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x"] Jul 16 12:46:45.157388 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:45.157298 2570 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" secret="" err="secret \"e2e-derive-f5f31a77-openshift-default-dockercfg-9kh4x\" not found" Jul 16 12:46:46.161977 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:46.161934 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" podUID="30afd424-350d-47fb-97e6-778338aaf74e" containerName="istio-proxy" containerID="cri-o://1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1" gracePeriod=30 Jul 16 12:46:51.029701 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.029617 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:51.138801 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.138689 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-certs\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.138801 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.138734 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-data\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.138801 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.138760 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-envoy\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.138801 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.138778 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfnwt\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-kube-api-access-bfnwt\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.138801 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.138796 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-socket\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.139243 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.138852 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30afd424-350d-47fb-97e6-778338aaf74e-istiod-ca-cert\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.139243 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.138985 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30afd424-350d-47fb-97e6-778338aaf74e-istio-podinfo\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.139243 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.139014 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-istio-token\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.139243 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.139057 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-credential-socket\") pod \"30afd424-350d-47fb-97e6-778338aaf74e\" (UID: \"30afd424-350d-47fb-97e6-778338aaf74e\") " Jul 16 12:46:51.139243 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.139057 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:46:51.139511 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.139351 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-certs\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.139511 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.139477 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30afd424-350d-47fb-97e6-778338aaf74e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:46:51.139644 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.139561 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:46:51.139701 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.139598 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:46:51.139828 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.139799 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-data" (OuterVolumeSpecName: "istio-data") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:46:51.141259 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.141230 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:46:51.141381 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.141303 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-istio-token" (OuterVolumeSpecName: "istio-token") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:46:51.141462 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.141436 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30afd424-350d-47fb-97e6-778338aaf74e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 12:46:51.141606 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.141589 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-kube-api-access-bfnwt" (OuterVolumeSpecName: "kube-api-access-bfnwt") pod "30afd424-350d-47fb-97e6-778338aaf74e" (UID: "30afd424-350d-47fb-97e6-778338aaf74e"). InnerVolumeSpecName "kube-api-access-bfnwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:46:51.187998 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.187956 2570 generic.go:356] "Generic (PLEG): container finished" podID="30afd424-350d-47fb-97e6-778338aaf74e" containerID="1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1" exitCode=0 Jul 16 12:46:51.188180 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.188017 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" Jul 16 12:46:51.188180 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.188040 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" event={"ID":"30afd424-350d-47fb-97e6-778338aaf74e","Type":"ContainerDied","Data":"1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1"} Jul 16 12:46:51.188180 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.188100 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x" event={"ID":"30afd424-350d-47fb-97e6-778338aaf74e","Type":"ContainerDied","Data":"7b28b0c6f666992fa50275646e99015f5a2973288d064ad3e4ab55ea89d79351"} Jul 16 12:46:51.188180 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.188124 2570 scope.go:117] "RemoveContainer" containerID="1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1" Jul 16 12:46:51.198048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.198025 2570 scope.go:117] "RemoveContainer" containerID="1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1" Jul 16 12:46:51.198358 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:46:51.198337 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1\": container with ID starting with 1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1 not found: ID does not exist" containerID="1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1" Jul 16 12:46:51.198428 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.198371 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1"} err="failed to get container status \"1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1\": rpc error: code = NotFound desc = could not find container \"1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1\": container with ID starting with 1cb87af691ecbb649cc441f23436f9ef8a8ee7d82d192443f102d20620e2ecd1 not found: ID does not exist" Jul 16 12:46:51.211861 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.211825 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x"] Jul 16 12:46:51.216415 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.216379 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f5f31a77-openshift-default-7f96588d4c-ggx8x"] Jul 16 12:46:51.240370 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.240336 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-envoy\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.240370 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.240366 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfnwt\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-kube-api-access-bfnwt\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.240370 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.240378 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-workload-socket\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.240370 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.240388 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30afd424-350d-47fb-97e6-778338aaf74e-istiod-ca-cert\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.240674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.240398 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30afd424-350d-47fb-97e6-778338aaf74e-istio-podinfo\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.240674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.240410 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30afd424-350d-47fb-97e6-778338aaf74e-istio-token\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.240674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.240417 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-credential-socket\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.240674 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.240425 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30afd424-350d-47fb-97e6-778338aaf74e-istio-data\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:46:51.825839 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:46:51.825796 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30afd424-350d-47fb-97e6-778338aaf74e" path="/var/lib/kubelet/pods/30afd424-350d-47fb-97e6-778338aaf74e/volumes" Jul 16 12:48:31.691265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.691228 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g"] Jul 16 12:48:31.691857 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.691652 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30afd424-350d-47fb-97e6-778338aaf74e" containerName="istio-proxy" Jul 16 12:48:31.691857 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.691663 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="30afd424-350d-47fb-97e6-778338aaf74e" containerName="istio-proxy" Jul 16 12:48:31.691857 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.691730 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="30afd424-350d-47fb-97e6-778338aaf74e" containerName="istio-proxy" Jul 16 12:48:31.694978 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.694946 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.697773 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.697732 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2e36a3ff-serving-cert\"" Jul 16 12:48:31.697950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.697816 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nttp2\"" Jul 16 12:48:31.708707 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.708668 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g"] Jul 16 12:48:31.843644 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.843605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09c9451-dc2c-4369-962c-a4dc8cecf82b-openshift-service-ca\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.843644 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.843661 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a09c9451-dc2c-4369-962c-a4dc8cecf82b-maas-api-tls\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.843923 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.843740 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d6tq\" (UniqueName: \"kubernetes.io/projected/a09c9451-dc2c-4369-962c-a4dc8cecf82b-kube-api-access-4d6tq\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.944945 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.944805 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d6tq\" (UniqueName: \"kubernetes.io/projected/a09c9451-dc2c-4369-962c-a4dc8cecf82b-kube-api-access-4d6tq\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.945138 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.944964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09c9451-dc2c-4369-962c-a4dc8cecf82b-openshift-service-ca\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.945138 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.945035 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a09c9451-dc2c-4369-962c-a4dc8cecf82b-maas-api-tls\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.945736 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.945714 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09c9451-dc2c-4369-962c-a4dc8cecf82b-openshift-service-ca\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.947559 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.947532 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a09c9451-dc2c-4369-962c-a4dc8cecf82b-maas-api-tls\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:31.953155 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:31.953130 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d6tq\" (UniqueName: \"kubernetes.io/projected/a09c9451-dc2c-4369-962c-a4dc8cecf82b-kube-api-access-4d6tq\") pod \"maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g\" (UID: \"a09c9451-dc2c-4369-962c-a4dc8cecf82b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:32.012494 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:32.012453 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:32.162618 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:32.162584 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g"] Jul 16 12:48:32.164682 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:48:32.164651 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09c9451_dc2c_4369_962c_a4dc8cecf82b.slice/crio-3e6615002d453e2868cd32385a4caf4dc3afcb7f405cb782d2499c264268bbbd WatchSource:0}: Error finding container 3e6615002d453e2868cd32385a4caf4dc3afcb7f405cb782d2499c264268bbbd: Status 404 returned error can't find the container with id 3e6615002d453e2868cd32385a4caf4dc3afcb7f405cb782d2499c264268bbbd Jul 16 12:48:32.721406 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:32.721356 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" event={"ID":"a09c9451-dc2c-4369-962c-a4dc8cecf82b","Type":"ContainerStarted","Data":"3e6615002d453e2868cd32385a4caf4dc3afcb7f405cb782d2499c264268bbbd"} Jul 16 12:48:35.740469 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:35.740431 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" event={"ID":"a09c9451-dc2c-4369-962c-a4dc8cecf82b","Type":"ContainerStarted","Data":"2adb7c6b376fa310901c6b20395008beec8ab8a2159b5e8c298045ab4e8ede26"} Jul 16 12:48:35.741008 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:35.740553 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:48:35.759869 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:35.759806 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" podStartSLOduration=2.252312451 podStartE2EDuration="4.75978623s" totalImagesPullingTime="2.507473779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:48:35.756840394 +0000 UTC m=+1710.609041223" watchObservedRunningTime="2026-07-16 12:48:35.75978623 +0000 UTC m=+1710.611987108" Jul 16 12:48:41.751949 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:48:41.751906 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g" Jul 16 12:50:05.805445 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:05.805414 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:50:05.809172 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:05.809140 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:50:05.812051 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:05.812025 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:50:05.815516 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:05.815496 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:50:15.232839 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.232797 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh"] Jul 16 12:50:15.237183 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.237156 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.239568 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.239534 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 12:50:15.239724 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.239619 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b2b0c9-openshift-default-dockercfg-qwmwl\"" Jul 16 12:50:15.249024 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.248997 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh"] Jul 16 12:50:15.410103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-socket\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.410103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410106 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-envoy\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.410401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgtm5\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-kube-api-access-pgtm5\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.410401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410203 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-certs\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.410401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410235 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-podinfo\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.410401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-credential-socket\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.410401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410306 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-data\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.410401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410343 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-token\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.410401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.410364 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istiod-ca-cert\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.511952 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.511819 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-token\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512181 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512147 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istiod-ca-cert\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512388 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512279 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-socket\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512487 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-envoy\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512487 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512456 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgtm5\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-kube-api-access-pgtm5\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512601 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512496 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-certs\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512601 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512523 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-podinfo\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512601 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512585 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-credential-socket\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512778 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512651 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-data\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.512862 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.512835 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-socket\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.513049 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.513027 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-certs\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.513353 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.513181 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istiod-ca-cert\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.513353 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.513303 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-credential-socket\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.513502 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.513469 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-data\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.515239 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.515216 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-envoy\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.515345 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.515328 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-podinfo\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.521574 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.521538 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-token\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.522251 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.522224 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgtm5\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-kube-api-access-pgtm5\") pod \"e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.550431 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.550394 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:15.704173 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.704135 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh"] Jul 16 12:50:15.707653 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:50:15.707618 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c80b050_8cc7_46eb_be3a_09aa33ea533f.slice/crio-1f89cb9906da36a1b4ff6e38f43be2225bf8da5bdb18c345a93856c4eb245fba WatchSource:0}: Error finding container 1f89cb9906da36a1b4ff6e38f43be2225bf8da5bdb18c345a93856c4eb245fba: Status 404 returned error can't find the container with id 1f89cb9906da36a1b4ff6e38f43be2225bf8da5bdb18c345a93856c4eb245fba Jul 16 12:50:15.709818 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.709780 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:50:15.709936 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.709853 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:50:15.709936 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:15.709898 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:50:16.285726 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:16.285687 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" event={"ID":"5c80b050-8cc7-46eb-be3a-09aa33ea533f","Type":"ContainerStarted","Data":"58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be"} Jul 16 12:50:16.286185 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:16.285744 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" event={"ID":"5c80b050-8cc7-46eb-be3a-09aa33ea533f","Type":"ContainerStarted","Data":"1f89cb9906da36a1b4ff6e38f43be2225bf8da5bdb18c345a93856c4eb245fba"} Jul 16 12:50:16.308024 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:16.307969 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" podStartSLOduration=1.3079472540000001 podStartE2EDuration="1.307947254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:50:16.306726381 +0000 UTC m=+1811.158927192" watchObservedRunningTime="2026-07-16 12:50:16.307947254 +0000 UTC m=+1811.160148070" Jul 16 12:50:16.551399 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:16.551289 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:16.557290 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:16.557255 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:17.291193 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:17.291155 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:17.292316 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:17.292297 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:31.381896 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:31.381853 2570 generic.go:356] "Generic (PLEG): container finished" podID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerID="58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be" exitCode=0 Jul 16 12:50:31.382351 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:31.381929 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" event={"ID":"5c80b050-8cc7-46eb-be3a-09aa33ea533f","Type":"ContainerDied","Data":"58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be"} Jul 16 12:50:31.382399 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:31.382351 2570 scope.go:117] "RemoveContainer" containerID="58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be" Jul 16 12:50:31.383436 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:31.383407 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:50:31.383508 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:31.383482 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:50:31.383554 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:31.383515 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:50:32.291651 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:32.291607 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:32.389141 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:32.389107 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" event={"ID":"5c80b050-8cc7-46eb-be3a-09aa33ea533f","Type":"ContainerStarted","Data":"4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53"} Jul 16 12:50:32.551337 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:32.551230 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:32.552509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:32.552484 2570 patch_prober.go:28] interesting pod/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 16 12:50:32.552571 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:32.552551 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 16 12:50:33.551038 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:33.550991 2570 patch_prober.go:28] interesting pod/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 16 12:50:33.551574 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:33.551051 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 16 12:50:34.550925 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:34.550849 2570 patch_prober.go:28] interesting pod/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 16 12:50:34.551132 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:34.550940 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 16 12:50:35.551249 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:35.551213 2570 patch_prober.go:28] interesting pod/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 16 12:50:35.551638 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:35.551273 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 16 12:50:36.555561 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:36.555518 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:36.556096 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:36.555848 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:50:36.556700 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:50:36.556676 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:52:12.900459 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:12.900415 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh"] Jul 16 12:52:12.901195 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:12.900641 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" containerID="cri-o://4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53" gracePeriod=30 Jul 16 12:52:18.171955 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.171860 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:52:18.277956 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.277870 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-socket\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278142 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.277976 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-data\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278142 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278019 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-podinfo\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278142 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278044 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-token\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278142 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278072 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-envoy\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278327 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278146 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:52:18.278327 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278193 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-credential-socket\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278327 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278242 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istiod-ca-cert\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278327 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278321 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgtm5\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-kube-api-access-pgtm5\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278536 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278346 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-certs\") pod \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\" (UID: \"5c80b050-8cc7-46eb-be3a-09aa33ea533f\") " Jul 16 12:52:18.278536 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278505 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:52:18.278699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278672 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-credential-socket\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.278699 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278682 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:52:18.278804 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278704 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-socket\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.278804 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278703 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:52:18.278983 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.278956 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:52:18.280437 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.280399 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:52:18.280623 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.280601 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-kube-api-access-pgtm5" (OuterVolumeSpecName: "kube-api-access-pgtm5") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "kube-api-access-pgtm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:52:18.280827 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.280804 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 12:52:18.280914 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.280807 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c80b050-8cc7-46eb-be3a-09aa33ea533f" (UID: "5c80b050-8cc7-46eb-be3a-09aa33ea533f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:52:18.379670 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.379625 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgtm5\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-kube-api-access-pgtm5\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.379670 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.379665 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-workload-certs\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.379670 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.379678 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-data\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.379971 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.379686 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-podinfo\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.379971 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.379695 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-token\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.379971 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.379703 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istio-envoy\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.379971 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.379711 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c80b050-8cc7-46eb-be3a-09aa33ea533f-istiod-ca-cert\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:52:18.967713 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.967677 2570 generic.go:356] "Generic (PLEG): container finished" podID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerID="4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53" exitCode=0 Jul 16 12:52:18.967950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.967741 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" Jul 16 12:52:18.967950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.967748 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" event={"ID":"5c80b050-8cc7-46eb-be3a-09aa33ea533f","Type":"ContainerDied","Data":"4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53"} Jul 16 12:52:18.967950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.967858 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh" event={"ID":"5c80b050-8cc7-46eb-be3a-09aa33ea533f","Type":"ContainerDied","Data":"1f89cb9906da36a1b4ff6e38f43be2225bf8da5bdb18c345a93856c4eb245fba"} Jul 16 12:52:18.967950 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.967905 2570 scope.go:117] "RemoveContainer" containerID="4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53" Jul 16 12:52:18.978488 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.978465 2570 scope.go:117] "RemoveContainer" containerID="58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be" Jul 16 12:52:18.988227 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.988194 2570 scope.go:117] "RemoveContainer" containerID="4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53" Jul 16 12:52:18.988554 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:52:18.988531 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53\": container with ID starting with 4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53 not found: ID does not exist" containerID="4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53" Jul 16 12:52:18.988631 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.988567 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53"} err="failed to get container status \"4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53\": rpc error: code = NotFound desc = could not find container \"4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53\": container with ID starting with 4b14637588db05badaf7a1765cd0ae3cba526a0dad8f0917f2433e036871fc53 not found: ID does not exist" Jul 16 12:52:18.988631 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.988588 2570 scope.go:117] "RemoveContainer" containerID="58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be" Jul 16 12:52:18.988859 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:52:18.988841 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be\": container with ID starting with 58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be not found: ID does not exist" containerID="58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be" Jul 16 12:52:18.988944 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.988865 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be"} err="failed to get container status \"58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be\": rpc error: code = NotFound desc = could not find container \"58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be\": container with ID starting with 58529d2285ee07606e4f25618a4082eb4c6dcae16b135cfcf5274d7af8b169be not found: ID does not exist" Jul 16 12:52:18.991952 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.991924 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh"] Jul 16 12:52:18.996124 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:18.996095 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b2b0c9-openshift-default-5bb786c599-fj4dh"] Jul 16 12:52:19.825989 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:19.825955 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" path="/var/lib/kubelet/pods/5c80b050-8cc7-46eb-be3a-09aa33ea533f/volumes" Jul 16 12:52:22.277870 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.277830 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9"] Jul 16 12:52:22.278435 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.278325 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" Jul 16 12:52:22.278435 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.278340 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" Jul 16 12:52:22.278435 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.278357 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" Jul 16 12:52:22.278435 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.278363 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" Jul 16 12:52:22.278435 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.278425 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" Jul 16 12:52:22.283371 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.283341 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.286012 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.285989 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-197335-openshift-default-dockercfg-48rmw\"" Jul 16 12:52:22.286163 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.285991 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 12:52:22.313218 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.313181 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9"] Jul 16 12:52:22.428116 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-certs\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.428340 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e924b860-c304-40de-ad1d-a757a6923321-istio-podinfo\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.428340 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428181 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-socket\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.428340 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428204 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e924b860-c304-40de-ad1d-a757a6923321-istiod-ca-cert\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.428340 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428285 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwkb\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-kube-api-access-5qwkb\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.428523 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428360 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-envoy\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.428523 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428397 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-istio-token\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.428523 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428428 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-credential-socket\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.428523 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.428499 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-data\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529457 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529353 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-data\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529457 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529429 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-certs\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529457 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e924b860-c304-40de-ad1d-a757a6923321-istio-podinfo\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529768 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529481 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-socket\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529768 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529500 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e924b860-c304-40de-ad1d-a757a6923321-istiod-ca-cert\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529768 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529536 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwkb\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-kube-api-access-5qwkb\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529768 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529641 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-envoy\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529768 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529698 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-istio-token\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.529768 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-credential-socket\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.530155 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.529867 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-data\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.530155 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.530004 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-socket\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.530155 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.530133 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-credential-socket\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.530347 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.530204 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-certs\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.530472 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.530448 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e924b860-c304-40de-ad1d-a757a6923321-istiod-ca-cert\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.532163 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.532140 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-envoy\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.532405 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.532371 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e924b860-c304-40de-ad1d-a757a6923321-istio-podinfo\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.538537 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.538494 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-istio-token\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.538679 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.538580 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwkb\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-kube-api-access-5qwkb\") pod \"e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.594265 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.594222 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:22.751992 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.751953 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9"] Jul 16 12:52:22.754367 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:52:22.754339 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode924b860_c304_40de_ad1d_a757a6923321.slice/crio-8b7ef056de6a698fd051d9ddd049563e2300292937928d3a33e95ff642668beb WatchSource:0}: Error finding container 8b7ef056de6a698fd051d9ddd049563e2300292937928d3a33e95ff642668beb: Status 404 returned error can't find the container with id 8b7ef056de6a698fd051d9ddd049563e2300292937928d3a33e95ff642668beb Jul 16 12:52:22.756505 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.756467 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:52:22.756615 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.756555 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:52:22.756615 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.756598 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:52:22.991495 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.991455 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" event={"ID":"e924b860-c304-40de-ad1d-a757a6923321","Type":"ContainerStarted","Data":"0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423"} Jul 16 12:52:22.991714 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:22.991521 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" event={"ID":"e924b860-c304-40de-ad1d-a757a6923321","Type":"ContainerStarted","Data":"8b7ef056de6a698fd051d9ddd049563e2300292937928d3a33e95ff642668beb"} Jul 16 12:52:23.010786 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:23.010722 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" podStartSLOduration=1.010701 podStartE2EDuration="1.010701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:52:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:52:23.010284938 +0000 UTC m=+1937.862485748" watchObservedRunningTime="2026-07-16 12:52:23.010701 +0000 UTC m=+1937.862901811" Jul 16 12:52:23.595045 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:23.595001 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:23.596805 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:23.596769 2570 patch_prober.go:28] interesting pod/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 16 12:52:23.596979 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:23.596822 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 16 12:52:24.065765 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.065670 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm"] Jul 16 12:52:24.066415 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.066378 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c80b050-8cc7-46eb-be3a-09aa33ea533f" containerName="istio-proxy" Jul 16 12:52:24.069702 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.069679 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.072232 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.072205 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-197335-serving-cert\"" Jul 16 12:52:24.082046 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.082019 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm"] Jul 16 12:52:24.246711 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.246657 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jqgp\" (UniqueName: \"kubernetes.io/projected/56af4062-2ae2-4d95-ba26-83ec9835b14f-kube-api-access-4jqgp\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.246932 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.246762 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56af4062-2ae2-4d95-ba26-83ec9835b14f-openshift-service-ca\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.246932 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.246826 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56af4062-2ae2-4d95-ba26-83ec9835b14f-maas-api-tls\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.347565 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.347529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56af4062-2ae2-4d95-ba26-83ec9835b14f-openshift-service-ca\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.347789 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.347588 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56af4062-2ae2-4d95-ba26-83ec9835b14f-maas-api-tls\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.347789 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.347653 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jqgp\" (UniqueName: \"kubernetes.io/projected/56af4062-2ae2-4d95-ba26-83ec9835b14f-kube-api-access-4jqgp\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.347789 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:52:24.347697 2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-197335-serving-cert: secret "maas-api-e2e-api-b-197335-serving-cert" not found Jul 16 12:52:24.347789 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:52:24.347779 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56af4062-2ae2-4d95-ba26-83ec9835b14f-maas-api-tls podName:56af4062-2ae2-4d95-ba26-83ec9835b14f nodeName:}" failed. No retries permitted until 2026-07-16 12:52:24.847754763 +0000 UTC m=+1939.699955559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/56af4062-2ae2-4d95-ba26-83ec9835b14f-maas-api-tls") pod "maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" (UID: "56af4062-2ae2-4d95-ba26-83ec9835b14f") : secret "maas-api-e2e-api-b-197335-serving-cert" not found Jul 16 12:52:24.348314 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.348290 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56af4062-2ae2-4d95-ba26-83ec9835b14f-openshift-service-ca\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.357718 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.357680 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jqgp\" (UniqueName: \"kubernetes.io/projected/56af4062-2ae2-4d95-ba26-83ec9835b14f-kube-api-access-4jqgp\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.598818 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.598730 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:24.853401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.853292 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56af4062-2ae2-4d95-ba26-83ec9835b14f-maas-api-tls\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.855914 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.855860 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56af4062-2ae2-4d95-ba26-83ec9835b14f-maas-api-tls\") pod \"maas-api-e2e-api-b-197335-6d857c49bc-fl4gm\" (UID: \"56af4062-2ae2-4d95-ba26-83ec9835b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:24.986635 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:24.986593 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:25.003431 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:25.003398 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:25.005082 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:25.005052 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:25.155428 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:25.155400 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm"] Jul 16 12:52:25.157638 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:52:25.157609 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56af4062_2ae2_4d95_ba26_83ec9835b14f.slice/crio-c61e770a0339f0c490d758e2e9acfd76bc92ad2251ad77c9fab03203571e69dc WatchSource:0}: Error finding container c61e770a0339f0c490d758e2e9acfd76bc92ad2251ad77c9fab03203571e69dc: Status 404 returned error can't find the container with id c61e770a0339f0c490d758e2e9acfd76bc92ad2251ad77c9fab03203571e69dc Jul 16 12:52:25.159207 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:25.159186 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:52:26.010048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:26.010007 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" event={"ID":"56af4062-2ae2-4d95-ba26-83ec9835b14f","Type":"ContainerStarted","Data":"740922e074333a65a70ef3ab31e6875368546de68f69f67ca334ebe1596d1e37"} Jul 16 12:52:26.010493 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:26.010079 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" event={"ID":"56af4062-2ae2-4d95-ba26-83ec9835b14f","Type":"ContainerStarted","Data":"c61e770a0339f0c490d758e2e9acfd76bc92ad2251ad77c9fab03203571e69dc"} Jul 16 12:52:26.010493 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:26.010252 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:26.029845 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:26.029786 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" podStartSLOduration=1.635997824 podStartE2EDuration="2.029767836s" totalImagesPullingTime="393.770012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:52:26.027892725 +0000 UTC m=+1940.880093531" watchObservedRunningTime="2026-07-16 12:52:26.029767836 +0000 UTC m=+1940.881968647" Jul 16 12:52:32.029603 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:32.029567 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-197335-6d857c49bc-fl4gm" Jul 16 12:52:37.093745 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:37.093706 2570 generic.go:356] "Generic (PLEG): container finished" podID="e924b860-c304-40de-ad1d-a757a6923321" containerID="0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423" exitCode=0 Jul 16 12:52:37.094403 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:37.093785 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" event={"ID":"e924b860-c304-40de-ad1d-a757a6923321","Type":"ContainerDied","Data":"0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423"} Jul 16 12:52:37.094485 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:37.094425 2570 scope.go:117] "RemoveContainer" containerID="0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423" Jul 16 12:52:37.095607 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:37.095579 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:52:37.095683 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:37.095662 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:52:37.095719 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:37.095693 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:52:38.101085 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:38.101045 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" event={"ID":"e924b860-c304-40de-ad1d-a757a6923321","Type":"ContainerStarted","Data":"fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210"} Jul 16 12:52:38.594475 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:38.594426 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:38.596005 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:38.595971 2570 patch_prober.go:28] interesting pod/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 16 12:52:38.596146 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:38.596028 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 16 12:52:39.594939 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:39.594896 2570 patch_prober.go:28] interesting pod/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 16 12:52:39.595364 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:39.594979 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 16 12:52:40.003916 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:40.003794 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:40.595477 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:40.595437 2570 patch_prober.go:28] interesting pod/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 16 12:52:40.595918 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:40.595498 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 16 12:52:41.594911 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:41.594855 2570 patch_prober.go:28] interesting pod/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 16 12:52:41.595115 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:41.594935 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 16 12:52:42.599981 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:42.599949 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:52:42.600990 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:52:42.600969 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:53:03.891535 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:03.891447 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9"] Jul 16 12:53:03.892103 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:03.891670 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" containerID="cri-o://fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210" gracePeriod=30 Jul 16 12:53:09.166420 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.166350 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:53:09.276102 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.276065 2570 generic.go:356] "Generic (PLEG): container finished" podID="e924b860-c304-40de-ad1d-a757a6923321" containerID="fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210" exitCode=0 Jul 16 12:53:09.276317 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.276121 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" Jul 16 12:53:09.276317 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.276149 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" event={"ID":"e924b860-c304-40de-ad1d-a757a6923321","Type":"ContainerDied","Data":"fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210"} Jul 16 12:53:09.276317 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.276216 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9" event={"ID":"e924b860-c304-40de-ad1d-a757a6923321","Type":"ContainerDied","Data":"8b7ef056de6a698fd051d9ddd049563e2300292937928d3a33e95ff642668beb"} Jul 16 12:53:09.276317 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.276249 2570 scope.go:117] "RemoveContainer" containerID="fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210" Jul 16 12:53:09.285520 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.285498 2570 scope.go:117] "RemoveContainer" containerID="0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423" Jul 16 12:53:09.286618 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.286589 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qwkb\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-kube-api-access-5qwkb\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.286685 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.286635 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-envoy\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.286735 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.286690 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-certs\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.286735 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.286719 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-istio-token\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.286834 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.286796 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e924b860-c304-40de-ad1d-a757a6923321-istio-podinfo\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.286834 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.286821 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-data\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.287040 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.287014 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e924b860-c304-40de-ad1d-a757a6923321-istiod-ca-cert\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.287107 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.287032 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:53:09.287107 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.287058 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-credential-socket\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.287107 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.287089 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-socket\") pod \"e924b860-c304-40de-ad1d-a757a6923321\" (UID: \"e924b860-c304-40de-ad1d-a757a6923321\") " Jul 16 12:53:09.287504 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.287455 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:53:09.287504 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.287464 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-certs\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.287504 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.287480 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:53:09.287744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.287508 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e924b860-c304-40de-ad1d-a757a6923321-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:53:09.288427 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.288400 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-data" (OuterVolumeSpecName: "istio-data") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:53:09.289367 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.289339 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-kube-api-access-5qwkb" (OuterVolumeSpecName: "kube-api-access-5qwkb") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "kube-api-access-5qwkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:53:09.289367 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.289348 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e924b860-c304-40de-ad1d-a757a6923321-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 12:53:09.289500 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.289428 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:53:09.289623 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.289607 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-istio-token" (OuterVolumeSpecName: "istio-token") pod "e924b860-c304-40de-ad1d-a757a6923321" (UID: "e924b860-c304-40de-ad1d-a757a6923321"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:53:09.311092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.311064 2570 scope.go:117] "RemoveContainer" containerID="fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210" Jul 16 12:53:09.311438 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:53:09.311412 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210\": container with ID starting with fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210 not found: ID does not exist" containerID="fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210" Jul 16 12:53:09.311509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.311450 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210"} err="failed to get container status \"fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210\": rpc error: code = NotFound desc = could not find container \"fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210\": container with ID starting with fe26b1daad48bb0273f2fa289fefb557918b44a0dca2334889d0434e019d4210 not found: ID does not exist" Jul 16 12:53:09.311509 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.311471 2570 scope.go:117] "RemoveContainer" containerID="0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423" Jul 16 12:53:09.311775 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:53:09.311756 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423\": container with ID starting with 0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423 not found: ID does not exist" containerID="0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423" Jul 16 12:53:09.311816 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.311783 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423"} err="failed to get container status \"0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423\": rpc error: code = NotFound desc = could not find container \"0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423\": container with ID starting with 0c0a6581ae6e12059111d55ada573ce305b4094b92a2400e0199e1c6a541a423 not found: ID does not exist" Jul 16 12:53:09.388388 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.388342 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qwkb\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-kube-api-access-5qwkb\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.388388 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.388376 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-envoy\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.388388 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.388385 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e924b860-c304-40de-ad1d-a757a6923321-istio-token\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.388388 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.388394 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e924b860-c304-40de-ad1d-a757a6923321-istio-podinfo\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.388388 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.388401 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-istio-data\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.388808 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.388409 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e924b860-c304-40de-ad1d-a757a6923321-istiod-ca-cert\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.388808 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.388418 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-credential-socket\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.388808 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.388426 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e924b860-c304-40de-ad1d-a757a6923321-workload-socket\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:53:09.604957 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.604921 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9"] Jul 16 12:53:09.610761 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.610726 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-197335-openshift-default-5cffcf86c7-7g2l9"] Jul 16 12:53:09.824850 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:09.824814 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e924b860-c304-40de-ad1d-a757a6923321" path="/var/lib/kubelet/pods/e924b860-c304-40de-ad1d-a757a6923321/volumes" Jul 16 12:53:13.432508 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.432473 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8"] Jul 16 12:53:13.433057 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.432947 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" Jul 16 12:53:13.433057 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.432960 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" Jul 16 12:53:13.433057 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.432979 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" Jul 16 12:53:13.433057 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.432985 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" Jul 16 12:53:13.433057 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.433059 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" Jul 16 12:53:13.433335 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.433070 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e924b860-c304-40de-ad1d-a757a6923321" containerName="istio-proxy" Jul 16 12:53:13.437896 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.437859 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.440424 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.440397 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 12:53:13.440559 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.440443 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-293c75-openshift-default-dockercfg-knkz9\"" Jul 16 12:53:13.447975 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.447945 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8"] Jul 16 12:53:13.527528 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527485 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-token\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.527744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527563 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-socket\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.527744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527588 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-credential-socket\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.527744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-data\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.527744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-podinfo\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.527744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-certs\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.527744 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527720 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkp76\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-kube-api-access-rkp76\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.528090 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-envoy\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.528090 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.527803 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istiod-ca-cert\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.628785 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.628744 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-socket\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.628785 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.628788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-credential-socket\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.628812 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-data\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.628835 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-podinfo\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.628860 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-certs\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.628911 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkp76\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-kube-api-access-rkp76\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.628942 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-envoy\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.628987 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istiod-ca-cert\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629092 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.629068 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-token\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629425 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.629226 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-socket\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629425 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.629237 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-data\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629572 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.629548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-credential-socket\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629671 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.629642 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-certs\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.629921 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.629892 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istiod-ca-cert\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.631542 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.631518 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-podinfo\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.631616 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.631563 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-envoy\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.638349 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.638315 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-token\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.638502 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.638328 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkp76\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-kube-api-access-rkp76\") pod \"e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.751447 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.751358 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:13.907790 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.907748 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8"] Jul 16 12:53:13.910022 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:53:13.909984 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5cc89f6_ec0e_4872_b7c2_bba60293576b.slice/crio-8392be092966b4a1954e29ac9ddd2e4a6cee8481683e6af141577fcf6daa7342 WatchSource:0}: Error finding container 8392be092966b4a1954e29ac9ddd2e4a6cee8481683e6af141577fcf6daa7342: Status 404 returned error can't find the container with id 8392be092966b4a1954e29ac9ddd2e4a6cee8481683e6af141577fcf6daa7342 Jul 16 12:53:13.912497 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.912461 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:53:13.912593 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.912537 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:53:13.912593 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:13.912570 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:53:14.304717 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:14.304670 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" event={"ID":"e5cc89f6-ec0e-4872-b7c2-bba60293576b","Type":"ContainerStarted","Data":"23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d"} Jul 16 12:53:14.304953 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:14.304739 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" event={"ID":"e5cc89f6-ec0e-4872-b7c2-bba60293576b","Type":"ContainerStarted","Data":"8392be092966b4a1954e29ac9ddd2e4a6cee8481683e6af141577fcf6daa7342"} Jul 16 12:53:14.327386 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:14.327334 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" podStartSLOduration=1.327314598 podStartE2EDuration="1.327314598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:53:14.327003361 +0000 UTC m=+1989.179204173" watchObservedRunningTime="2026-07-16 12:53:14.327314598 +0000 UTC m=+1989.179515403" Jul 16 12:53:14.751971 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:14.751927 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:14.757728 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:14.757697 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:15.310129 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:15.310097 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:15.311193 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:15.311165 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:33.405370 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:33.405329 2570 generic.go:356] "Generic (PLEG): container finished" podID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerID="23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d" exitCode=0 Jul 16 12:53:33.405951 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:33.405410 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" event={"ID":"e5cc89f6-ec0e-4872-b7c2-bba60293576b","Type":"ContainerDied","Data":"23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d"} Jul 16 12:53:33.406043 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:33.406022 2570 scope.go:117] "RemoveContainer" containerID="23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d" Jul 16 12:53:33.407235 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:33.407202 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:53:33.407357 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:33.407299 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:53:33.407357 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:33.407349 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:53:34.412549 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:34.412511 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" event={"ID":"e5cc89f6-ec0e-4872-b7c2-bba60293576b","Type":"ContainerStarted","Data":"407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06"} Jul 16 12:53:34.752150 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:34.752044 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:34.752324 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:34.752300 2570 patch_prober.go:28] interesting pod/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 16 12:53:34.752378 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:34.752355 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 16 12:53:35.752202 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:35.752168 2570 patch_prober.go:28] interesting pod/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 16 12:53:35.752686 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:35.752247 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 16 12:53:36.751921 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:36.751862 2570 patch_prober.go:28] interesting pod/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 16 12:53:36.752146 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:36.751942 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 16 12:53:37.752320 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:37.752279 2570 patch_prober.go:28] interesting pod/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 16 12:53:37.752852 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:37.752351 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 16 12:53:38.756830 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:38.756795 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:38.757391 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:38.757095 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:53:38.757986 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:53:38.757967 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:55:05.848090 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:55:05.848061 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:55:05.852033 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:55:05.851998 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:55:05.855176 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:55:05.855152 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 12:55:05.858451 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:55:05.858429 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 12:59:14.639993 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:14.639871 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7342-140363006282672"] Jul 16 12:59:14.643647 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:14.643615 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363006282672" Jul 16 12:59:14.646353 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:14.646329 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hrwbx\"" Jul 16 12:59:14.650892 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:14.650846 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363006282672"] Jul 16 12:59:14.670110 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:14.670069 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgzrp\" (UniqueName: \"kubernetes.io/projected/fabcce6f-d143-4c64-9b74-7d5511efda67-kube-api-access-qgzrp\") pod \"test-curl-7342-140363006282672\" (UID: \"fabcce6f-d143-4c64-9b74-7d5511efda67\") " pod="opendatahub/test-curl-7342-140363006282672" Jul 16 12:59:14.771220 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:14.771177 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgzrp\" (UniqueName: \"kubernetes.io/projected/fabcce6f-d143-4c64-9b74-7d5511efda67-kube-api-access-qgzrp\") pod \"test-curl-7342-140363006282672\" (UID: \"fabcce6f-d143-4c64-9b74-7d5511efda67\") " pod="opendatahub/test-curl-7342-140363006282672" Jul 16 12:59:14.789895 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:14.789832 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgzrp\" (UniqueName: \"kubernetes.io/projected/fabcce6f-d143-4c64-9b74-7d5511efda67-kube-api-access-qgzrp\") pod \"test-curl-7342-140363006282672\" (UID: \"fabcce6f-d143-4c64-9b74-7d5511efda67\") " pod="opendatahub/test-curl-7342-140363006282672" Jul 16 12:59:14.955051 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:14.954940 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363006282672" Jul 16 12:59:15.105507 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:15.105456 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363006282672"] Jul 16 12:59:15.107923 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:59:15.107890 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfabcce6f_d143_4c64_9b74_7d5511efda67.slice/crio-c9b1e793107c65dd898c1d9b88f827c6318d25501e8ba0b1a4013589e08c4cb7 WatchSource:0}: Error finding container c9b1e793107c65dd898c1d9b88f827c6318d25501e8ba0b1a4013589e08c4cb7: Status 404 returned error can't find the container with id c9b1e793107c65dd898c1d9b88f827c6318d25501e8ba0b1a4013589e08c4cb7 Jul 16 12:59:15.109204 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:15.109184 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:59:15.263222 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:15.263125 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363006282672" event={"ID":"fabcce6f-d143-4c64-9b74-7d5511efda67","Type":"ContainerStarted","Data":"c9b1e793107c65dd898c1d9b88f827c6318d25501e8ba0b1a4013589e08c4cb7"} Jul 16 12:59:16.270653 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:16.270615 2570 generic.go:356] "Generic (PLEG): container finished" podID="fabcce6f-d143-4c64-9b74-7d5511efda67" containerID="f0421449dff6764e2596b2f05a8be367a9547fcd6ca484519cbe6c8a0cafca31" exitCode=0 Jul 16 12:59:16.271156 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:16.270702 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363006282672" event={"ID":"fabcce6f-d143-4c64-9b74-7d5511efda67","Type":"ContainerDied","Data":"f0421449dff6764e2596b2f05a8be367a9547fcd6ca484519cbe6c8a0cafca31"} Jul 16 12:59:17.442505 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.442474 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363006282672" Jul 16 12:59:17.478361 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.478327 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7342-140363006282672_fabcce6f-d143-4c64-9b74-7d5511efda67/test-curl-7342-140363006282672/0.log" Jul 16 12:59:17.499225 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.499190 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgzrp\" (UniqueName: \"kubernetes.io/projected/fabcce6f-d143-4c64-9b74-7d5511efda67-kube-api-access-qgzrp\") pod \"fabcce6f-d143-4c64-9b74-7d5511efda67\" (UID: \"fabcce6f-d143-4c64-9b74-7d5511efda67\") " Jul 16 12:59:17.501528 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.501491 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabcce6f-d143-4c64-9b74-7d5511efda67-kube-api-access-qgzrp" (OuterVolumeSpecName: "kube-api-access-qgzrp") pod "fabcce6f-d143-4c64-9b74-7d5511efda67" (UID: "fabcce6f-d143-4c64-9b74-7d5511efda67"). InnerVolumeSpecName "kube-api-access-qgzrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:59:17.504212 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.504184 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7342-140363006282672"] Jul 16 12:59:17.508017 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.507993 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7342-140363006282672"] Jul 16 12:59:17.600115 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.600071 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgzrp\" (UniqueName: \"kubernetes.io/projected/fabcce6f-d143-4c64-9b74-7d5511efda67-kube-api-access-qgzrp\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:17.628250 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.628209 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7342-140363006264880"] Jul 16 12:59:17.628750 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.628721 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabcce6f-d143-4c64-9b74-7d5511efda67" containerName="test-curl-7342-140363006282672" Jul 16 12:59:17.628750 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.628747 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabcce6f-d143-4c64-9b74-7d5511efda67" containerName="test-curl-7342-140363006282672" Jul 16 12:59:17.628941 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.628892 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fabcce6f-d143-4c64-9b74-7d5511efda67" containerName="test-curl-7342-140363006282672" Jul 16 12:59:17.632080 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.632061 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363006264880" Jul 16 12:59:17.639543 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.639516 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363006264880"] Jul 16 12:59:17.700853 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.700811 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxvx\" (UniqueName: \"kubernetes.io/projected/703b5886-5636-47cb-8064-da3ca01024e0-kube-api-access-mrxvx\") pod \"test-curl-7342-140363006264880\" (UID: \"703b5886-5636-47cb-8064-da3ca01024e0\") " pod="opendatahub/test-curl-7342-140363006264880" Jul 16 12:59:17.801468 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.801416 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxvx\" (UniqueName: \"kubernetes.io/projected/703b5886-5636-47cb-8064-da3ca01024e0-kube-api-access-mrxvx\") pod \"test-curl-7342-140363006264880\" (UID: \"703b5886-5636-47cb-8064-da3ca01024e0\") " pod="opendatahub/test-curl-7342-140363006264880" Jul 16 12:59:17.811487 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.811455 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxvx\" (UniqueName: \"kubernetes.io/projected/703b5886-5636-47cb-8064-da3ca01024e0-kube-api-access-mrxvx\") pod \"test-curl-7342-140363006264880\" (UID: \"703b5886-5636-47cb-8064-da3ca01024e0\") " pod="opendatahub/test-curl-7342-140363006264880" Jul 16 12:59:17.826192 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.826158 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fabcce6f-d143-4c64-9b74-7d5511efda67" path="/var/lib/kubelet/pods/fabcce6f-d143-4c64-9b74-7d5511efda67/volumes" Jul 16 12:59:17.942476 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:17.942387 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363006264880" Jul 16 12:59:18.088177 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:18.088151 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363006264880"] Jul 16 12:59:18.090306 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:59:18.090275 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod703b5886_5636_47cb_8064_da3ca01024e0.slice/crio-ca4d5f7138aacc9702d8e6570d81fcf05f6f171f011c1044d5b3ffff60522a6b WatchSource:0}: Error finding container ca4d5f7138aacc9702d8e6570d81fcf05f6f171f011c1044d5b3ffff60522a6b: Status 404 returned error can't find the container with id ca4d5f7138aacc9702d8e6570d81fcf05f6f171f011c1044d5b3ffff60522a6b Jul 16 12:59:18.283020 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:18.282915 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363006264880" event={"ID":"703b5886-5636-47cb-8064-da3ca01024e0","Type":"ContainerStarted","Data":"ca4d5f7138aacc9702d8e6570d81fcf05f6f171f011c1044d5b3ffff60522a6b"} Jul 16 12:59:18.284250 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:18.284228 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363006282672" Jul 16 12:59:18.284411 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:18.284228 2570 scope.go:117] "RemoveContainer" containerID="f0421449dff6764e2596b2f05a8be367a9547fcd6ca484519cbe6c8a0cafca31" Jul 16 12:59:19.290703 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:19.290662 2570 generic.go:356] "Generic (PLEG): container finished" podID="703b5886-5636-47cb-8064-da3ca01024e0" containerID="eae0dfd8700304dfbce74d2127985a9747fd7d9a8301a363aec572c7b0ac4022" exitCode=0 Jul 16 12:59:19.291214 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:19.290752 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363006264880" event={"ID":"703b5886-5636-47cb-8064-da3ca01024e0","Type":"ContainerDied","Data":"eae0dfd8700304dfbce74d2127985a9747fd7d9a8301a363aec572c7b0ac4022"} Jul 16 12:59:20.446527 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.446498 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363006264880" Jul 16 12:59:20.474419 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.474388 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7342-140363006264880_703b5886-5636-47cb-8064-da3ca01024e0/test-curl-7342-140363006264880/0.log" Jul 16 12:59:20.500237 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.500196 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7342-140363006264880"] Jul 16 12:59:20.507845 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.507814 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7342-140363006264880"] Jul 16 12:59:20.531033 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.530995 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrxvx\" (UniqueName: \"kubernetes.io/projected/703b5886-5636-47cb-8064-da3ca01024e0-kube-api-access-mrxvx\") pod \"703b5886-5636-47cb-8064-da3ca01024e0\" (UID: \"703b5886-5636-47cb-8064-da3ca01024e0\") " Jul 16 12:59:20.533219 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.533195 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/703b5886-5636-47cb-8064-da3ca01024e0-kube-api-access-mrxvx" (OuterVolumeSpecName: "kube-api-access-mrxvx") pod "703b5886-5636-47cb-8064-da3ca01024e0" (UID: "703b5886-5636-47cb-8064-da3ca01024e0"). InnerVolumeSpecName "kube-api-access-mrxvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:59:20.632395 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.632345 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrxvx\" (UniqueName: \"kubernetes.io/projected/703b5886-5636-47cb-8064-da3ca01024e0-kube-api-access-mrxvx\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:20.670850 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.670807 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:20.671324 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.671310 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="703b5886-5636-47cb-8064-da3ca01024e0" containerName="test-curl-7342-140363006264880" Jul 16 12:59:20.671381 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.671326 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="703b5886-5636-47cb-8064-da3ca01024e0" containerName="test-curl-7342-140363006264880" Jul 16 12:59:20.671420 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.671406 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="703b5886-5636-47cb-8064-da3ca01024e0" containerName="test-curl-7342-140363006264880" Jul 16 12:59:20.674624 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.674604 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:20.684053 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.684017 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:20.733145 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.733102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrc2\" (UniqueName: \"kubernetes.io/projected/8ed4cc38-66d6-4137-9583-95843cdfb8e9-kube-api-access-msrc2\") pod \"test-curl-7342-140363004445584\" (UID: \"8ed4cc38-66d6-4137-9583-95843cdfb8e9\") " pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:20.834283 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.834235 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msrc2\" (UniqueName: \"kubernetes.io/projected/8ed4cc38-66d6-4137-9583-95843cdfb8e9-kube-api-access-msrc2\") pod \"test-curl-7342-140363004445584\" (UID: \"8ed4cc38-66d6-4137-9583-95843cdfb8e9\") " pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:20.842985 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.842957 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrc2\" (UniqueName: \"kubernetes.io/projected/8ed4cc38-66d6-4137-9583-95843cdfb8e9-kube-api-access-msrc2\") pod \"test-curl-7342-140363004445584\" (UID: \"8ed4cc38-66d6-4137-9583-95843cdfb8e9\") " pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:20.984784 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:20.984685 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:21.155330 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:21.155301 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:21.157672 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:59:21.157641 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ed4cc38_66d6_4137_9583_95843cdfb8e9.slice/crio-5509c3ea0f4341131bd66b405fc9e13e2d126f2fbab6b30da322b8121114051c WatchSource:0}: Error finding container 5509c3ea0f4341131bd66b405fc9e13e2d126f2fbab6b30da322b8121114051c: Status 404 returned error can't find the container with id 5509c3ea0f4341131bd66b405fc9e13e2d126f2fbab6b30da322b8121114051c Jul 16 12:59:21.304247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:21.304155 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363006264880" Jul 16 12:59:21.304247 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:21.304164 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca4d5f7138aacc9702d8e6570d81fcf05f6f171f011c1044d5b3ffff60522a6b" Jul 16 12:59:21.305551 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:21.305519 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363004445584" event={"ID":"8ed4cc38-66d6-4137-9583-95843cdfb8e9","Type":"ContainerStarted","Data":"5509c3ea0f4341131bd66b405fc9e13e2d126f2fbab6b30da322b8121114051c"} Jul 16 12:59:21.315269 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:59:21.315237 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7342-140363006264880\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="703b5886-5636-47cb-8064-da3ca01024e0" pod="opendatahub/test-curl-7342-140363006264880" Jul 16 12:59:21.826978 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:21.826930 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="703b5886-5636-47cb-8064-da3ca01024e0" path="/var/lib/kubelet/pods/703b5886-5636-47cb-8064-da3ca01024e0/volumes" Jul 16 12:59:22.312924 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:22.312811 2570 generic.go:356] "Generic (PLEG): container finished" podID="8ed4cc38-66d6-4137-9583-95843cdfb8e9" containerID="caaaf5bcbc4d2c12d9a9ebb3b618a8f07254ddda09bc8fc3c47e4e4979c63daa" exitCode=0 Jul 16 12:59:22.312924 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:22.312910 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363004445584" event={"ID":"8ed4cc38-66d6-4137-9583-95843cdfb8e9","Type":"ContainerDied","Data":"caaaf5bcbc4d2c12d9a9ebb3b618a8f07254ddda09bc8fc3c47e4e4979c63daa"} Jul 16 12:59:23.469682 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.469657 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:23.494186 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.494153 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7342-140363004445584_8ed4cc38-66d6-4137-9583-95843cdfb8e9/test-curl-7342-140363004445584/0.log" Jul 16 12:59:23.522449 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.522405 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:23.527071 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.527034 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:23.563137 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.563096 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msrc2\" (UniqueName: \"kubernetes.io/projected/8ed4cc38-66d6-4137-9583-95843cdfb8e9-kube-api-access-msrc2\") pod \"8ed4cc38-66d6-4137-9583-95843cdfb8e9\" (UID: \"8ed4cc38-66d6-4137-9583-95843cdfb8e9\") " Jul 16 12:59:23.565434 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.565403 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed4cc38-66d6-4137-9583-95843cdfb8e9-kube-api-access-msrc2" (OuterVolumeSpecName: "kube-api-access-msrc2") pod "8ed4cc38-66d6-4137-9583-95843cdfb8e9" (UID: "8ed4cc38-66d6-4137-9583-95843cdfb8e9"). InnerVolumeSpecName "kube-api-access-msrc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:59:23.647114 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.647077 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:23.647534 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.647520 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed4cc38-66d6-4137-9583-95843cdfb8e9" containerName="test-curl-7342-140363004445584" Jul 16 12:59:23.647579 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.647535 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed4cc38-66d6-4137-9583-95843cdfb8e9" containerName="test-curl-7342-140363004445584" Jul 16 12:59:23.647623 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.647613 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed4cc38-66d6-4137-9583-95843cdfb8e9" containerName="test-curl-7342-140363004445584" Jul 16 12:59:23.650809 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.650792 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:23.655106 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.655076 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:23.664221 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.664189 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msrc2\" (UniqueName: \"kubernetes.io/projected/8ed4cc38-66d6-4137-9583-95843cdfb8e9-kube-api-access-msrc2\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:23.764780 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.764743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w56h9\" (UniqueName: \"kubernetes.io/projected/35bb29e3-dc46-48e5-ab4b-df9090625d2a-kube-api-access-w56h9\") pod \"test-curl-7342-140363004445584\" (UID: \"35bb29e3-dc46-48e5-ab4b-df9090625d2a\") " pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:23.832494 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.832383 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ed4cc38-66d6-4137-9583-95843cdfb8e9" path="/var/lib/kubelet/pods/8ed4cc38-66d6-4137-9583-95843cdfb8e9/volumes" Jul 16 12:59:23.866476 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.866436 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w56h9\" (UniqueName: \"kubernetes.io/projected/35bb29e3-dc46-48e5-ab4b-df9090625d2a-kube-api-access-w56h9\") pod \"test-curl-7342-140363004445584\" (UID: \"35bb29e3-dc46-48e5-ab4b-df9090625d2a\") " pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:23.877803 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.877771 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w56h9\" (UniqueName: \"kubernetes.io/projected/35bb29e3-dc46-48e5-ab4b-df9090625d2a-kube-api-access-w56h9\") pod \"test-curl-7342-140363004445584\" (UID: \"35bb29e3-dc46-48e5-ab4b-df9090625d2a\") " pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:23.962684 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:23.962642 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:24.140048 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:24.140018 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:24.141989 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:59:24.141961 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35bb29e3_dc46_48e5_ab4b_df9090625d2a.slice/crio-10b11a5cfe1afdc27a0b17dd7f1361b253ff6cd91fbd1d9a9ec2df37c519c8de WatchSource:0}: Error finding container 10b11a5cfe1afdc27a0b17dd7f1361b253ff6cd91fbd1d9a9ec2df37c519c8de: Status 404 returned error can't find the container with id 10b11a5cfe1afdc27a0b17dd7f1361b253ff6cd91fbd1d9a9ec2df37c519c8de Jul 16 12:59:24.324583 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:24.324545 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:24.324583 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:24.324570 2570 scope.go:117] "RemoveContainer" containerID="caaaf5bcbc4d2c12d9a9ebb3b618a8f07254ddda09bc8fc3c47e4e4979c63daa" Jul 16 12:59:24.326160 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:24.326126 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363004445584" event={"ID":"35bb29e3-dc46-48e5-ab4b-df9090625d2a","Type":"ContainerStarted","Data":"10b11a5cfe1afdc27a0b17dd7f1361b253ff6cd91fbd1d9a9ec2df37c519c8de"} Jul 16 12:59:25.334138 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:25.334096 2570 generic.go:356] "Generic (PLEG): container finished" podID="35bb29e3-dc46-48e5-ab4b-df9090625d2a" containerID="7d5efcd067560e388a3a8d73ff5c6dd3fd462458cd0b5f9eff4301919c63fa13" exitCode=0 Jul 16 12:59:25.334615 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:25.334185 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363004445584" event={"ID":"35bb29e3-dc46-48e5-ab4b-df9090625d2a","Type":"ContainerDied","Data":"7d5efcd067560e388a3a8d73ff5c6dd3fd462458cd0b5f9eff4301919c63fa13"} Jul 16 12:59:26.489610 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.489579 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:26.514009 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.513979 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7342-140363004445584_35bb29e3-dc46-48e5-ab4b-df9090625d2a/test-curl-7342-140363004445584/0.log" Jul 16 12:59:26.539785 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.539754 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:26.546038 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.546005 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7342-140363004445584"] Jul 16 12:59:26.589045 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.589010 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w56h9\" (UniqueName: \"kubernetes.io/projected/35bb29e3-dc46-48e5-ab4b-df9090625d2a-kube-api-access-w56h9\") pod \"35bb29e3-dc46-48e5-ab4b-df9090625d2a\" (UID: \"35bb29e3-dc46-48e5-ab4b-df9090625d2a\") " Jul 16 12:59:26.591317 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.591242 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35bb29e3-dc46-48e5-ab4b-df9090625d2a-kube-api-access-w56h9" (OuterVolumeSpecName: "kube-api-access-w56h9") pod "35bb29e3-dc46-48e5-ab4b-df9090625d2a" (UID: "35bb29e3-dc46-48e5-ab4b-df9090625d2a"). InnerVolumeSpecName "kube-api-access-w56h9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:59:26.671379 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.671338 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7342-140363002466928"] Jul 16 12:59:26.671939 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.671915 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35bb29e3-dc46-48e5-ab4b-df9090625d2a" containerName="test-curl-7342-140363004445584" Jul 16 12:59:26.672027 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.671943 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="35bb29e3-dc46-48e5-ab4b-df9090625d2a" containerName="test-curl-7342-140363004445584" Jul 16 12:59:26.672081 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.672071 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="35bb29e3-dc46-48e5-ab4b-df9090625d2a" containerName="test-curl-7342-140363004445584" Jul 16 12:59:26.675160 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.675140 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363002466928" Jul 16 12:59:26.683601 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.683578 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363002466928"] Jul 16 12:59:26.689854 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.689829 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w56h9\" (UniqueName: \"kubernetes.io/projected/35bb29e3-dc46-48e5-ab4b-df9090625d2a-kube-api-access-w56h9\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:26.790953 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.790911 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkzcp\" (UniqueName: \"kubernetes.io/projected/8a6e6ddc-481a-4bcc-991c-e17a8a8361ac-kube-api-access-zkzcp\") pod \"test-curl-7342-140363002466928\" (UID: \"8a6e6ddc-481a-4bcc-991c-e17a8a8361ac\") " pod="opendatahub/test-curl-7342-140363002466928" Jul 16 12:59:26.891611 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.891502 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkzcp\" (UniqueName: \"kubernetes.io/projected/8a6e6ddc-481a-4bcc-991c-e17a8a8361ac-kube-api-access-zkzcp\") pod \"test-curl-7342-140363002466928\" (UID: \"8a6e6ddc-481a-4bcc-991c-e17a8a8361ac\") " pod="opendatahub/test-curl-7342-140363002466928" Jul 16 12:59:26.900391 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.900357 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkzcp\" (UniqueName: \"kubernetes.io/projected/8a6e6ddc-481a-4bcc-991c-e17a8a8361ac-kube-api-access-zkzcp\") pod \"test-curl-7342-140363002466928\" (UID: \"8a6e6ddc-481a-4bcc-991c-e17a8a8361ac\") " pod="opendatahub/test-curl-7342-140363002466928" Jul 16 12:59:26.985762 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:26.985723 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363002466928" Jul 16 12:59:27.142386 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:27.142359 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363002466928"] Jul 16 12:59:27.144408 ip-10-0-137-10 kubenswrapper[2570]: W0716 12:59:27.144382 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a6e6ddc_481a_4bcc_991c_e17a8a8361ac.slice/crio-b2f0b90addcdd25542ff0492d2693717f403e11e0a885b47d76889edf8ce8406 WatchSource:0}: Error finding container b2f0b90addcdd25542ff0492d2693717f403e11e0a885b47d76889edf8ce8406: Status 404 returned error can't find the container with id b2f0b90addcdd25542ff0492d2693717f403e11e0a885b47d76889edf8ce8406 Jul 16 12:59:27.347401 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:27.347359 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363002466928" event={"ID":"8a6e6ddc-481a-4bcc-991c-e17a8a8361ac","Type":"ContainerStarted","Data":"b2f0b90addcdd25542ff0492d2693717f403e11e0a885b47d76889edf8ce8406"} Jul 16 12:59:27.348706 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:27.348681 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10b11a5cfe1afdc27a0b17dd7f1361b253ff6cd91fbd1d9a9ec2df37c519c8de" Jul 16 12:59:27.348859 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:27.348714 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:27.359867 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:59:27.359834 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7342-140363004445584\" is forbidden: User \"system:node:ip-10-0-137-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-10.ec2.internal' and this object" podUID="35bb29e3-dc46-48e5-ab4b-df9090625d2a" pod="opendatahub/test-curl-7342-140363004445584" Jul 16 12:59:27.824913 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:27.824857 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35bb29e3-dc46-48e5-ab4b-df9090625d2a" path="/var/lib/kubelet/pods/35bb29e3-dc46-48e5-ab4b-df9090625d2a/volumes" Jul 16 12:59:28.362342 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:28.362301 2570 generic.go:356] "Generic (PLEG): container finished" podID="8a6e6ddc-481a-4bcc-991c-e17a8a8361ac" containerID="38543bddadcb34596a06b39e21f8f157c467de184d638c1760d97e1c47cd577e" exitCode=0 Jul 16 12:59:28.362550 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:28.362357 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363002466928" event={"ID":"8a6e6ddc-481a-4bcc-991c-e17a8a8361ac","Type":"ContainerDied","Data":"38543bddadcb34596a06b39e21f8f157c467de184d638c1760d97e1c47cd577e"} Jul 16 12:59:29.517698 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:29.517668 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363002466928" Jul 16 12:59:29.542987 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:29.542952 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7342-140363002466928_8a6e6ddc-481a-4bcc-991c-e17a8a8361ac/test-curl-7342-140363002466928/0.log" Jul 16 12:59:29.570163 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:29.570125 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7342-140363002466928"] Jul 16 12:59:29.575102 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:29.575074 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7342-140363002466928"] Jul 16 12:59:29.620413 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:29.620323 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkzcp\" (UniqueName: \"kubernetes.io/projected/8a6e6ddc-481a-4bcc-991c-e17a8a8361ac-kube-api-access-zkzcp\") pod \"8a6e6ddc-481a-4bcc-991c-e17a8a8361ac\" (UID: \"8a6e6ddc-481a-4bcc-991c-e17a8a8361ac\") " Jul 16 12:59:29.622525 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:29.622493 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a6e6ddc-481a-4bcc-991c-e17a8a8361ac-kube-api-access-zkzcp" (OuterVolumeSpecName: "kube-api-access-zkzcp") pod "8a6e6ddc-481a-4bcc-991c-e17a8a8361ac" (UID: "8a6e6ddc-481a-4bcc-991c-e17a8a8361ac"). InnerVolumeSpecName "kube-api-access-zkzcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:59:29.722183 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:29.722141 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkzcp\" (UniqueName: \"kubernetes.io/projected/8a6e6ddc-481a-4bcc-991c-e17a8a8361ac-kube-api-access-zkzcp\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:29.829197 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:29.829159 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a6e6ddc-481a-4bcc-991c-e17a8a8361ac" path="/var/lib/kubelet/pods/8a6e6ddc-481a-4bcc-991c-e17a8a8361ac/volumes" Jul 16 12:59:30.375076 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:30.375043 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363002466928" Jul 16 12:59:30.375287 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:30.375046 2570 scope.go:117] "RemoveContainer" containerID="38543bddadcb34596a06b39e21f8f157c467de184d638c1760d97e1c47cd577e" Jul 16 12:59:48.224791 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:48.224753 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8"] Jul 16 12:59:48.225442 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:48.225086 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" containerID="cri-o://407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06" gracePeriod=30 Jul 16 12:59:48.941177 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:48.941130 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-698684c77c-xbp9z_43b5d44c-fca9-4f6c-bede-f75327539e79/authorino/0.log" Jul 16 12:59:53.493943 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.493842 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:59:53.508391 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.508357 2570 generic.go:356] "Generic (PLEG): container finished" podID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerID="407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06" exitCode=0 Jul 16 12:59:53.508580 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.508406 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" Jul 16 12:59:53.508580 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.508428 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" event={"ID":"e5cc89f6-ec0e-4872-b7c2-bba60293576b","Type":"ContainerDied","Data":"407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06"} Jul 16 12:59:53.508580 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.508475 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8" event={"ID":"e5cc89f6-ec0e-4872-b7c2-bba60293576b","Type":"ContainerDied","Data":"8392be092966b4a1954e29ac9ddd2e4a6cee8481683e6af141577fcf6daa7342"} Jul 16 12:59:53.508580 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.508498 2570 scope.go:117] "RemoveContainer" containerID="407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06" Jul 16 12:59:53.518984 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.518937 2570 scope.go:117] "RemoveContainer" containerID="23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d" Jul 16 12:59:53.530301 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.530270 2570 scope.go:117] "RemoveContainer" containerID="407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06" Jul 16 12:59:53.530644 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:59:53.530622 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06\": container with ID starting with 407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06 not found: ID does not exist" containerID="407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06" Jul 16 12:59:53.530747 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.530653 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06"} err="failed to get container status \"407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06\": rpc error: code = NotFound desc = could not find container \"407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06\": container with ID starting with 407cb67fca9469d171bf8c682da8734640a26aff01ae3ee6efa7d2573e76cc06 not found: ID does not exist" Jul 16 12:59:53.530747 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.530675 2570 scope.go:117] "RemoveContainer" containerID="23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d" Jul 16 12:59:53.531016 ip-10-0-137-10 kubenswrapper[2570]: E0716 12:59:53.530991 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d\": container with ID starting with 23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d not found: ID does not exist" containerID="23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d" Jul 16 12:59:53.531069 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.531028 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d"} err="failed to get container status \"23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d\": rpc error: code = NotFound desc = could not find container \"23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d\": container with ID starting with 23d3c3e5a63a13f21b15a771e82a9162c9580fa34b4849e847e96dd402826b9d not found: ID does not exist" Jul 16 12:59:53.559408 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559375 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-token\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.559606 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559416 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkp76\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-kube-api-access-rkp76\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.559606 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559447 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-socket\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.559606 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559467 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-data\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.559606 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559491 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istiod-ca-cert\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.559606 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559533 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-credential-socket\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.559851 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559664 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-certs\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.559851 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559714 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-envoy\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.559851 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559735 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:59:53.559851 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559768 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-podinfo\") pod \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\" (UID: \"e5cc89f6-ec0e-4872-b7c2-bba60293576b\") " Jul 16 12:59:53.560080 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559921 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:59:53.560080 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.559996 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:59:53.560218 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.560201 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:59:53.560323 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.560302 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-credential-socket\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.560384 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.560329 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-certs\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.560384 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.560346 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-workload-socket\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.560384 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.560359 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istiod-ca-cert\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.560758 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.560728 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:59:53.561766 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.561738 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-kube-api-access-rkp76" (OuterVolumeSpecName: "kube-api-access-rkp76") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "kube-api-access-rkp76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:59:53.561947 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.561906 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:59:53.562016 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.561978 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 12:59:53.562016 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.561987 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5cc89f6-ec0e-4872-b7c2-bba60293576b" (UID: "e5cc89f6-ec0e-4872-b7c2-bba60293576b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:59:53.661710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.661664 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-token\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.661710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.661701 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkp76\" (UniqueName: \"kubernetes.io/projected/e5cc89f6-ec0e-4872-b7c2-bba60293576b-kube-api-access-rkp76\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.661710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.661711 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-data\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.661710 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.661720 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-envoy\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.662044 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.661728 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cc89f6-ec0e-4872-b7c2-bba60293576b-istio-podinfo\") on node \"ip-10-0-137-10.ec2.internal\" DevicePath \"\"" Jul 16 12:59:53.834635 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.834596 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8"] Jul 16 12:59:53.842715 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:53.842682 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-293c75-openshift-default-675c4d4c9f-5fxf8"] Jul 16 12:59:54.399485 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:54.399451 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xqwnk_63143e74-a1d3-4430-acc0-e98d3c5e180e/manager/0.log" Jul 16 12:59:54.793385 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:54.793298 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vdbxl_50bccda8-a710-4b15-8daf-ddb5827605c6/server/0.log" Jul 16 12:59:54.927193 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:54.927147 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cs5hs_80496865-9ce1-4ccc-8d6f-cc448df57433/manager/0.log" Jul 16 12:59:55.318063 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:55.318032 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87d97db45-r7xcn_0370cf94-99db-4105-8810-1a406b604241/copy-manifests/0.log" Jul 16 12:59:55.326714 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:55.326668 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87d97db45-r7xcn_0370cf94-99db-4105-8810-1a406b604241/manager/0.log" Jul 16 12:59:55.826136 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:55.826105 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" path="/var/lib/kubelet/pods/e5cc89f6-ec0e-4872-b7c2-bba60293576b/volumes" Jul 16 12:59:56.053443 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:56.053401 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-197335-6d857c49bc-fl4gm_56af4062-2ae2-4d95-ba26-83ec9835b14f/maas-api/0.log" Jul 16 12:59:56.657932 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:56.657899 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-2e36a3ff-68dc5f6f47-dv78g_a09c9451-dc2c-4369-962c-a4dc8cecf82b/maas-api/0.log" Jul 16 12:59:57.259666 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:57.259622 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-gqvtl_39b9746a-f486-4ec8-ba7f-cdaa71ee4b79/postgres/0.log" Jul 16 12:59:58.612812 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:58.612758 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-698684c77c-xbp9z_43b5d44c-fca9-4f6c-bede-f75327539e79/authorino/0.log" Jul 16 12:59:58.740775 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:58.740724 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qfs4m_0c2f49f9-7c56-4ff6-913e-b0503bef685d/manager/0.log" Jul 16 12:59:59.106254 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:59.106212 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ljmk2_9a2b8396-e9c4-46db-8fd5-61bd54680ba6/registry-server/0.log" Jul 16 12:59:59.242268 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:59.242226 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4m7zx_c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473/manager/0.log" Jul 16 12:59:59.491937 ip-10-0-137-10 kubenswrapper[2570]: I0716 12:59:59.491782 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pftcf_b38bba01-87d4-4c6c-8d3d-3ae93770e703/manager/0.log" Jul 16 13:00:00.231049 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:00.231014 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5767f667-gp5fl_59dc9047-afce-4fdb-bfb7-ea6f39a397de/kube-auth-proxy/0.log" Jul 16 13:00:00.494568 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:00.494472 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-lg2lk_8c923913-477a-49e0-b1a9-e05942cb6d8e/payload-pre-processing/0.log" Jul 16 13:00:00.734317 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:00.734282 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f8649488-lw5qn_e2141df0-1926-4524-9c52-14cf694c6022/router/0.log" Jul 16 13:00:01.089570 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:01.089534 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2wmmb_fe6f42e2-4984-4cbb-9341-94ad16e5b676/main/0.log" Jul 16 13:00:01.326849 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:01.326816 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-v6t85_bc994784-e4c2-4701-a536-740fba4a23b6/main/0.log" Jul 16 13:00:05.886424 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:05.886388 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 13:00:05.893298 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:05.893271 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 13:00:05.899257 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:05.899235 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 13:00:05.902762 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:05.902740 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgl9d_f3ba8030-15f6-4204-8445-ef7ae53ac5d6/ovn-acl-logging/0.log" Jul 16 13:00:09.945774 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:09.945743 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6246f_3d1c8afb-3295-4ea3-94cd-73ae61d2fb01/global-pull-secret-syncer/0.log" Jul 16 13:00:10.123785 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:10.123744 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-872t8_2de93f5d-8172-4e3b-bc2f-20d83afac84c/konnectivity-agent/0.log" Jul 16 13:00:10.211051 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:10.210954 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-10.ec2.internal_0666eb19974600d7a3d9fe4c6ca0a2f8/haproxy/0.log" Jul 16 13:00:15.082147 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:15.082090 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-698684c77c-xbp9z_43b5d44c-fca9-4f6c-bede-f75327539e79/authorino/0.log" Jul 16 13:00:15.115722 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:15.115683 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qfs4m_0c2f49f9-7c56-4ff6-913e-b0503bef685d/manager/0.log" Jul 16 13:00:15.246436 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:15.246399 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ljmk2_9a2b8396-e9c4-46db-8fd5-61bd54680ba6/registry-server/0.log" Jul 16 13:00:15.438659 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:15.438562 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4m7zx_c8ccefd3-86c5-4a8d-82f0-f5e8d51f6473/manager/0.log" Jul 16 13:00:15.562015 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:15.561976 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pftcf_b38bba01-87d4-4c6c-8d3d-3ae93770e703/manager/0.log" Jul 16 13:00:17.373159 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:17.373116 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-xlts4_3dbcfdf1-3184-47bf-bcd0-d6f73bf8ccad/cluster-monitoring-operator/0.log" Jul 16 13:00:17.783166 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:17.783079 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vf972_eb9aa115-01de-4eb3-8ba4-28d9688fda43/node-exporter/0.log" Jul 16 13:00:17.807129 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:17.807079 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vf972_eb9aa115-01de-4eb3-8ba4-28d9688fda43/kube-rbac-proxy/0.log" Jul 16 13:00:17.835302 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:17.835268 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vf972_eb9aa115-01de-4eb3-8ba4-28d9688fda43/init-textfile/0.log" Jul 16 13:00:18.198692 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:18.198661 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-wtjp7_a1afae13-8665-4f63-bd94-06be57bdf4e2/prometheus-operator-admission-webhook/0.log" Jul 16 13:00:19.607045 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.607006 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-294g4_0c640aa2-f5aa-4bec-8081-6c4310467b05/networking-console-plugin/0.log" Jul 16 13:00:19.665241 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665205 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777"] Jul 16 13:00:19.665651 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665638 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" Jul 16 13:00:19.665694 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665652 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" Jul 16 13:00:19.665694 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665665 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" Jul 16 13:00:19.665694 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665671 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" Jul 16 13:00:19.665694 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665684 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a6e6ddc-481a-4bcc-991c-e17a8a8361ac" containerName="test-curl-7342-140363002466928" Jul 16 13:00:19.665694 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665691 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a6e6ddc-481a-4bcc-991c-e17a8a8361ac" containerName="test-curl-7342-140363002466928" Jul 16 13:00:19.665854 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665754 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a6e6ddc-481a-4bcc-991c-e17a8a8361ac" containerName="test-curl-7342-140363002466928" Jul 16 13:00:19.665854 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.665762 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cc89f6-ec0e-4872-b7c2-bba60293576b" containerName="istio-proxy" Jul 16 13:00:19.669173 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.669147 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.671655 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.671631 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ndv85\"/\"default-dockercfg-7mnpt\"" Jul 16 13:00:19.672690 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.672669 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ndv85\"/\"kube-root-ca.crt\"" Jul 16 13:00:19.672810 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.672696 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ndv85\"/\"openshift-service-ca.crt\"" Jul 16 13:00:19.679938 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.679908 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777"] Jul 16 13:00:19.805956 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.805915 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-lib-modules\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.806141 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.806064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrp5\" (UniqueName: \"kubernetes.io/projected/1f8f8e85-17dc-4edb-b563-b92c593abc59-kube-api-access-bsrp5\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.806141 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.806130 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-podres\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.806228 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.806167 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-sys\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.806228 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.806209 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-proc\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907688 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907577 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-lib-modules\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907688 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907658 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrp5\" (UniqueName: \"kubernetes.io/projected/1f8f8e85-17dc-4edb-b563-b92c593abc59-kube-api-access-bsrp5\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907992 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907693 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-podres\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907992 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907711 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-sys\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907992 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907734 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-proc\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907992 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907817 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-lib-modules\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907992 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907844 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-sys\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907992 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907861 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-podres\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.907992 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.907914 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f8f8e85-17dc-4edb-b563-b92c593abc59-proc\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.920097 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.920054 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrp5\" (UniqueName: \"kubernetes.io/projected/1f8f8e85-17dc-4edb-b563-b92c593abc59-kube-api-access-bsrp5\") pod \"perf-node-gather-daemonset-4b777\" (UID: \"1f8f8e85-17dc-4edb-b563-b92c593abc59\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:19.981160 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:19.981119 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:20.135000 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.134972 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777"] Jul 16 13:00:20.137222 ip-10-0-137-10 kubenswrapper[2570]: W0716 13:00:20.137168 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1f8f8e85_17dc_4edb_b563_b92c593abc59.slice/crio-f9aa1978946e184ea9a9c993f6e7330db52f9f68a43d9dd0e847047f4befa3cc WatchSource:0}: Error finding container f9aa1978946e184ea9a9c993f6e7330db52f9f68a43d9dd0e847047f4befa3cc: Status 404 returned error can't find the container with id f9aa1978946e184ea9a9c993f6e7330db52f9f68a43d9dd0e847047f4befa3cc Jul 16 13:00:20.290788 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.290740 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/1.log" Jul 16 13:00:20.299634 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.299597 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5x9lg_90df5fb6-dd25-4493-ba24-73892e0c372e/console-operator/2.log" Jul 16 13:00:20.661132 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.661087 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" event={"ID":"1f8f8e85-17dc-4edb-b563-b92c593abc59","Type":"ContainerStarted","Data":"39e2309d231b026a0ca8ccf111235a4b0932275f149fd25da252ea25328725f6"} Jul 16 13:00:20.661535 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.661156 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" event={"ID":"1f8f8e85-17dc-4edb-b563-b92c593abc59","Type":"ContainerStarted","Data":"f9aa1978946e184ea9a9c993f6e7330db52f9f68a43d9dd0e847047f4befa3cc"} Jul 16 13:00:20.661535 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.661321 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:20.679353 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.679300 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" podStartSLOduration=1.679282352 podStartE2EDuration="1.679282352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:00:20.677597965 +0000 UTC m=+2415.529798776" watchObservedRunningTime="2026-07-16 13:00:20.679282352 +0000 UTC m=+2415.531483162" Jul 16 13:00:20.760598 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.760565 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-656594f667-p44nr_2239b9ac-1706-415f-b90b-dec3cdd4dd69/console/0.log" Jul 16 13:00:20.803421 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:20.803381 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-x9fmw_62175354-1513-4ce2-bf86-3c4a1755bd54/download-server/0.log" Jul 16 13:00:21.408177 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:21.408144 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-4fbnv_fa91a08c-add6-4bbe-9c70-93f7e707527e/volume-data-source-validator/0.log" Jul 16 13:00:22.508865 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:22.508829 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-djqx8_cc2a9eea-8c67-4488-a4c4-0426dcdbe012/dns/0.log" Jul 16 13:00:22.533509 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:22.533474 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-djqx8_cc2a9eea-8c67-4488-a4c4-0426dcdbe012/kube-rbac-proxy/0.log" Jul 16 13:00:22.686822 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:22.686790 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qrfnd_8dfd361f-c637-4992-bc3d-195d93515460/dns-node-resolver/0.log" Jul 16 13:00:23.307934 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:23.307899 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s7w6z_aa3f2ae3-1adf-4a70-ba6e-24be9d985b0e/node-ca/0.log" Jul 16 13:00:24.400569 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:24.400542 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5767f667-gp5fl_59dc9047-afce-4fdb-bfb7-ea6f39a397de/kube-auth-proxy/0.log" Jul 16 13:00:24.496641 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:24.496585 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-lg2lk_8c923913-477a-49e0-b1a9-e05942cb6d8e/payload-pre-processing/0.log" Jul 16 13:00:24.548949 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:24.548914 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f8649488-lw5qn_e2141df0-1926-4524-9c52-14cf694c6022/router/0.log" Jul 16 13:00:25.277540 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:25.277512 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zs5rp_0d588531-9df4-4f7d-b42f-3609a2a684d6/serve-healthcheck-canary/0.log" Jul 16 13:00:25.791594 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:25.791560 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-twttw_179cd1bb-64f3-4af6-927b-58ee4e78cf15/insights-operator/0.log" Jul 16 13:00:25.792580 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:25.792550 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-twttw_179cd1bb-64f3-4af6-927b-58ee4e78cf15/insights-operator/1.log" Jul 16 13:00:25.814009 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:25.813982 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-82gfb_26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03/kube-rbac-proxy/0.log" Jul 16 13:00:25.836526 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:25.836491 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-82gfb_26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03/exporter/0.log" Jul 16 13:00:25.861367 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:25.861336 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-82gfb_26e0a4d6-a94b-4b9c-8ac8-b95e00a87d03/extractor/0.log" Jul 16 13:00:26.678449 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:26.678419 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-4b777" Jul 16 13:00:28.178290 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:28.178193 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xqwnk_63143e74-a1d3-4430-acc0-e98d3c5e180e/manager/0.log" Jul 16 13:00:28.477437 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:28.477348 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vdbxl_50bccda8-a710-4b15-8daf-ddb5827605c6/server/0.log" Jul 16 13:00:28.576865 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:28.576826 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cs5hs_80496865-9ce1-4ccc-8d6f-cc448df57433/manager/0.log" Jul 16 13:00:28.796916 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:28.796805 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87d97db45-r7xcn_0370cf94-99db-4105-8810-1a406b604241/manager/0.log" Jul 16 13:00:28.819523 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:28.819491 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87d97db45-r7xcn_0370cf94-99db-4105-8810-1a406b604241/copy-manifests/0.log" Jul 16 13:00:29.327635 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:29.327600 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5767f667-gp5fl_59dc9047-afce-4fdb-bfb7-ea6f39a397de/kube-auth-proxy/0.log" Jul 16 13:00:29.411543 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:29.411489 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-lg2lk_8c923913-477a-49e0-b1a9-e05942cb6d8e/payload-pre-processing/0.log" Jul 16 13:00:29.449153 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:29.449120 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f8649488-lw5qn_e2141df0-1926-4524-9c52-14cf694c6022/router/0.log" Jul 16 13:00:30.957060 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:30.957027 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5767f667-gp5fl_59dc9047-afce-4fdb-bfb7-ea6f39a397de/kube-auth-proxy/0.log" Jul 16 13:00:31.033629 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:31.033595 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-lg2lk_8c923913-477a-49e0-b1a9-e05942cb6d8e/payload-pre-processing/0.log" Jul 16 13:00:31.071231 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:31.071199 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f8649488-lw5qn_e2141df0-1926-4524-9c52-14cf694c6022/router/0.log" Jul 16 13:00:35.270892 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:35.270842 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8knsk_f0b73307-5fe0-46f4-b78e-2e9da436dd8b/migrator/0.log" Jul 16 13:00:35.292561 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:35.292527 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8knsk_f0b73307-5fe0-46f4-b78e-2e9da436dd8b/graceful-termination/0.log" Jul 16 13:00:35.744809 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:35.744767 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qx8sm_b58c4c06-bf79-45c4-9be0-f303f5b942c6/kube-storage-version-migrator-operator/1.log" Jul 16 13:00:35.746343 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:35.746316 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qx8sm_b58c4c06-bf79-45c4-9be0-f303f5b942c6/kube-storage-version-migrator-operator/0.log" Jul 16 13:00:36.839054 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:36.838976 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2j4wv_94ea42dd-9d25-4218-b973-828ffd6d7796/kube-multus/0.log" Jul 16 13:00:37.259738 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.259650 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxm82_4eaa7819-97bc-4be4-823f-1b30eb9fd0fa/kube-multus-additional-cni-plugins/0.log" Jul 16 13:00:37.288718 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.288681 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxm82_4eaa7819-97bc-4be4-823f-1b30eb9fd0fa/egress-router-binary-copy/0.log" Jul 16 13:00:37.311268 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.311239 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxm82_4eaa7819-97bc-4be4-823f-1b30eb9fd0fa/cni-plugins/0.log" Jul 16 13:00:37.340917 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.340870 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxm82_4eaa7819-97bc-4be4-823f-1b30eb9fd0fa/bond-cni-plugin/0.log" Jul 16 13:00:37.363076 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.363041 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxm82_4eaa7819-97bc-4be4-823f-1b30eb9fd0fa/routeoverride-cni/0.log" Jul 16 13:00:37.385810 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.385779 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxm82_4eaa7819-97bc-4be4-823f-1b30eb9fd0fa/whereabouts-cni-bincopy/0.log" Jul 16 13:00:37.409436 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.409407 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxm82_4eaa7819-97bc-4be4-823f-1b30eb9fd0fa/whereabouts-cni/0.log" Jul 16 13:00:37.649523 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.649494 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lxqfm_8ce77094-7be6-4e19-9926-b7cc33b9fff3/network-metrics-daemon/0.log" Jul 16 13:00:37.672364 ip-10-0-137-10 kubenswrapper[2570]: I0716 13:00:37.672328 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lxqfm_8ce77094-7be6-4e19-9926-b7cc33b9fff3/kube-rbac-proxy/0.log"