Jul 26 17:57:01.169652 ip-10-0-132-146 systemd[1]: Starting Kubernetes Kubelet... Jul 26 17:57:01.608262 ip-10-0-132-146 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 26 17:57:01.608262 ip-10-0-132-146 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 26 17:57:01.608262 ip-10-0-132-146 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 26 17:57:01.608262 ip-10-0-132-146 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 26 17:57:01.608262 ip-10-0-132-146 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 26 17:57:01.611077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.610959 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 26 17:57:01.617395 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617372 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 26 17:57:01.617395 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617390 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 26 17:57:01.617395 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617395 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 26 17:57:01.617395 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617399 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617404 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617408 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617415 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617420 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617424 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617428 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617432 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617437 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617441 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617445 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617449 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617452 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617456 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617460 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617463 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617467 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617471 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617475 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 26 17:57:01.617643 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617479 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617484 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617488 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617492 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617496 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617500 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617503 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617507 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617511 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617515 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617519 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617523 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617527 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617531 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617536 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617544 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617550 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617555 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617559 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 26 17:57:01.618439 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617563 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617567 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617571 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617576 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617580 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617584 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617588 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617591 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617595 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617601 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617605 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617609 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617613 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617617 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617621 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617625 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617629 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617634 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617638 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617642 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 26 17:57:01.619190 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617646 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617650 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617654 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617660 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617666 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617671 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617676 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617681 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617686 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617691 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617695 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617699 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617704 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617708 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617712 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617716 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617720 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617724 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617728 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617733 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 26 17:57:01.620014 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617737 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617741 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617747 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617751 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617755 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617759 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617763 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617768 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617773 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617777 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617781 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617785 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617789 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617794 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617798 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617802 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617807 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.617811 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618957 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618966 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 26 17:57:01.620846 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618972 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618978 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618982 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618986 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618990 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618995 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.618999 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619003 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619007 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619011 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619015 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619019 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619023 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619027 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619032 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619036 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619041 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619048 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619054 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619059 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 26 17:57:01.621724 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619063 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619068 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619073 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619078 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619083 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619088 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619093 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619097 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619101 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619106 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619111 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619115 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619121 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619126 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619130 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619134 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619138 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619142 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619146 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 26 17:57:01.622419 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619150 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619154 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619158 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619162 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619166 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619171 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619175 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619178 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619183 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619188 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619192 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619197 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619200 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619204 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619209 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619215 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619221 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619225 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619230 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619235 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 26 17:57:01.622913 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619239 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619244 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619250 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619255 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619259 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619264 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619268 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619272 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619277 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619281 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619285 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619289 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619293 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619297 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619301 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619305 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619327 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619345 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619349 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619353 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 26 17:57:01.623445 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619358 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619362 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619367 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619371 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619375 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619380 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619383 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619388 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619392 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619396 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619400 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619405 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619409 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619414 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619417 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619422 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619426 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.619431 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620027 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 26 17:57:01.624185 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620035 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620040 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620044 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620048 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620053 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620057 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620062 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620066 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620070 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620076 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620081 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620085 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620089 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620093 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620098 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620113 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620117 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620121 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620125 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620129 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 26 17:57:01.624670 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620134 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620138 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620142 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620146 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620150 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620154 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620158 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620162 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620166 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620171 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620175 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620180 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620184 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620188 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620192 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620197 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620201 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620205 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620209 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620214 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 26 17:57:01.625144 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620218 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620222 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620229 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620234 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620239 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620244 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620248 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620254 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620260 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620265 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620269 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620273 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620277 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620281 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620290 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620296 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620301 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620305 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620327 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 26 17:57:01.625730 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620332 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620336 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620342 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620347 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620351 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620354 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620359 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620363 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620368 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620372 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620376 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620380 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620384 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620387 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620392 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620396 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620400 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620405 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620409 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620413 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 26 17:57:01.626189 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620417 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620421 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620426 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620430 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620434 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620438 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620442 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620447 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620451 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620455 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620461 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620465 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620469 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620473 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620479 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620483 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620487 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620492 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.620496 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620596 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620607 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 26 17:57:01.626691 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620616 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620623 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620629 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620634 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620641 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620647 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620652 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620656 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620662 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620667 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620672 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620677 2565 flags.go:64] FLAG: --cgroup-root="" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620683 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620687 2565 flags.go:64] FLAG: --client-ca-file="" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620692 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620697 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620704 2565 flags.go:64] FLAG: --cluster-domain="" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620709 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620714 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620719 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620724 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620732 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620736 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 26 17:57:01.627171 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620741 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620746 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620753 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620757 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620762 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620767 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620771 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620778 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620783 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620788 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620792 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620797 2565 flags.go:64] FLAG: --enable-server="true" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620802 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620808 2565 flags.go:64] FLAG: --event-burst="100" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620812 2565 flags.go:64] FLAG: --event-qps="50" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620817 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620822 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620826 2565 flags.go:64] FLAG: --eviction-hard="" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620832 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620837 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620841 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620846 2565 flags.go:64] FLAG: --eviction-soft="" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620850 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620855 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620861 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 26 17:57:01.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620866 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620870 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620874 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620879 2565 flags.go:64] FLAG: --feature-gates="" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620885 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620892 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620897 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620902 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620907 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620912 2565 flags.go:64] FLAG: --help="false" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620916 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-132-146.ec2.internal" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620921 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620926 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620931 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620936 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620942 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620946 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620951 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620955 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620960 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620964 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620970 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620974 2565 flags.go:64] FLAG: --kube-reserved="" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620979 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 26 17:57:01.628426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620983 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620988 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620993 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.620997 2565 flags.go:64] FLAG: --lock-file="" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621001 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621006 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621011 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621020 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621025 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621030 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621035 2565 flags.go:64] FLAG: --logging-format="text" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621041 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621046 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621052 2565 flags.go:64] FLAG: --manifest-url="" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621057 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621064 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621068 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621075 2565 flags.go:64] FLAG: --max-pods="110" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621080 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621085 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621090 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621095 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621099 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621104 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621108 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 26 17:57:01.629000 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621120 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621125 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621130 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621134 2565 flags.go:64] FLAG: --pod-cidr="" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621139 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621147 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621152 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621157 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621161 2565 flags.go:64] FLAG: --port="10250" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621166 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621171 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-083fb0734b44f53e7" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621176 2565 flags.go:64] FLAG: --qos-reserved="" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621181 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621186 2565 flags.go:64] FLAG: --register-node="true" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621190 2565 flags.go:64] FLAG: --register-with-taints="" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621196 2565 flags.go:64] FLAG: --registry-burst="10" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621201 2565 flags.go:64] FLAG: --registry-qps="5" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621206 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621211 2565 flags.go:64] FLAG: --reserved-memory="" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621217 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621221 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621228 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621233 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621238 2565 flags.go:64] FLAG: --runonce="false" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621242 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 26 17:57:01.629615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621247 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621252 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621256 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621261 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621265 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621270 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621276 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621280 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621285 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621289 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621294 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621298 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621303 2565 flags.go:64] FLAG: --system-cgroups="" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621307 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621334 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621339 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621343 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621350 2565 flags.go:64] FLAG: --tls-min-version="" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621355 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621360 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621364 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621368 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621373 2565 flags.go:64] FLAG: --v="2" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621379 2565 flags.go:64] FLAG: --version="false" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621386 2565 flags.go:64] FLAG: --vmodule="" Jul 26 17:57:01.630211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621392 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.621398 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621581 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621589 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621595 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621599 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621604 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621609 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621616 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621621 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621627 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621632 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621636 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621640 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621644 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621648 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621652 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621656 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621661 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621665 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 26 17:57:01.630826 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621669 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621673 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621677 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621681 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621685 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621689 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621694 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621698 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621702 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621708 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621712 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621716 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621723 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621727 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621731 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621736 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621740 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621744 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621748 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 26 17:57:01.631280 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621752 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621756 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621760 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621765 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621770 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621774 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621778 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621782 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621786 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621790 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621794 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621798 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621802 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621806 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621810 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621815 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621819 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621824 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621828 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621832 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 26 17:57:01.631819 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621836 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621840 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621846 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621851 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621857 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621862 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621867 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621871 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621877 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621882 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621886 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621890 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621894 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621899 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621903 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621907 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621911 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621917 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621922 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 26 17:57:01.632282 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621927 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621931 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621936 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621940 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621944 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621948 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621952 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621956 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621960 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621964 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621969 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621973 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621977 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621981 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621985 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621991 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621995 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.621999 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.622003 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.622007 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 26 17:57:01.632748 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.622012 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.622018 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.622022 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.622817 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.630013 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.630027 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.630867 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.630875 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630939 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630945 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630948 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630951 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630954 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630956 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630959 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 26 17:57:01.633256 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630962 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630965 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630967 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630970 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630972 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630975 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630978 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630980 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630983 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630986 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630988 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630991 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630994 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630996 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.630999 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631001 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631004 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631012 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631014 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631017 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 26 17:57:01.633635 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631020 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631022 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631025 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631027 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631030 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631032 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631035 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631038 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631040 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631044 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631048 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631052 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631055 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631058 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631061 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631063 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631066 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631069 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631072 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 26 17:57:01.634098 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631075 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631078 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631081 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631084 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631087 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631089 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631092 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631094 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631097 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631099 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631102 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631110 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631113 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631117 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631120 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631123 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631126 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631129 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631132 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 26 17:57:01.634578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631135 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631137 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631139 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631142 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631144 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631147 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631149 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631152 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631154 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631157 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631159 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631162 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631164 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631166 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631169 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631171 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631174 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631176 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631179 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631181 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 26 17:57:01.635026 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631184 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631186 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631189 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631191 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631194 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631202 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631204 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631207 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631210 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631212 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631215 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631217 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631219 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631222 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.631226 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 26 17:57:01.635511 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631390 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631396 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631398 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631401 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631404 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631406 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631408 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631411 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631413 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631416 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631418 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631421 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631423 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631433 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631435 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631438 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631441 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631444 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631448 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631451 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 26 17:57:01.635871 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631454 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631457 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631459 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631467 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631470 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631473 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631475 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631478 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631480 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631483 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631485 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631488 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631490 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631493 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631495 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631497 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631500 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631502 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631505 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631507 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 26 17:57:01.636387 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631509 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631512 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631514 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631517 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631519 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631522 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631524 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631527 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631530 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631532 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631535 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631537 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631539 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631542 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631544 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631547 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631555 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631557 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631560 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631562 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 26 17:57:01.636856 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631565 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631567 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631569 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631572 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631574 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631577 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631579 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631581 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631584 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631586 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631588 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631591 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631593 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631595 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631598 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631601 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631603 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631606 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631608 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631611 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 26 17:57:01.637328 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631613 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631615 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631618 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631620 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631624 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631627 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631630 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631632 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631635 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631643 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631647 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631650 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631653 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631656 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631658 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631661 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631663 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631666 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 26 17:57:01.637786 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:01.631668 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 26 17:57:01.638219 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.631673 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 26 17:57:01.638219 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.631776 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 26 17:57:01.638219 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.634036 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 26 17:57:01.638219 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.635569 2565 server.go:1019] "Starting client certificate rotation" Jul 26 17:57:01.638219 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.635667 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 26 17:57:01.638219 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.635700 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 26 17:57:01.639302 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.639283 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 26 17:57:01.644207 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.644192 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 26 17:57:01.655382 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.655366 2565 log.go:25] "Validated CRI v1 runtime API" Jul 26 17:57:01.657693 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.657679 2565 log.go:25] "Validated CRI v1 image API" Jul 26 17:57:01.661074 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.661056 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 26 17:57:01.666589 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.666571 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a92cb70d-a427-41c6-8f0b-9e8e745d7c77:/dev/nvme0n1p4 b07b0b18-a1cb-4964-99c5-56ec2af3e855:/dev/nvme0n1p3] Jul 26 17:57:01.666638 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.666589 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 26 17:57:01.673462 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.673328 2565 manager.go:216] Machine: {Timestamp:2026-07-26 17:57:01.670950339 +0000 UTC m=+0.374677488 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201174 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec200946c2ee8af744c81a8390d1668d SystemUUID:ec200946-c2ee-8af7-44c8-1a8390d1668d BootID:27333192-bd59-42d9-b28a-d03c025c6f81 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:a5:de:a6:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:a5:de:a6:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:54:0c:58:16:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 26 17:57:01.673462 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.673449 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 26 17:57:01.673591 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.673528 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 26 17:57:01.674020 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.674005 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 26 17:57:01.676821 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.676793 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 26 17:57:01.676990 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.676824 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 26 17:57:01.677676 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.677666 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 26 17:57:01.677706 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.677678 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 26 17:57:01.677706 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.677691 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 26 17:57:01.677706 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.677705 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 26 17:57:01.678883 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.678872 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 26 17:57:01.681712 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.681701 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 26 17:57:01.681826 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.681818 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 26 17:57:01.681858 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.681847 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 26 17:57:01.681858 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.681856 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 26 17:57:01.681910 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.681871 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 26 17:57:01.681910 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.681881 2565 kubelet.go:398] "Adding apiserver pod source" Jul 26 17:57:01.681910 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.681891 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 26 17:57:01.682306 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.682289 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 26 17:57:01.682401 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.682326 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 26 17:57:01.686392 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.686374 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 26 17:57:01.688859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.688844 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 26 17:57:01.688936 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.688874 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 26 17:57:01.690739 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690726 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 26 17:57:01.690739 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690742 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690748 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690754 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690763 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690768 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690776 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690782 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690789 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690794 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690813 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 26 17:57:01.690849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.690818 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 26 17:57:01.691748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.691738 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 26 17:57:01.691748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.691748 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 26 17:57:01.693457 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.693434 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 26 17:57:01.693524 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.693435 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 26 17:57:01.694875 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.694862 2565 server.go:1268] "Started kubelet" Jul 26 17:57:01.694968 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.694945 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 26 17:57:01.695064 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.695038 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 26 17:57:01.695115 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.695088 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 26 17:57:01.695680 ip-10-0-132-146 systemd[1]: Started Kubernetes Kubelet. Jul 26 17:57:01.698091 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.697935 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 26 17:57:01.698091 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.698057 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 26 17:57:01.701465 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.701443 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 26 17:57:01.703388 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.703371 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 26 17:57:01.704659 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.703476 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-146.ec2.internal.18c5e8a4c4b6432f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-146.ec2.internal,UID:ip-10-0-132-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-146.ec2.internal,},FirstTimestamp:2026-07-26 17:57:01.694829359 +0000 UTC m=+0.398556508,LastTimestamp:2026-07-26 17:57:01.694829359 +0000 UTC m=+0.398556508,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-146.ec2.internal,}" Jul 26 17:57:01.708003 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.707981 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 26 17:57:01.708003 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.707996 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 26 17:57:01.708134 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.708082 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:01.708722 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.708698 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 26 17:57:01.708798 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.708731 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 26 17:57:01.708862 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.708697 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 26 17:57:01.708862 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.708844 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 26 17:57:01.708862 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.708860 2565 factory.go:55] Registering systemd factory Jul 26 17:57:01.709006 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.708870 2565 factory.go:223] Registration of the systemd container factory successfully Jul 26 17:57:01.709006 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.708884 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 26 17:57:01.709006 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.708893 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 26 17:57:01.709150 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.709097 2565 factory.go:153] Registering CRI-O factory Jul 26 17:57:01.709150 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.709110 2565 factory.go:223] Registration of the crio container factory successfully Jul 26 17:57:01.709150 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.709132 2565 factory.go:103] Registering Raw factory Jul 26 17:57:01.709150 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.709144 2565 manager.go:1196] Started watching for new ooms in manager Jul 26 17:57:01.709738 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.709537 2565 manager.go:349] Starting recovery of all containers Jul 26 17:57:01.711227 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.711200 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 26 17:57:01.711377 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.711355 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 26 17:57:01.721337 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.721218 2565 manager.go:354] Recovery completed Jul 26 17:57:01.724075 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.724056 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cfdt5" Jul 26 17:57:01.725709 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.725697 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 26 17:57:01.727424 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.727409 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientMemory" Jul 26 17:57:01.727493 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.727437 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 26 17:57:01.727493 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.727449 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientPID" Jul 26 17:57:01.728008 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.727994 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 26 17:57:01.728008 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.728005 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 26 17:57:01.728110 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.728019 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 26 17:57:01.728110 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.728029 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 26 17:57:01.728823 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.728808 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientMemory" Jul 26 17:57:01.728903 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.728837 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 26 17:57:01.728903 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.728852 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientPID" Jul 26 17:57:01.729604 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.729544 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-146.ec2.internal.18c5e8a4c6a79b46 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-146.ec2.internal,UID:ip-10-0-132-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-146.ec2.internal,},FirstTimestamp:2026-07-26 17:57:01.727423302 +0000 UTC m=+0.431150455,LastTimestamp:2026-07-26 17:57:01.727423302 +0000 UTC m=+0.431150455,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-146.ec2.internal,}" Jul 26 17:57:01.729831 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.729817 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cfdt5" Jul 26 17:57:01.731658 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.731640 2565 policy_none.go:49] "None policy: Start" Jul 26 17:57:01.731705 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.731665 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 26 17:57:01.731705 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.731680 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 26 17:57:01.733642 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.733631 2565 policy_none.go:47] "Start" Jul 26 17:57:01.777901 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.777884 2565 manager.go:337] "Starting Device Plugin manager" Jul 26 17:57:01.778010 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.777916 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 26 17:57:01.778010 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.777925 2565 server.go:87] "Starting device plugin registration server" Jul 26 17:57:01.778195 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.778184 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 26 17:57:01.778229 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.778196 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 26 17:57:01.778333 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.778295 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 26 17:57:01.778424 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.778397 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 26 17:57:01.778424 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.778407 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 26 17:57:01.778973 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.778955 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 26 17:57:01.779037 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.778998 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:01.842394 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.842358 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 26 17:57:01.844583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.843523 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 26 17:57:01.844583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.843562 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 26 17:57:01.844583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.843582 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 26 17:57:01.844583 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.843615 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 26 17:57:01.845890 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.845872 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 26 17:57:01.878862 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.878697 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 26 17:57:01.879757 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.879741 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientMemory" Jul 26 17:57:01.879834 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.879771 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 26 17:57:01.879834 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.879782 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientPID" Jul 26 17:57:01.879834 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.879804 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-146.ec2.internal" Jul 26 17:57:01.886298 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.886276 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-146.ec2.internal" Jul 26 17:57:01.886298 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.886297 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-146.ec2.internal\": node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:01.910698 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.910675 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:01.944543 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.944508 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal"] Jul 26 17:57:01.944678 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.944604 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 26 17:57:01.945644 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.945625 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientMemory" Jul 26 17:57:01.945753 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.945659 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 26 17:57:01.945753 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.945672 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientPID" Jul 26 17:57:01.947951 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.947936 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 26 17:57:01.948057 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.948043 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:01.948108 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.948077 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 26 17:57:01.948688 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.948672 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientMemory" Jul 26 17:57:01.948688 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.948683 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientMemory" Jul 26 17:57:01.948800 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.948704 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 26 17:57:01.948800 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.948708 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 26 17:57:01.948800 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.948720 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientPID" Jul 26 17:57:01.948800 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.948719 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientPID" Jul 26 17:57:01.950942 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.950927 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" Jul 26 17:57:01.951027 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.950953 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 26 17:57:01.951660 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.951640 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientMemory" Jul 26 17:57:01.951726 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.951666 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 26 17:57:01.951726 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:01.951675 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeHasSufficientPID" Jul 26 17:57:01.981253 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.981231 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-146.ec2.internal\" not found" node="ip-10-0-132-146.ec2.internal" Jul 26 17:57:01.985559 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:01.985542 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-146.ec2.internal\" not found" node="ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.010629 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.010600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9bdd46282848f78b3a7301feafbb6319-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal\" (UID: \"9bdd46282848f78b3a7301feafbb6319\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.010629 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.010633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd46282848f78b3a7301feafbb6319-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal\" (UID: \"9bdd46282848f78b3a7301feafbb6319\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.010765 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.010651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d355a552e2e9bb7fc5a4bd746d646b8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-146.ec2.internal\" (UID: \"2d355a552e2e9bb7fc5a4bd746d646b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.010765 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.010705 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:02.111649 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.111600 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:02.111649 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.111629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9bdd46282848f78b3a7301feafbb6319-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal\" (UID: \"9bdd46282848f78b3a7301feafbb6319\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.111871 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.111669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd46282848f78b3a7301feafbb6319-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal\" (UID: \"9bdd46282848f78b3a7301feafbb6319\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.111871 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.111692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d355a552e2e9bb7fc5a4bd746d646b8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-146.ec2.internal\" (UID: \"2d355a552e2e9bb7fc5a4bd746d646b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.111871 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.111736 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd46282848f78b3a7301feafbb6319-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal\" (UID: \"9bdd46282848f78b3a7301feafbb6319\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.111871 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.111736 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9bdd46282848f78b3a7301feafbb6319-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal\" (UID: \"9bdd46282848f78b3a7301feafbb6319\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.111871 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.111737 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d355a552e2e9bb7fc5a4bd746d646b8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-146.ec2.internal\" (UID: \"2d355a552e2e9bb7fc5a4bd746d646b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.212359 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.212278 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:02.283521 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.283485 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.289367 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.289341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.312652 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.312625 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:02.413042 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.413003 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:02.513446 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.513372 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-146.ec2.internal\" not found" Jul 26 17:57:02.599021 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.598992 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 26 17:57:02.608923 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.608901 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.622059 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.622039 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 26 17:57:02.623873 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.623857 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" Jul 26 17:57:02.630754 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.630736 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 26 17:57:02.634999 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.634981 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 26 17:57:02.635105 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.635088 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 26 17:57:02.635105 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.635093 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 26 17:57:02.682597 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.682568 2565 apiserver.go:52] "Watching apiserver" Jul 26 17:57:02.701127 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.701103 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 26 17:57:02.701527 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.701501 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-cprtz","openshift-multus/multus-pmdlc","openshift-multus/network-metrics-daemon-vlzln","openshift-cluster-node-tuning-operator/tuned-8z6ln","openshift-dns/node-resolver-hggld","openshift-image-registry/node-ca-9lzgg","openshift-network-diagnostics/network-check-target-k47mn","openshift-network-operator/iptables-alerter-tqrk6","openshift-ovn-kubernetes/ovnkube-node-jnltj","kube-system/global-pull-secret-syncer-9fwzm","kube-system/konnectivity-agent-4tsn4","kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal"] Jul 26 17:57:02.704041 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.704016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:02.704138 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.704116 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:02.706616 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.706596 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.708838 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.708814 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 26 17:57:02.709301 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.709263 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 26 17:57:02.709838 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.709682 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 26 17:57:02.709838 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.709697 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zlp54\"" Jul 26 17:57:02.709838 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.709717 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 26 17:57:02.710246 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.710229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:02.710317 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.710300 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:02.713153 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.713134 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.714306 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.714378 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-device-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.714378 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.714378 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-sys-fs\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.714378 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714361 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bn6c\" (UniqueName: \"kubernetes.io/projected/bc643b4d-a649-4ea2-9a59-195bfad480ac-kube-api-access-4bn6c\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.714578 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-socket-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.714578 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-registration-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.714578 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:02.714578 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzq47\" (UniqueName: \"kubernetes.io/projected/e82c225e-6d71-4825-b117-29957a7301c1-kube-api-access-dzq47\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:02.714578 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.714531 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:02.715123 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.715104 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 26 17:57:02.715197 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.715122 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 26 17:57:02.715197 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.715183 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xb9tf\"" Jul 26 17:57:02.716044 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.716030 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.717945 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.717928 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 26 17:57:02.718043 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.717976 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 26 17:57:02.718043 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.717987 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rr5cc\"" Jul 26 17:57:02.718676 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.718658 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 26 17:57:02.718896 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.718877 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.720890 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.720870 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 26 17:57:02.721011 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.720996 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 26 17:57:02.721298 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.721285 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n798h\"" Jul 26 17:57:02.721414 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.721393 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 26 17:57:02.721889 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.721874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.724092 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.724002 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 26 17:57:02.724092 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.724019 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 26 17:57:02.724215 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.724136 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 26 17:57:02.724447 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.724427 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xmhqn\"" Jul 26 17:57:02.724565 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.724463 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 26 17:57:02.724565 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.724432 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 26 17:57:02.724565 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.724435 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 26 17:57:02.725181 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.725165 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.727231 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.727211 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 26 17:57:02.727336 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.727299 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 26 17:57:02.727611 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.727593 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lrrps\"" Jul 26 17:57:02.727730 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.727599 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 26 17:57:02.727730 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.727679 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.727894 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.727878 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 26 17:57:02.727894 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.727892 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 26 17:57:02.730362 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.730342 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kfj29\"" Jul 26 17:57:02.730473 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.730365 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 26 17:57:02.730566 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.730552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.730634 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.730613 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:02.733544 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.733528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:02.736166 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.736121 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-25 17:52:02 +0000 UTC" deadline="2028-04-01 06:13:56.241337685 +0000 UTC" Jul 26 17:57:02.736166 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.736164 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14748h16m53.5051769s" Jul 26 17:57:02.736474 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.736457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.736748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.736635 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4krpb\"" Jul 26 17:57:02.736748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.736637 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 26 17:57:02.736748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.736652 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 26 17:57:02.738916 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.738902 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 26 17:57:02.739137 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.739124 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsqm4\"" Jul 26 17:57:02.739223 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.739205 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 26 17:57:02.739298 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.739209 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 26 17:57:02.747079 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.747052 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-64tvk" Jul 26 17:57:02.755957 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.755938 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-64tvk" Jul 26 17:57:02.809502 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.809476 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 26 17:57:02.815213 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-kubernetes\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.815322 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysctl-conf\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.815322 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-lib-modules\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.815322 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-log-socket\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.815322 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.815322 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72aecfd4-b021-4785-b203-12a59b056341-kubelet-config\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-systemd\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cnibin\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-daemon-config\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72aecfd4-b021-4785-b203-12a59b056341-dbus\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3410ab75-f3e5-4f19-9d4e-a3d256b2528f-konnectivity-ca\") pod \"konnectivity-agent-4tsn4\" (UID: \"3410ab75-f3e5-4f19-9d4e-a3d256b2528f\") " pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4a4c57e-8faf-4045-b47c-34fc52be086a-iptables-alerter-script\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-cni-bin\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjqs\" (UniqueName: \"kubernetes.io/projected/06548e45-656c-46dd-9e46-f5433e0cfd27-kube-api-access-ltjqs\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-socket-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815572 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-system-cni-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.815592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-cni-bin\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-multus-certs\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-sys-fs\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815698 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-socket-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-tuned\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-sys-fs\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef31bff5-1025-488b-91bf-2d5d40aaccb8-tmp\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-registration-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzq47\" (UniqueName: \"kubernetes.io/projected/e82c225e-6d71-4825-b117-29957a7301c1-kube-api-access-dzq47\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-cnibin\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815940 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-registration-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjn2f\" (UniqueName: \"kubernetes.io/projected/fe8643d5-c142-43a1-8f9c-0169e832ef5a-kube-api-access-kjn2f\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.815992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.815993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-tmp-dir\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a74e93c1-e880-4b9d-abdc-ec56742fbf45-host\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-systemd\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-cni-multus\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-sys\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-os-release\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46c4\" (UniqueName: \"kubernetes.io/projected/5e57a9e8-4895-42a4-a68d-6345eb478fa5-kube-api-access-s46c4\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-systemd-units\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-kubelet\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-conf-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.816409 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-slash\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.816484 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs podName:e82c225e-6d71-4825-b117-29957a7301c1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:03.31646045 +0000 UTC m=+2.020187607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs") pod "network-metrics-daemon-vlzln" (UID: "e82c225e-6d71-4825-b117-29957a7301c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:02.816514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816521 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-device-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-hostroot\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-modprobe-d\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkwhx\" (UniqueName: \"kubernetes.io/projected/a74e93c1-e880-4b9d-abdc-ec56742fbf45-kube-api-access-wkwhx\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-var-lib-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-cni-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4a4c57e-8faf-4045-b47c-34fc52be086a-host-slash\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-device-dir\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc643b4d-a649-4ea2-9a59-195bfad480ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysctl-d\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnntr\" (UniqueName: \"kubernetes.io/projected/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-kube-api-access-jnntr\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-cni-netd\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-ovnkube-script-lib\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.816966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-socket-dir-parent\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.817348 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysconfig\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-run-netns\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3410ab75-f3e5-4f19-9d4e-a3d256b2528f-agent-certs\") pod \"konnectivity-agent-4tsn4\" (UID: \"3410ab75-f3e5-4f19-9d4e-a3d256b2528f\") " pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-var-lib-kubelet\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-host\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-system-cni-dir\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817435 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-etc-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817466 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-os-release\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-etc-kubernetes\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a74e93c1-e880-4b9d-abdc-ec56742fbf45-serviceca\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-ovnkube-config\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06548e45-656c-46dd-9e46-f5433e0cfd27-ovn-node-metrics-cert\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818072 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6x92\" (UniqueName: \"kubernetes.io/projected/d4a4c57e-8faf-4045-b47c-34fc52be086a-kube-api-access-q6x92\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817668 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-run\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpr26\" (UniqueName: \"kubernetes.io/projected/ef31bff5-1025-488b-91bf-2d5d40aaccb8-kube-api-access-hpr26\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817757 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-hosts-file\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-ovn\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe8643d5-c142-43a1-8f9c-0169e832ef5a-cni-binary-copy\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-env-overrides\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.817979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-netns\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.818020 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-kubelet\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.818057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-node-log\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.818083 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bn6c\" (UniqueName: \"kubernetes.io/projected/bc643b4d-a649-4ea2-9a59-195bfad480ac-kube-api-access-4bn6c\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.818575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.818113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-k8s-cni-cncf-io\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.828433 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.828411 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 26 17:57:02.831077 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.831053 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 26 17:57:02.831180 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.831082 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 26 17:57:02.831180 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.831097 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vkbfp for pod openshift-network-diagnostics/network-check-target-k47mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:02.831180 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.831165 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp podName:8aa976c7-8d7d-4b67-8814-89a7c1ee2f41 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:03.331146014 +0000 UTC m=+2.034873177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vkbfp" (UniqueName: "kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp") pod "network-check-target-k47mn" (UID: "8aa976c7-8d7d-4b67-8814-89a7c1ee2f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:02.832918 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.832897 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bn6c\" (UniqueName: \"kubernetes.io/projected/bc643b4d-a649-4ea2-9a59-195bfad480ac-kube-api-access-4bn6c\") pod \"aws-ebs-csi-driver-node-x9bxj\" (UID: \"bc643b4d-a649-4ea2-9a59-195bfad480ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:02.833003 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.832903 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzq47\" (UniqueName: \"kubernetes.io/projected/e82c225e-6d71-4825-b117-29957a7301c1-kube-api-access-dzq47\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:02.865871 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.864901 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 26 17:57:02.886120 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:02.886093 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d355a552e2e9bb7fc5a4bd746d646b8.slice/crio-becdc49863c290c7faf6e2cc9f466ca9e74cc2131dcba4733339b80306c046c2 WatchSource:0}: Error finding container becdc49863c290c7faf6e2cc9f466ca9e74cc2131dcba4733339b80306c046c2: Status 404 returned error can't find the container with id becdc49863c290c7faf6e2cc9f466ca9e74cc2131dcba4733339b80306c046c2 Jul 26 17:57:02.888188 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:02.888164 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdd46282848f78b3a7301feafbb6319.slice/crio-2e467758fea96fa6521f3457db110a1c183f37b39a638b23897a596e6e9da9a8 WatchSource:0}: Error finding container 2e467758fea96fa6521f3457db110a1c183f37b39a638b23897a596e6e9da9a8: Status 404 returned error can't find the container with id 2e467758fea96fa6521f3457db110a1c183f37b39a638b23897a596e6e9da9a8 Jul 26 17:57:02.890605 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.890586 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 26 17:57:02.918845 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-kubelet\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.918966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918849 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-conf-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.918966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.918966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-slash\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.918966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-hostroot\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.918966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918929 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-kubelet\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.918966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-modprobe-d\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.918966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918956 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-conf-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwhx\" (UniqueName: \"kubernetes.io/projected/a74e93c1-e880-4b9d-abdc-ec56742fbf45-kube-api-access-wkwhx\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918987 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-hostroot\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.918998 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-slash\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-var-lib-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919049 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-var-lib-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-cni-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4a4c57e-8faf-4045-b47c-34fc52be086a-host-slash\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919093 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-modprobe-d\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysctl-d\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnntr\" (UniqueName: \"kubernetes.io/projected/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-kube-api-access-jnntr\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-cni-netd\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919184 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysctl-d\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-ovnkube-script-lib\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-socket-dir-parent\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919216 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4a4c57e-8faf-4045-b47c-34fc52be086a-host-slash\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysconfig\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919245 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-cni-netd\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.919292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919255 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-cni-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919287 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysconfig\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919308 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-socket-dir-parent\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-run-netns\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919398 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-run-netns\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919401 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3410ab75-f3e5-4f19-9d4e-a3d256b2528f-agent-certs\") pod \"konnectivity-agent-4tsn4\" (UID: \"3410ab75-f3e5-4f19-9d4e-a3d256b2528f\") " pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-var-lib-kubelet\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919466 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-host\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-system-cni-dir\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-var-lib-kubelet\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-etc-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-os-release\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919567 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-system-cni-dir\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.919489 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-etc-kubernetes\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919613 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a74e93c1-e880-4b9d-abdc-ec56742fbf45-serviceca\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.920179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919641 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-os-release\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:02.919670 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret podName:72aecfd4-b021-4785-b203-12a59b056341 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:03.419647374 +0000 UTC m=+2.123374526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret") pod "global-pull-secret-syncer-9fwzm" (UID: "72aecfd4-b021-4785-b203-12a59b056341") : object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919680 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919686 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-etc-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-host\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919732 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-etc-kubernetes\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-ovnkube-config\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06548e45-656c-46dd-9e46-f5433e0cfd27-ovn-node-metrics-cert\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6x92\" (UniqueName: \"kubernetes.io/projected/d4a4c57e-8faf-4045-b47c-34fc52be086a-kube-api-access-q6x92\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919893 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919905 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-run\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.919860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-run\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920041 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-ovnkube-script-lib\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpr26\" (UniqueName: \"kubernetes.io/projected/ef31bff5-1025-488b-91bf-2d5d40aaccb8-kube-api-access-hpr26\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.921129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920129 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a74e93c1-e880-4b9d-abdc-ec56742fbf45-serviceca\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-hosts-file\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-ovn\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe8643d5-c142-43a1-8f9c-0169e832ef5a-cni-binary-copy\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-hosts-file\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-env-overrides\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-netns\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920306 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-ovn\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920333 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-kubelet\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920349 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-ovnkube-config\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-node-log\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920402 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-netns\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920425 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-kubelet\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-k8s-cni-cncf-io\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-kubernetes\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysctl-conf\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.921944 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920501 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-k8s-cni-cncf-io\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920548 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-kubernetes\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920549 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920470 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-node-log\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-lib-modules\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-log-socket\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920619 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-sysctl-conf\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72aecfd4-b021-4785-b203-12a59b056341-kubelet-config\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920683 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-log-socket\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920690 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06548e45-656c-46dd-9e46-f5433e0cfd27-env-overrides\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920709 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920721 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-lib-modules\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-systemd\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920743 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cnibin\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920783 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72aecfd4-b021-4785-b203-12a59b056341-kubelet-config\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.922583 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-daemon-config\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-systemd\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72aecfd4-b021-4785-b203-12a59b056341-dbus\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920846 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-cnibin\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3410ab75-f3e5-4f19-9d4e-a3d256b2528f-konnectivity-ca\") pod \"konnectivity-agent-4tsn4\" (UID: \"3410ab75-f3e5-4f19-9d4e-a3d256b2528f\") " pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4a4c57e-8faf-4045-b47c-34fc52be086a-iptables-alerter-script\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920898 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72aecfd4-b021-4785-b203-12a59b056341-dbus\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-cni-bin\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920936 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe8643d5-c142-43a1-8f9c-0169e832ef5a-cni-binary-copy\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjqs\" (UniqueName: \"kubernetes.io/projected/06548e45-656c-46dd-9e46-f5433e0cfd27-kube-api-access-ltjqs\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-system-cni-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.920993 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-host-cni-bin\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-cni-bin\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921034 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-multus-certs\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-tuned\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef31bff5-1025-488b-91bf-2d5d40aaccb8-tmp\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-cnibin\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923157 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjn2f\" (UniqueName: \"kubernetes.io/projected/fe8643d5-c142-43a1-8f9c-0169e832ef5a-kube-api-access-kjn2f\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921201 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-system-cni-dir\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-tmp-dir\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921266 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-run-multus-certs\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921280 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-cnibin\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921135 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-cni-bin\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921428 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3410ab75-f3e5-4f19-9d4e-a3d256b2528f-konnectivity-ca\") pod \"konnectivity-agent-4tsn4\" (UID: \"3410ab75-f3e5-4f19-9d4e-a3d256b2528f\") " pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a74e93c1-e880-4b9d-abdc-ec56742fbf45-host\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-tmp-dir\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-systemd\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921573 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4a4c57e-8faf-4045-b47c-34fc52be086a-iptables-alerter-script\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-cni-multus\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921615 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-sys\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921628 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a74e93c1-e880-4b9d-abdc-ec56742fbf45-host\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-os-release\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s46c4\" (UniqueName: \"kubernetes.io/projected/5e57a9e8-4895-42a4-a68d-6345eb478fa5-kube-api-access-s46c4\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921683 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe8643d5-c142-43a1-8f9c-0169e832ef5a-host-var-lib-cni-multus\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921641 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-systemd\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.923737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-systemd-units\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921685 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef31bff5-1025-488b-91bf-2d5d40aaccb8-sys\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921705 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e57a9e8-4895-42a4-a68d-6345eb478fa5-os-release\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921731 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-systemd-units\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.921765 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06548e45-656c-46dd-9e46-f5433e0cfd27-run-openvswitch\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.922075 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe8643d5-c142-43a1-8f9c-0169e832ef5a-multus-daemon-config\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.922305 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3410ab75-f3e5-4f19-9d4e-a3d256b2528f-agent-certs\") pod \"konnectivity-agent-4tsn4\" (UID: \"3410ab75-f3e5-4f19-9d4e-a3d256b2528f\") " pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.923033 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06548e45-656c-46dd-9e46-f5433e0cfd27-ovn-node-metrics-cert\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.923625 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef31bff5-1025-488b-91bf-2d5d40aaccb8-tmp\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.924277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.923757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef31bff5-1025-488b-91bf-2d5d40aaccb8-etc-tuned\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.934918 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.934884 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkwhx\" (UniqueName: \"kubernetes.io/projected/a74e93c1-e880-4b9d-abdc-ec56742fbf45-kube-api-access-wkwhx\") pod \"node-ca-9lzgg\" (UID: \"a74e93c1-e880-4b9d-abdc-ec56742fbf45\") " pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:02.935885 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.935859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6x92\" (UniqueName: \"kubernetes.io/projected/d4a4c57e-8faf-4045-b47c-34fc52be086a-kube-api-access-q6x92\") pod \"iptables-alerter-tqrk6\" (UID: \"d4a4c57e-8faf-4045-b47c-34fc52be086a\") " pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:02.936385 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.936362 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjqs\" (UniqueName: \"kubernetes.io/projected/06548e45-656c-46dd-9e46-f5433e0cfd27-kube-api-access-ltjqs\") pod \"ovnkube-node-jnltj\" (UID: \"06548e45-656c-46dd-9e46-f5433e0cfd27\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:02.936969 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.936949 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnntr\" (UniqueName: \"kubernetes.io/projected/f216a66e-0611-4d7e-b7ab-6bf977bbfd6c-kube-api-access-jnntr\") pod \"node-resolver-hggld\" (UID: \"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c\") " pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:02.937314 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.937297 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpr26\" (UniqueName: \"kubernetes.io/projected/ef31bff5-1025-488b-91bf-2d5d40aaccb8-kube-api-access-hpr26\") pod \"tuned-8z6ln\" (UID: \"ef31bff5-1025-488b-91bf-2d5d40aaccb8\") " pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:02.938054 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.938034 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjn2f\" (UniqueName: \"kubernetes.io/projected/fe8643d5-c142-43a1-8f9c-0169e832ef5a-kube-api-access-kjn2f\") pod \"multus-pmdlc\" (UID: \"fe8643d5-c142-43a1-8f9c-0169e832ef5a\") " pod="openshift-multus/multus-pmdlc" Jul 26 17:57:02.938404 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:02.938371 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46c4\" (UniqueName: \"kubernetes.io/projected/5e57a9e8-4895-42a4-a68d-6345eb478fa5-kube-api-access-s46c4\") pod \"multus-additional-cni-plugins-cprtz\" (UID: \"5e57a9e8-4895-42a4-a68d-6345eb478fa5\") " pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:03.022649 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.022592 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 26 17:57:03.036878 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.036854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" Jul 26 17:57:03.047029 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.047007 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc643b4d_a649_4ea2_9a59_195bfad480ac.slice/crio-b9659cfde558b6acd3fc19a9599a9912d65b86936963c730367e219194c5955a WatchSource:0}: Error finding container b9659cfde558b6acd3fc19a9599a9912d65b86936963c730367e219194c5955a: Status 404 returned error can't find the container with id b9659cfde558b6acd3fc19a9599a9912d65b86936963c730367e219194c5955a Jul 26 17:57:03.054392 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.054367 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" Jul 26 17:57:03.062933 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.062912 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef31bff5_1025_488b_91bf_2d5d40aaccb8.slice/crio-919e50a446bd443d1de1f27982eef42cd99fc9e6b9aebc4caf762c6f75ff65ce WatchSource:0}: Error finding container 919e50a446bd443d1de1f27982eef42cd99fc9e6b9aebc4caf762c6f75ff65ce: Status 404 returned error can't find the container with id 919e50a446bd443d1de1f27982eef42cd99fc9e6b9aebc4caf762c6f75ff65ce Jul 26 17:57:03.067299 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.067282 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hggld" Jul 26 17:57:03.075085 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.075060 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf216a66e_0611_4d7e_b7ab_6bf977bbfd6c.slice/crio-60b7ebb40578bd7fb0de747a8f40ff506dd776d9e6e6d84a4b5ba1861489d9e8 WatchSource:0}: Error finding container 60b7ebb40578bd7fb0de747a8f40ff506dd776d9e6e6d84a4b5ba1861489d9e8: Status 404 returned error can't find the container with id 60b7ebb40578bd7fb0de747a8f40ff506dd776d9e6e6d84a4b5ba1861489d9e8 Jul 26 17:57:03.081287 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.081241 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lzgg" Jul 26 17:57:03.090781 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.090757 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74e93c1_e880_4b9d_abdc_ec56742fbf45.slice/crio-aaf8d5b2e000b355fd32a4e100428f68bd10e23ee3f837741e357b29a43a7dea WatchSource:0}: Error finding container aaf8d5b2e000b355fd32a4e100428f68bd10e23ee3f837741e357b29a43a7dea: Status 404 returned error can't find the container with id aaf8d5b2e000b355fd32a4e100428f68bd10e23ee3f837741e357b29a43a7dea Jul 26 17:57:03.096727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.096707 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:03.104377 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.104356 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06548e45_656c_46dd_9e46_f5433e0cfd27.slice/crio-2f8de6de7491a9b3c2bb9c6e652c259f50ccd47b9ab4746a617902aeedde0093 WatchSource:0}: Error finding container 2f8de6de7491a9b3c2bb9c6e652c259f50ccd47b9ab4746a617902aeedde0093: Status 404 returned error can't find the container with id 2f8de6de7491a9b3c2bb9c6e652c259f50ccd47b9ab4746a617902aeedde0093 Jul 26 17:57:03.113495 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.113471 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cprtz" Jul 26 17:57:03.122079 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.122056 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e57a9e8_4895_42a4_a68d_6345eb478fa5.slice/crio-e851ef4baf7113903440d6b2bf3b18e40863efce06ce8c7899b3c87b406d0af7 WatchSource:0}: Error finding container e851ef4baf7113903440d6b2bf3b18e40863efce06ce8c7899b3c87b406d0af7: Status 404 returned error can't find the container with id e851ef4baf7113903440d6b2bf3b18e40863efce06ce8c7899b3c87b406d0af7 Jul 26 17:57:03.129434 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.129414 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pmdlc" Jul 26 17:57:03.137885 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.137863 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe8643d5_c142_43a1_8f9c_0169e832ef5a.slice/crio-b934554f32700e78f9070ac3e99bb88415a7e60c3192d3bb129cdd15f51f812a WatchSource:0}: Error finding container b934554f32700e78f9070ac3e99bb88415a7e60c3192d3bb129cdd15f51f812a: Status 404 returned error can't find the container with id b934554f32700e78f9070ac3e99bb88415a7e60c3192d3bb129cdd15f51f812a Jul 26 17:57:03.150322 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.150304 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:03.156477 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.156450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tqrk6" Jul 26 17:57:03.159817 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.159795 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3410ab75_f3e5_4f19_9d4e_a3d256b2528f.slice/crio-ee5472788f85bca029f9966bd576c63d2feb3ea278151017d04d3e5cf13a1e49 WatchSource:0}: Error finding container ee5472788f85bca029f9966bd576c63d2feb3ea278151017d04d3e5cf13a1e49: Status 404 returned error can't find the container with id ee5472788f85bca029f9966bd576c63d2feb3ea278151017d04d3e5cf13a1e49 Jul 26 17:57:03.164824 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:03.164804 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a4c57e_8faf_4045_b47c_34fc52be086a.slice/crio-903f1a3d75a19e4aaa54609da2bb2e01a617258a6fc2cfb0759e5091add1b6a0 WatchSource:0}: Error finding container 903f1a3d75a19e4aaa54609da2bb2e01a617258a6fc2cfb0759e5091add1b6a0: Status 404 returned error can't find the container with id 903f1a3d75a19e4aaa54609da2bb2e01a617258a6fc2cfb0759e5091add1b6a0 Jul 26 17:57:03.324789 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.324701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:03.324962 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.324844 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:03.324962 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.324917 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs podName:e82c225e-6d71-4825-b117-29957a7301c1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:04.324883661 +0000 UTC m=+3.028610820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs") pod "network-metrics-daemon-vlzln" (UID: "e82c225e-6d71-4825-b117-29957a7301c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:03.426030 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.425986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:03.426030 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.426023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:03.426281 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.426171 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:03.426281 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.426236 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret podName:72aecfd4-b021-4785-b203-12a59b056341 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:04.426218288 +0000 UTC m=+3.129945437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret") pod "global-pull-secret-syncer-9fwzm" (UID: "72aecfd4-b021-4785-b203-12a59b056341") : object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:03.426281 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.426174 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 26 17:57:03.426536 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.426293 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 26 17:57:03.426536 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.426309 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vkbfp for pod openshift-network-diagnostics/network-check-target-k47mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:03.426536 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.426391 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp podName:8aa976c7-8d7d-4b67-8814-89a7c1ee2f41 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:04.426375846 +0000 UTC m=+3.130103005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkbfp" (UniqueName: "kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp") pod "network-check-target-k47mn" (UID: "8aa976c7-8d7d-4b67-8814-89a7c1ee2f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:03.760435 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.760251 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 17:52:03 +0000 UTC" deadline="2028-03-28 22:38:11.28440648 +0000 UTC" Jul 26 17:57:03.760435 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.760314 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14668h41m7.524096916s" Jul 26 17:57:03.847713 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.847109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:03.847713 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:03.847253 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:03.895730 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.895661 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pmdlc" event={"ID":"fe8643d5-c142-43a1-8f9c-0169e832ef5a","Type":"ContainerStarted","Data":"b934554f32700e78f9070ac3e99bb88415a7e60c3192d3bb129cdd15f51f812a"} Jul 26 17:57:03.910015 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.909975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"2f8de6de7491a9b3c2bb9c6e652c259f50ccd47b9ab4746a617902aeedde0093"} Jul 26 17:57:03.912401 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.912368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lzgg" event={"ID":"a74e93c1-e880-4b9d-abdc-ec56742fbf45","Type":"ContainerStarted","Data":"aaf8d5b2e000b355fd32a4e100428f68bd10e23ee3f837741e357b29a43a7dea"} Jul 26 17:57:03.921536 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.921503 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" event={"ID":"ef31bff5-1025-488b-91bf-2d5d40aaccb8","Type":"ContainerStarted","Data":"919e50a446bd443d1de1f27982eef42cd99fc9e6b9aebc4caf762c6f75ff65ce"} Jul 26 17:57:03.933181 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.933151 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 26 17:57:03.942935 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.942903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" event={"ID":"bc643b4d-a649-4ea2-9a59-195bfad480ac","Type":"ContainerStarted","Data":"b9659cfde558b6acd3fc19a9599a9912d65b86936963c730367e219194c5955a"} Jul 26 17:57:03.962986 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.962928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" event={"ID":"9bdd46282848f78b3a7301feafbb6319","Type":"ContainerStarted","Data":"2e467758fea96fa6521f3457db110a1c183f37b39a638b23897a596e6e9da9a8"} Jul 26 17:57:03.978695 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:03.978624 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cprtz" event={"ID":"5e57a9e8-4895-42a4-a68d-6345eb478fa5","Type":"ContainerStarted","Data":"e851ef4baf7113903440d6b2bf3b18e40863efce06ce8c7899b3c87b406d0af7"} Jul 26 17:57:04.005520 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.005125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hggld" event={"ID":"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c","Type":"ContainerStarted","Data":"60b7ebb40578bd7fb0de747a8f40ff506dd776d9e6e6d84a4b5ba1861489d9e8"} Jul 26 17:57:04.023743 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.023654 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" event={"ID":"2d355a552e2e9bb7fc5a4bd746d646b8","Type":"ContainerStarted","Data":"becdc49863c290c7faf6e2cc9f466ca9e74cc2131dcba4733339b80306c046c2"} Jul 26 17:57:04.069040 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.068732 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tqrk6" event={"ID":"d4a4c57e-8faf-4045-b47c-34fc52be086a","Type":"ContainerStarted","Data":"903f1a3d75a19e4aaa54609da2bb2e01a617258a6fc2cfb0759e5091add1b6a0"} Jul 26 17:57:04.089129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.089069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4tsn4" event={"ID":"3410ab75-f3e5-4f19-9d4e-a3d256b2528f","Type":"ContainerStarted","Data":"ee5472788f85bca029f9966bd576c63d2feb3ea278151017d04d3e5cf13a1e49"} Jul 26 17:57:04.336839 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.336744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:04.337014 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.336933 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:04.337014 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.337002 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs podName:e82c225e-6d71-4825-b117-29957a7301c1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:06.336980247 +0000 UTC m=+5.040707414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs") pod "network-metrics-daemon-vlzln" (UID: "e82c225e-6d71-4825-b117-29957a7301c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:04.376277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.376242 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 26 17:57:04.438123 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.438084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:04.438293 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.438133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:04.438293 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.438275 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:04.438431 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.438338 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret podName:72aecfd4-b021-4785-b203-12a59b056341 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:06.43831863 +0000 UTC m=+5.142045770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret") pod "global-pull-secret-syncer-9fwzm" (UID: "72aecfd4-b021-4785-b203-12a59b056341") : object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:04.438802 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.438766 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 26 17:57:04.438802 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.438786 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 26 17:57:04.438802 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.438800 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vkbfp for pod openshift-network-diagnostics/network-check-target-k47mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:04.439018 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.438845 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp podName:8aa976c7-8d7d-4b67-8814-89a7c1ee2f41 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:06.438830282 +0000 UTC m=+5.142557424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkbfp" (UniqueName: "kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp") pod "network-check-target-k47mn" (UID: "8aa976c7-8d7d-4b67-8814-89a7c1ee2f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:04.760650 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.760550 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 17:52:03 +0000 UTC" deadline="2028-03-03 20:26:37.379928112 +0000 UTC" Jul 26 17:57:04.760650 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.760592 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14066h29m32.619341247s" Jul 26 17:57:04.844047 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.844017 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:04.844257 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.844148 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:04.844590 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:04.844568 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:04.844699 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:04.844677 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:05.846289 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:05.846257 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:05.846881 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:05.846427 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:06.358699 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:06.358658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:06.359169 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.358886 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:06.359169 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.358956 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs podName:e82c225e-6d71-4825-b117-29957a7301c1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:10.35893539 +0000 UTC m=+9.062662533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs") pod "network-metrics-daemon-vlzln" (UID: "e82c225e-6d71-4825-b117-29957a7301c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:06.459748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:06.459708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:06.459748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:06.459750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:06.460000 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.459877 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:06.460000 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.459910 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 26 17:57:06.460000 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.459940 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 26 17:57:06.460000 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.459941 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret podName:72aecfd4-b021-4785-b203-12a59b056341 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:10.459922144 +0000 UTC m=+9.163649288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret") pod "global-pull-secret-syncer-9fwzm" (UID: "72aecfd4-b021-4785-b203-12a59b056341") : object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:06.460000 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.459955 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vkbfp for pod openshift-network-diagnostics/network-check-target-k47mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:06.460239 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.460011 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp podName:8aa976c7-8d7d-4b67-8814-89a7c1ee2f41 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:10.459994565 +0000 UTC m=+9.163721705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkbfp" (UniqueName: "kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp") pod "network-check-target-k47mn" (UID: "8aa976c7-8d7d-4b67-8814-89a7c1ee2f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:06.844644 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:06.844582 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:06.844842 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.844724 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:06.844842 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:06.844584 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:06.844842 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:06.844833 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:07.845497 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:07.845286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:07.845944 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:07.845805 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:08.844932 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:08.844215 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:08.844932 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:08.844367 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:08.844932 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:08.844787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:08.844932 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:08.844886 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:09.844468 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:09.844396 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:09.844935 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:09.844554 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:10.396446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:10.396309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:10.396623 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.396550 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:10.396721 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.396706 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs podName:e82c225e-6d71-4825-b117-29957a7301c1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:18.396658231 +0000 UTC m=+17.100385370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs") pod "network-metrics-daemon-vlzln" (UID: "e82c225e-6d71-4825-b117-29957a7301c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:10.497103 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:10.497066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:10.497280 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:10.497117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:10.497280 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.497226 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:10.497280 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.497230 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 26 17:57:10.497280 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.497251 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 26 17:57:10.497280 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.497263 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vkbfp for pod openshift-network-diagnostics/network-check-target-k47mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:10.497583 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.497293 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret podName:72aecfd4-b021-4785-b203-12a59b056341 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:18.497274135 +0000 UTC m=+17.201001289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret") pod "global-pull-secret-syncer-9fwzm" (UID: "72aecfd4-b021-4785-b203-12a59b056341") : object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:10.497583 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.497312 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp podName:8aa976c7-8d7d-4b67-8814-89a7c1ee2f41 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:18.497302328 +0000 UTC m=+17.201029467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkbfp" (UniqueName: "kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp") pod "network-check-target-k47mn" (UID: "8aa976c7-8d7d-4b67-8814-89a7c1ee2f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:10.844028 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:10.843993 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:10.844234 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.844135 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:10.844604 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:10.844437 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:10.844604 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:10.844556 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:11.845595 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:11.845104 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:11.845595 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:11.845230 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:12.844798 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:12.844766 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:12.844798 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:12.844786 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:12.844991 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:12.844894 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:12.844991 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:12.844975 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:13.844559 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:13.844527 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:13.844963 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:13.844678 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:14.844179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:14.844159 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:14.844267 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:14.844251 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:14.844419 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:14.844403 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:14.844501 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:14.844485 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:15.844108 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:15.844072 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:15.844596 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:15.844214 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:16.844172 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:16.844134 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:16.844597 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:16.844132 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:16.844597 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:16.844269 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:16.844597 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:16.844366 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:17.844210 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:17.844179 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:17.844671 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:17.844303 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:18.457822 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:18.457792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:18.457971 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.457945 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:18.458014 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.458003 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs podName:e82c225e-6d71-4825-b117-29957a7301c1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:34.457989221 +0000 UTC m=+33.161716358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs") pod "network-metrics-daemon-vlzln" (UID: "e82c225e-6d71-4825-b117-29957a7301c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:18.558095 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:18.558064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:18.558095 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:18.558101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:18.558261 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.558194 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:18.558261 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.558213 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 26 17:57:18.558261 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.558233 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 26 17:57:18.558261 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.558242 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret podName:72aecfd4-b021-4785-b203-12a59b056341 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:34.558228958 +0000 UTC m=+33.261956094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret") pod "global-pull-secret-syncer-9fwzm" (UID: "72aecfd4-b021-4785-b203-12a59b056341") : object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:18.558261 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.558243 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vkbfp for pod openshift-network-diagnostics/network-check-target-k47mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:18.558440 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.558275 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp podName:8aa976c7-8d7d-4b67-8814-89a7c1ee2f41 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:34.558268828 +0000 UTC m=+33.261995976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkbfp" (UniqueName: "kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp") pod "network-check-target-k47mn" (UID: "8aa976c7-8d7d-4b67-8814-89a7c1ee2f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:18.844844 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:18.844811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:18.845331 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.844947 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:18.845331 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:18.844982 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:18.845331 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:18.845051 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:19.844715 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:19.844682 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:19.844875 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:19.844813 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:20.844406 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:20.844372 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:20.844871 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:20.844385 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:20.844871 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:20.844505 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:20.844871 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:20.844579 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:21.844362 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:21.844327 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:21.844541 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:21.844425 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:22.844575 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:22.844410 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:22.844982 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:22.844436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:22.844982 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:22.844669 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:22.844982 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:22.844765 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:23.133300 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:23.133272 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pmdlc" event={"ID":"fe8643d5-c142-43a1-8f9c-0169e832ef5a","Type":"ContainerStarted","Data":"2ae2a230bbf192d1675a87e444535ddf0c97798fcd1a97db337ee07fa401a873"} Jul 26 17:57:23.135360 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:23.135260 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"e11c1930501c349a6cef50fcdbb6a8de5d9ac129d88265bbf68cc0a519486653"} Jul 26 17:57:23.136953 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:23.136927 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" event={"ID":"ef31bff5-1025-488b-91bf-2d5d40aaccb8","Type":"ContainerStarted","Data":"b5398d08aa8c68b2b8a01ee22749588a9612300a1e81f4adb120f7aaa65766ae"} Jul 26 17:57:23.138265 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:23.138240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" event={"ID":"2d355a552e2e9bb7fc5a4bd746d646b8","Type":"ContainerStarted","Data":"d8665246e65decb42c687786f68fe30458c4065e833fc950b6bd10d36646c57f"} Jul 26 17:57:23.152623 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:23.152208 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pmdlc" podStartSLOduration=1.636408486 podStartE2EDuration="21.152188199s" totalImagesPullingTime="19.515779713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:23.151609192 +0000 UTC m=+21.855336352" watchObservedRunningTime="2026-07-26 17:57:23.152188199 +0000 UTC m=+21.855915357" Jul 26 17:57:23.168605 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:23.168344 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8z6ln" podStartSLOduration=1.60853555 podStartE2EDuration="21.168326447s" totalImagesPullingTime="19.559790897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:23.167897742 +0000 UTC m=+21.871624902" watchObservedRunningTime="2026-07-26 17:57:23.168326447 +0000 UTC m=+21.872053601" Jul 26 17:57:23.183063 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:23.183024 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-146.ec2.internal" podStartSLOduration=20.183011679 podStartE2EDuration="20.183011679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:23.182629536 +0000 UTC m=+21.886356693" watchObservedRunningTime="2026-07-26 17:57:23.183011679 +0000 UTC m=+21.886738835" Jul 26 17:57:23.844365 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:23.844150 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:23.844528 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:23.844457 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:24.143370 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.143344 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 17:57:24.143954 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.143672 2565 generic.go:356] "Generic (PLEG): container finished" podID="06548e45-656c-46dd-9e46-f5433e0cfd27" containerID="6f45fe76d55b178756dd847698fdc5c754345cf67f765aee78d36ec9e7376ed3" exitCode=1 Jul 26 17:57:24.143954 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.143744 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"7f28e1c493770d13b7a3db43d8f0bb755bc75b6a8eb8cf453a11aaededb7d838"} Jul 26 17:57:24.143954 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.143824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"03d7f7633a0d0a079f1129210f1c8c34284fe7af1da9db65d6263bb510644063"} Jul 26 17:57:24.143954 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.143866 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"57f6867686f7bc4a3640829bec096586fc67bc3b714f9f03e8ea88d8593209de"} Jul 26 17:57:24.143954 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.143903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"a633ee12db384c8189c746e7cdc505429c1239dca2dc3dc64a26e1aeda4387fd"} Jul 26 17:57:24.143954 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.143936 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerDied","Data":"6f45fe76d55b178756dd847698fdc5c754345cf67f765aee78d36ec9e7376ed3"} Jul 26 17:57:24.145038 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.145014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lzgg" event={"ID":"a74e93c1-e880-4b9d-abdc-ec56742fbf45","Type":"ContainerStarted","Data":"ecc3aaac90a2d52a19d32e5ec4f20a6690ea27ba4279a18947087152e26bf9ce"} Jul 26 17:57:24.146295 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.146274 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" event={"ID":"bc643b4d-a649-4ea2-9a59-195bfad480ac","Type":"ContainerStarted","Data":"3d355063435ea8b394feda5e433250d931926f33fe021bfa80a25a29788a2fda"} Jul 26 17:57:24.147609 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.147591 2565 generic.go:356] "Generic (PLEG): container finished" podID="9bdd46282848f78b3a7301feafbb6319" containerID="e8e00346bd02fefa21c895f55b207ad2605f294de92795a14d9d0b3a0e90ae93" exitCode=0 Jul 26 17:57:24.147699 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.147651 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" event={"ID":"9bdd46282848f78b3a7301feafbb6319","Type":"ContainerDied","Data":"e8e00346bd02fefa21c895f55b207ad2605f294de92795a14d9d0b3a0e90ae93"} Jul 26 17:57:24.148999 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.148979 2565 generic.go:356] "Generic (PLEG): container finished" podID="5e57a9e8-4895-42a4-a68d-6345eb478fa5" containerID="68d646d0ee5e4f65e79ed9561569fca92eeb2bb42b0866b88c825524b8adece8" exitCode=0 Jul 26 17:57:24.149098 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.149036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cprtz" event={"ID":"5e57a9e8-4895-42a4-a68d-6345eb478fa5","Type":"ContainerDied","Data":"68d646d0ee5e4f65e79ed9561569fca92eeb2bb42b0866b88c825524b8adece8"} Jul 26 17:57:24.150327 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.150300 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hggld" event={"ID":"f216a66e-0611-4d7e-b7ab-6bf977bbfd6c","Type":"ContainerStarted","Data":"488dad2e89efd324d53d02ebfead9ce7242660b7b0beff7affe00151ebf9a00a"} Jul 26 17:57:24.151640 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.151622 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tqrk6" event={"ID":"d4a4c57e-8faf-4045-b47c-34fc52be086a","Type":"ContainerStarted","Data":"d90aca7e04fd9223592d956000d23ba5624604a1721558ad269f6b3b32281f9c"} Jul 26 17:57:24.152897 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.152877 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4tsn4" event={"ID":"3410ab75-f3e5-4f19-9d4e-a3d256b2528f","Type":"ContainerStarted","Data":"e4d4b725275a3af2a4556168328b0cb52266f91966ba7f8f9a6f850546a3dbdf"} Jul 26 17:57:24.175225 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.175183 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4tsn4" podStartSLOduration=10.42720204 podStartE2EDuration="22.175171241s" totalImagesPullingTime="11.747969201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:24.175046458 +0000 UTC m=+22.878773616" watchObservedRunningTime="2026-07-26 17:57:24.175171241 +0000 UTC m=+22.878898398" Jul 26 17:57:24.175630 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.175603 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9lzgg" podStartSLOduration=2.649041646 podStartE2EDuration="22.175593753s" totalImagesPullingTime="19.526552107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:24.15816759 +0000 UTC m=+22.861894747" watchObservedRunningTime="2026-07-26 17:57:24.175593753 +0000 UTC m=+22.879320911" Jul 26 17:57:24.189689 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.189655 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tqrk6" podStartSLOduration=2.736947291 podStartE2EDuration="22.189644058s" totalImagesPullingTime="19.452696767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:24.189418676 +0000 UTC m=+22.893145834" watchObservedRunningTime="2026-07-26 17:57:24.189644058 +0000 UTC m=+22.893371216" Jul 26 17:57:24.207264 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.207223 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hggld" podStartSLOduration=2.66511348 podStartE2EDuration="22.207211648s" totalImagesPullingTime="19.542098168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:24.206761916 +0000 UTC m=+22.910489073" watchObservedRunningTime="2026-07-26 17:57:24.207211648 +0000 UTC m=+22.910938806" Jul 26 17:57:24.378200 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.378141 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 26 17:57:24.790794 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.790688 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-26T17:57:24.378168923Z","UUID":"8698ef13-a031-4cd1-94ca-459eab3ddc94","Handler":null,"Name":"","Endpoint":""} Jul 26 17:57:24.793051 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.793021 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 26 17:57:24.793180 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.793067 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 26 17:57:24.843870 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.843826 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:24.844093 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:24.843843 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:24.844093 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:24.843961 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:24.844093 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:24.844016 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:25.157467 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:25.157424 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" event={"ID":"bc643b4d-a649-4ea2-9a59-195bfad480ac","Type":"ContainerStarted","Data":"7e3e87d8b0cb23e3f50391ee2ac6624f57c2d8eee3b49216befafcdccc0df9dc"} Jul 26 17:57:25.159714 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:25.159654 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" event={"ID":"9bdd46282848f78b3a7301feafbb6319","Type":"ContainerStarted","Data":"c5df9186b951f7bb2cb2185b9936b6859d0888e3c3629baba0e1795ac9079442"} Jul 26 17:57:25.844548 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:25.844474 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:25.844705 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:25.844609 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:26.165636 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.165553 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 17:57:26.166061 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.165999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"5a56f9a4017e94328baa5aadf58a4ca626cbc68cd85b28e1bff4fe8933c56d57"} Jul 26 17:57:26.168121 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.168089 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" event={"ID":"bc643b4d-a649-4ea2-9a59-195bfad480ac","Type":"ContainerStarted","Data":"46ce107065043e7fde0307dbadd5c5ac3b0a5ed3baed5d806835cb8ae64c3687"} Jul 26 17:57:26.190276 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.190224 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9bxj" podStartSLOduration=2.3162377210000002 podStartE2EDuration="24.190208477s" totalImagesPullingTime="21.873970756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:26.189741771 +0000 UTC m=+24.893468932" watchObservedRunningTime="2026-07-26 17:57:26.190208477 +0000 UTC m=+24.893935634" Jul 26 17:57:26.190467 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.190408 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-146.ec2.internal" podStartSLOduration=23.190395563 podStartE2EDuration="23.190395563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:25.176057514 +0000 UTC m=+23.879784674" watchObservedRunningTime="2026-07-26 17:57:26.190395563 +0000 UTC m=+24.894122722" Jul 26 17:57:26.302349 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.302291 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:26.303014 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.302995 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:26.844363 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.844175 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:26.844537 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:26.844176 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:26.844537 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:26.844436 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:26.844636 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:26.844548 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:27.170276 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:27.170195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:27.170757 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:27.170735 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4tsn4" Jul 26 17:57:27.844400 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:27.844367 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:27.844570 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:27.844501 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:28.844387 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:28.844149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:28.844955 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:28.844149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:28.844955 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:28.844419 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:28.844955 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:28.844496 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:29.177048 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.176982 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 17:57:29.177365 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.177332 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"7fd3bc084f945c5a534dc843a58f6076c76574bf7cc187aab85774a34b237ce5"} Jul 26 17:57:29.177552 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.177537 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:29.177643 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.177606 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:29.177790 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.177775 2565 scope.go:117] "RemoveContainer" containerID="6f45fe76d55b178756dd847698fdc5c754345cf67f765aee78d36ec9e7376ed3" Jul 26 17:57:29.179208 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.179182 2565 generic.go:356] "Generic (PLEG): container finished" podID="5e57a9e8-4895-42a4-a68d-6345eb478fa5" containerID="42d13eae2e0ef05fd8327c3788fa38c2899655723d7d39eceade4e26dc92c494" exitCode=0 Jul 26 17:57:29.179300 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.179227 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cprtz" event={"ID":"5e57a9e8-4895-42a4-a68d-6345eb478fa5","Type":"ContainerDied","Data":"42d13eae2e0ef05fd8327c3788fa38c2899655723d7d39eceade4e26dc92c494"} Jul 26 17:57:29.193809 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.193790 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:29.843839 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:29.843810 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:29.844092 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:29.843924 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:30.184342 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.184273 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 17:57:30.184717 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.184619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" event={"ID":"06548e45-656c-46dd-9e46-f5433e0cfd27","Type":"ContainerStarted","Data":"9aa4dfcc08868088a8098b63fcb12049c839026432c0d30e7714355b62f3cfa3"} Jul 26 17:57:30.184927 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.184909 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:30.198296 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.198277 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:57:30.208369 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.208284 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" podStartSLOduration=8.398542354 podStartE2EDuration="28.20826856s" totalImagesPullingTime="19.809726206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:30.208097556 +0000 UTC m=+28.911824714" watchObservedRunningTime="2026-07-26 17:57:30.20826856 +0000 UTC m=+28.911995718" Jul 26 17:57:30.655779 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.655746 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k47mn"] Jul 26 17:57:30.655951 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.655916 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:30.656039 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:30.656020 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:30.656297 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.656282 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9fwzm"] Jul 26 17:57:30.656405 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.656393 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:30.656500 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:30.656484 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:30.656902 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.656881 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vlzln"] Jul 26 17:57:30.656994 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:30.656979 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:30.657101 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:30.657081 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:31.188965 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:31.188927 2565 generic.go:356] "Generic (PLEG): container finished" podID="5e57a9e8-4895-42a4-a68d-6345eb478fa5" containerID="9519edaa123eba7ba1340d5bbbaf645fa46223c0a77df83e3fb1f3efee151389" exitCode=0 Jul 26 17:57:31.189377 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:31.189008 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cprtz" event={"ID":"5e57a9e8-4895-42a4-a68d-6345eb478fa5","Type":"ContainerDied","Data":"9519edaa123eba7ba1340d5bbbaf645fa46223c0a77df83e3fb1f3efee151389"} Jul 26 17:57:31.848209 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:31.848021 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:31.848209 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:31.848163 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:32.844125 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:32.843951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:32.844523 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:32.844005 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:32.844523 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:32.844205 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:32.844523 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:32.844281 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:33.195065 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:33.194992 2565 generic.go:356] "Generic (PLEG): container finished" podID="5e57a9e8-4895-42a4-a68d-6345eb478fa5" containerID="69eb1e3c5d231b224ec4bd6e728e582a9a2ac5a139327e60c4d195a19a5a33f1" exitCode=0 Jul 26 17:57:33.195065 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:33.195034 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cprtz" event={"ID":"5e57a9e8-4895-42a4-a68d-6345eb478fa5","Type":"ContainerDied","Data":"69eb1e3c5d231b224ec4bd6e728e582a9a2ac5a139327e60c4d195a19a5a33f1"} Jul 26 17:57:33.843810 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:33.843774 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:33.843973 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:33.843873 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fwzm" podUID="72aecfd4-b021-4785-b203-12a59b056341" Jul 26 17:57:34.483512 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:34.483438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:34.484065 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.483626 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:34.484065 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.483701 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs podName:e82c225e-6d71-4825-b117-29957a7301c1 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:06.483681433 +0000 UTC m=+65.187408569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs") pod "network-metrics-daemon-vlzln" (UID: "e82c225e-6d71-4825-b117-29957a7301c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 26 17:57:34.584144 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:34.584111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:34.584301 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:34.584155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:34.584301 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.584256 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:34.584301 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.584274 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 26 17:57:34.584301 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.584298 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 26 17:57:34.584633 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.584327 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vkbfp for pod openshift-network-diagnostics/network-check-target-k47mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:34.584633 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.584331 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret podName:72aecfd4-b021-4785-b203-12a59b056341 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:06.584295414 +0000 UTC m=+65.288022551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret") pod "global-pull-secret-syncer-9fwzm" (UID: "72aecfd4-b021-4785-b203-12a59b056341") : object "kube-system"/"original-pull-secret" not registered Jul 26 17:57:34.584633 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.584373 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp podName:8aa976c7-8d7d-4b67-8814-89a7c1ee2f41 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:06.584357287 +0000 UTC m=+65.288084426 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkbfp" (UniqueName: "kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp") pod "network-check-target-k47mn" (UID: "8aa976c7-8d7d-4b67-8814-89a7c1ee2f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 26 17:57:34.844049 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:34.844018 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:34.844234 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.844131 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k47mn" podUID="8aa976c7-8d7d-4b67-8814-89a7c1ee2f41" Jul 26 17:57:34.844234 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:34.844141 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:34.844365 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:34.844306 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlzln" podUID="e82c225e-6d71-4825-b117-29957a7301c1" Jul 26 17:57:35.552192 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.552169 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-146.ec2.internal" event="NodeReady" Jul 26 17:57:35.552627 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.552302 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 26 17:57:35.584966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.584937 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-888964c5f-9ldfs"] Jul 26 17:57:35.588597 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.588578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.590600 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.590580 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 26 17:57:35.590833 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.590807 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 26 17:57:35.590948 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.590929 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 26 17:57:35.590992 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.590968 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rvncq\"" Jul 26 17:57:35.601102 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.601075 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-888964c5f-9ldfs"] Jul 26 17:57:35.601405 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.601214 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 26 17:57:35.605155 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.605136 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nk55l"] Jul 26 17:57:35.608269 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.608252 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l5qjb"] Jul 26 17:57:35.608393 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.608375 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nk55l" Jul 26 17:57:35.610515 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.610493 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 26 17:57:35.610515 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.610509 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 26 17:57:35.610632 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.610570 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 26 17:57:35.610632 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.610570 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k6gz2\"" Jul 26 17:57:35.611537 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.611521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.613852 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.613836 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 26 17:57:35.613931 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.613886 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 26 17:57:35.613995 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.613966 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-566xh\"" Jul 26 17:57:35.616717 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.616698 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nk55l"] Jul 26 17:57:35.620244 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.620217 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l5qjb"] Jul 26 17:57:35.692096 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-bound-sa-token\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.692239 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5sjt\" (UniqueName: \"kubernetes.io/projected/e4af50be-8015-404c-88fa-aada2c84ac2d-kube-api-access-h5sjt\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.692239 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.692239 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-image-registry-private-configuration\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.692239 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba-cert\") pod \"ingress-canary-nk55l\" (UID: \"7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba\") " pod="openshift-ingress-canary/ingress-canary-nk55l" Jul 26 17:57:35.692239 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4af50be-8015-404c-88fa-aada2c84ac2d-tmp-dir\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.692446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pddz2\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-kube-api-access-pddz2\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.692446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks9rc\" (UniqueName: \"kubernetes.io/projected/7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba-kube-api-access-ks9rc\") pod \"ingress-canary-nk55l\" (UID: \"7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba\") " pod="openshift-ingress-canary/ingress-canary-nk55l" Jul 26 17:57:35.692446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-trusted-ca\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.692446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-installation-pull-secrets\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.692446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-certificates\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.692446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.692446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4af50be-8015-404c-88fa-aada2c84ac2d-config-volume\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.692446 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.692445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-ca-trust-extracted\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.742776 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.742746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:35.793723 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793690 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba-cert\") pod \"ingress-canary-nk55l\" (UID: \"7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba\") " pod="openshift-ingress-canary/ingress-canary-nk55l" Jul 26 17:57:35.793843 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4af50be-8015-404c-88fa-aada2c84ac2d-tmp-dir\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.793843 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pddz2\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-kube-api-access-pddz2\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.793843 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks9rc\" (UniqueName: \"kubernetes.io/projected/7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba-kube-api-access-ks9rc\") pod \"ingress-canary-nk55l\" (UID: \"7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba\") " pod="openshift-ingress-canary/ingress-canary-nk55l" Jul 26 17:57:35.793843 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-trusted-ca\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.793843 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793833 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-installation-pull-secrets\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.794077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-certificates\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.794077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.794077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4af50be-8015-404c-88fa-aada2c84ac2d-config-volume\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.794077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.793999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-ca-trust-extracted\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.794077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.794038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-bound-sa-token\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.794077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.794057 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4af50be-8015-404c-88fa-aada2c84ac2d-tmp-dir\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.794077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.794070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5sjt\" (UniqueName: \"kubernetes.io/projected/e4af50be-8015-404c-88fa-aada2c84ac2d-kube-api-access-h5sjt\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.794410 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.794116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.794410 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.794146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-image-registry-private-configuration\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.794410 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:35.794193 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 26 17:57:35.794410 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:35.794214 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-888964c5f-9ldfs: secret "image-registry-tls" not found Jul 26 17:57:35.794410 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:35.794291 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls podName:2adf0630-fd4d-4e7b-bc40-b2be54d1ae50 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:36.294269462 +0000 UTC m=+34.997996614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls") pod "image-registry-888964c5f-9ldfs" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50") : secret "image-registry-tls" not found Jul 26 17:57:35.794966 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:35.794855 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 26 17:57:35.794966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.794892 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-ca-trust-extracted\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.794966 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.794859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4af50be-8015-404c-88fa-aada2c84ac2d-config-volume\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.794966 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:35.794929 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls podName:e4af50be-8015-404c-88fa-aada2c84ac2d nodeName:}" failed. No retries permitted until 2026-07-26 17:57:36.294911603 +0000 UTC m=+34.998638746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls") pod "dns-default-l5qjb" (UID: "e4af50be-8015-404c-88fa-aada2c84ac2d") : secret "dns-default-metrics-tls" not found Jul 26 17:57:35.795194 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.795062 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-certificates\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.795403 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.795381 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-trusted-ca\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.798367 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.798324 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-installation-pull-secrets\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.798367 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.798360 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba-cert\") pod \"ingress-canary-nk55l\" (UID: \"7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba\") " pod="openshift-ingress-canary/ingress-canary-nk55l" Jul 26 17:57:35.798485 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.798359 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-image-registry-private-configuration\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.802442 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.802397 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5sjt\" (UniqueName: \"kubernetes.io/projected/e4af50be-8015-404c-88fa-aada2c84ac2d-kube-api-access-h5sjt\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:35.802442 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.802415 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks9rc\" (UniqueName: \"kubernetes.io/projected/7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba-kube-api-access-ks9rc\") pod \"ingress-canary-nk55l\" (UID: \"7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba\") " pod="openshift-ingress-canary/ingress-canary-nk55l" Jul 26 17:57:35.803089 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.803056 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pddz2\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-kube-api-access-pddz2\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.803605 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.803584 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-bound-sa-token\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:35.834912 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.834888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:35.844841 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.844796 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:57:35.846947 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.846928 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 26 17:57:35.917459 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:35.917435 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nk55l" Jul 26 17:57:36.054753 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.054684 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nk55l"] Jul 26 17:57:36.059443 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:36.059237 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7b1fdf_f32a_4f3e_b0ed_292ca16e86ba.slice/crio-422399fef3a3aeb5d0eda2551673f84b401ff52ce22173c029dc48e9411a7814 WatchSource:0}: Error finding container 422399fef3a3aeb5d0eda2551673f84b401ff52ce22173c029dc48e9411a7814: Status 404 returned error can't find the container with id 422399fef3a3aeb5d0eda2551673f84b401ff52ce22173c029dc48e9411a7814 Jul 26 17:57:36.203895 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.203862 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nk55l" event={"ID":"7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba","Type":"ContainerStarted","Data":"422399fef3a3aeb5d0eda2551673f84b401ff52ce22173c029dc48e9411a7814"} Jul 26 17:57:36.298543 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.298505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:36.298708 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.298608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:36.298708 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:36.298688 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 26 17:57:36.298708 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:36.298705 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-888964c5f-9ldfs: secret "image-registry-tls" not found Jul 26 17:57:36.298857 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:36.298727 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 26 17:57:36.298857 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:36.298776 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls podName:2adf0630-fd4d-4e7b-bc40-b2be54d1ae50 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:37.298754909 +0000 UTC m=+36.002482067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls") pod "image-registry-888964c5f-9ldfs" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50") : secret "image-registry-tls" not found Jul 26 17:57:36.298857 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:36.298794 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls podName:e4af50be-8015-404c-88fa-aada2c84ac2d nodeName:}" failed. No retries permitted until 2026-07-26 17:57:37.298786293 +0000 UTC m=+36.002513434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls") pod "dns-default-l5qjb" (UID: "e4af50be-8015-404c-88fa-aada2c84ac2d") : secret "dns-default-metrics-tls" not found Jul 26 17:57:36.844641 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.844606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:57:36.845393 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.844606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:57:36.847142 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.847111 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 26 17:57:36.847242 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.847157 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 26 17:57:36.847327 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.847253 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9fbzz\"" Jul 26 17:57:36.847849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.847828 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7vmj\"" Jul 26 17:57:36.847961 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:36.847886 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 26 17:57:37.306384 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:37.306344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:37.306609 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:37.306447 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:37.306667 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:37.306626 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 26 17:57:37.306667 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:37.306641 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-888964c5f-9ldfs: secret "image-registry-tls" not found Jul 26 17:57:37.306755 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:37.306704 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls podName:2adf0630-fd4d-4e7b-bc40-b2be54d1ae50 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:39.306686711 +0000 UTC m=+38.010413851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls") pod "image-registry-888964c5f-9ldfs" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50") : secret "image-registry-tls" not found Jul 26 17:57:37.307207 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:37.307186 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 26 17:57:37.307279 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:37.307247 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls podName:e4af50be-8015-404c-88fa-aada2c84ac2d nodeName:}" failed. No retries permitted until 2026-07-26 17:57:39.307232922 +0000 UTC m=+38.010960058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls") pod "dns-default-l5qjb" (UID: "e4af50be-8015-404c-88fa-aada2c84ac2d") : secret "dns-default-metrics-tls" not found Jul 26 17:57:38.211361 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:38.211308 2565 generic.go:356] "Generic (PLEG): container finished" podID="5e57a9e8-4895-42a4-a68d-6345eb478fa5" containerID="7056332cecd494e08879b8df2e7a07c8327e6b70714bb664303aee4d47d7a08f" exitCode=0 Jul 26 17:57:38.211361 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:38.211353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cprtz" event={"ID":"5e57a9e8-4895-42a4-a68d-6345eb478fa5","Type":"ContainerDied","Data":"7056332cecd494e08879b8df2e7a07c8327e6b70714bb664303aee4d47d7a08f"} Jul 26 17:57:39.217665 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:39.217628 2565 generic.go:356] "Generic (PLEG): container finished" podID="5e57a9e8-4895-42a4-a68d-6345eb478fa5" containerID="86f029fd901e0e2bdcf8db3efaa8ab48764e85165215affecd109587d9952446" exitCode=0 Jul 26 17:57:39.218090 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:39.217678 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cprtz" event={"ID":"5e57a9e8-4895-42a4-a68d-6345eb478fa5","Type":"ContainerDied","Data":"86f029fd901e0e2bdcf8db3efaa8ab48764e85165215affecd109587d9952446"} Jul 26 17:57:39.325440 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:39.325330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:39.325606 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:39.325461 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 26 17:57:39.325606 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:39.325477 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-888964c5f-9ldfs: secret "image-registry-tls" not found Jul 26 17:57:39.325606 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:39.325530 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls podName:2adf0630-fd4d-4e7b-bc40-b2be54d1ae50 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:43.325511326 +0000 UTC m=+42.029238479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls") pod "image-registry-888964c5f-9ldfs" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50") : secret "image-registry-tls" not found Jul 26 17:57:39.325763 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:39.325691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:39.325818 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:39.325791 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 26 17:57:39.325865 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:39.325839 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls podName:e4af50be-8015-404c-88fa-aada2c84ac2d nodeName:}" failed. No retries permitted until 2026-07-26 17:57:43.325823764 +0000 UTC m=+42.029550922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls") pod "dns-default-l5qjb" (UID: "e4af50be-8015-404c-88fa-aada2c84ac2d") : secret "dns-default-metrics-tls" not found Jul 26 17:57:39.892953 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:39.892789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:39.949458 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:39.949428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:40.221744 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:40.221661 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nk55l" event={"ID":"7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba","Type":"ContainerStarted","Data":"29002c8153e37750ff9e484e5d393957fe7f23d326a97e1710079f23a5dbe4f0"} Jul 26 17:57:40.224882 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:40.224828 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cprtz" event={"ID":"5e57a9e8-4895-42a4-a68d-6345eb478fa5","Type":"ContainerStarted","Data":"3051f5b5b71a62bd40cbfcac096748eca8175f490bef526297caa7caec174ef0"} Jul 26 17:57:40.241519 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:40.240096 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nk55l" podStartSLOduration=1.768209012 podStartE2EDuration="5.240080774s" totalImagesPullingTime="3.471871762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:40.239384531 +0000 UTC m=+38.943111681" watchObservedRunningTime="2026-07-26 17:57:40.240080774 +0000 UTC m=+38.943807934" Jul 26 17:57:40.264004 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:40.263970 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cprtz" podStartSLOduration=7.716540384 podStartE2EDuration="38.263957618s" totalImagesPullingTime="30.547417234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:40.263476909 +0000 UTC m=+38.967204066" watchObservedRunningTime="2026-07-26 17:57:40.263957618 +0000 UTC m=+38.967684775" Jul 26 17:57:40.385486 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:40.385457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:40.486509 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:40.486438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:43.356042 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:43.356011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:43.356390 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:43.356071 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:43.356390 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:43.356152 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 26 17:57:43.356390 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:43.356174 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-888964c5f-9ldfs: secret "image-registry-tls" not found Jul 26 17:57:43.356390 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:43.356160 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 26 17:57:43.356390 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:43.356252 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls podName:2adf0630-fd4d-4e7b-bc40-b2be54d1ae50 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:51.356236558 +0000 UTC m=+50.059963698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls") pod "image-registry-888964c5f-9ldfs" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50") : secret "image-registry-tls" not found Jul 26 17:57:43.356390 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:43.356273 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls podName:e4af50be-8015-404c-88fa-aada2c84ac2d nodeName:}" failed. No retries permitted until 2026-07-26 17:57:51.356262142 +0000 UTC m=+50.059989279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls") pod "dns-default-l5qjb" (UID: "e4af50be-8015-404c-88fa-aada2c84ac2d") : secret "dns-default-metrics-tls" not found Jul 26 17:57:45.862602 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:45.862551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:45.963894 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:45.963854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:46.812282 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:46.812245 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:46.913816 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:46.913777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:46.968213 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:46.968183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:49.650282 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:49.650245 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:49.750974 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:49.750938 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:49.851522 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:49.851489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:50.678627 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:50.678595 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:50.742981 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:50.742937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:51.409170 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:51.409137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:57:51.409361 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:51.409277 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 26 17:57:51.409361 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:51.409284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:57:51.409463 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:51.409372 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls podName:e4af50be-8015-404c-88fa-aada2c84ac2d nodeName:}" failed. No retries permitted until 2026-07-26 17:58:07.409354616 +0000 UTC m=+66.113081756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls") pod "dns-default-l5qjb" (UID: "e4af50be-8015-404c-88fa-aada2c84ac2d") : secret "dns-default-metrics-tls" not found Jul 26 17:57:51.409463 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:51.409415 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 26 17:57:51.409463 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:51.409430 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-888964c5f-9ldfs: secret "image-registry-tls" not found Jul 26 17:57:51.409552 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:51.409475 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls podName:2adf0630-fd4d-4e7b-bc40-b2be54d1ae50 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:07.409463412 +0000 UTC m=+66.113190587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls") pod "image-registry-888964c5f-9ldfs" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50") : secret "image-registry-tls" not found Jul 26 17:57:51.623195 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:51.623164 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:55.253979 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:55.253942 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:56.590245 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.590210 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng"] Jul 26 17:57:56.595035 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.595010 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b"] Jul 26 17:57:56.595180 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.595148 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:57:56.596535 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.596514 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b" Jul 26 17:57:56.597426 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.597409 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 26 17:57:56.598060 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.598043 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 26 17:57:56.598140 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.598059 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 26 17:57:56.598140 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.598114 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l4gkp\"" Jul 26 17:57:56.598673 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.598656 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vbrw9\"" Jul 26 17:57:56.598772 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.598659 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 26 17:57:56.598772 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.598704 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 26 17:57:56.604492 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.604469 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng"] Jul 26 17:57:56.607601 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.607580 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b"] Jul 26 17:57:56.648261 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.648233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5hp\" (UniqueName: \"kubernetes.io/projected/67e96387-dddf-4ece-8df8-a122c49bf38c-kube-api-access-4w5hp\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:57:56.648384 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.648279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm6gk\" (UniqueName: \"kubernetes.io/projected/042bc1d4-f728-4fc0-a339-2e11ef9aafc8-kube-api-access-gm6gk\") pod \"volume-data-source-validator-549c6d54cf-m4p9b\" (UID: \"042bc1d4-f728-4fc0-a339-2e11ef9aafc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b" Jul 26 17:57:56.648384 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.648368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:57:56.692140 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.692121 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd"] Jul 26 17:57:56.693960 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.693946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:57:56.695165 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.695146 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k"] Jul 26 17:57:56.696538 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.696520 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 26 17:57:56.696660 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.696555 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 26 17:57:56.696660 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.696574 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xk5xr\"" Jul 26 17:57:56.696750 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.696699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.700460 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.700443 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 26 17:57:56.700568 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.700479 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 26 17:57:56.700568 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.700542 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 26 17:57:56.700685 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.700447 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x4bx4\"" Jul 26 17:57:56.700867 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.700850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 26 17:57:56.701239 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.701226 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mnrvx"] Jul 26 17:57:56.702972 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.702957 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt"] Jul 26 17:57:56.703061 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.703052 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.705025 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.705007 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.707525 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.707506 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 26 17:57:56.707605 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.707514 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 26 17:57:56.708519 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.708502 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 26 17:57:56.708612 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.708530 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 26 17:57:56.708612 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.708541 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 26 17:57:56.708612 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.708554 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 26 17:57:56.708762 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.708631 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 26 17:57:56.708762 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.708664 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 26 17:57:56.709005 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.708990 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-79vhl\"" Jul 26 17:57:56.709093 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.709052 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wrtrm\"" Jul 26 17:57:56.712954 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.712926 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd"] Jul 26 17:57:56.718132 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.718112 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k"] Jul 26 17:57:56.718656 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.718638 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 26 17:57:56.720327 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.720294 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mnrvx"] Jul 26 17:57:56.726509 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.726488 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt"] Jul 26 17:57:56.749290 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm6gk\" (UniqueName: \"kubernetes.io/projected/042bc1d4-f728-4fc0-a339-2e11ef9aafc8-kube-api-access-gm6gk\") pod \"volume-data-source-validator-549c6d54cf-m4p9b\" (UID: \"042bc1d4-f728-4fc0-a339-2e11ef9aafc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b" Jul 26 17:57:56.749388 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-tmp\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.749388 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8bb8\" (UniqueName: \"kubernetes.io/projected/121c3677-1b02-4b04-b32d-214d58e2bbcc-kube-api-access-k8bb8\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.749388 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/121c3677-1b02-4b04-b32d-214d58e2bbcc-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.749542 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-service-ca-bundle\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.749542 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749411 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg8xz\" (UniqueName: \"kubernetes.io/projected/10feeaa6-5e25-4e36-8751-245d0ca80ed4-kube-api-access-hg8xz\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.749542 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:57:56.749683 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:56.749551 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 26 17:57:56.749683 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10feeaa6-5e25-4e36-8751-245d0ca80ed4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.749683 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:56.749606 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls podName:67e96387-dddf-4ece-8df8-a122c49bf38c nodeName:}" failed. No retries permitted until 2026-07-26 17:57:57.249586826 +0000 UTC m=+55.953313974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls") pod "cluster-samples-operator-6748489656-th2ng" (UID: "67e96387-dddf-4ece-8df8-a122c49bf38c") : secret "samples-operator-tls" not found Jul 26 17:57:56.749683 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.749683 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-snapshots\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.749924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:57:56.749924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-serving-cert\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.749924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5hp\" (UniqueName: \"kubernetes.io/projected/67e96387-dddf-4ece-8df8-a122c49bf38c-kube-api-access-4w5hp\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:57:56.749924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749796 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.749924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749848 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10feeaa6-5e25-4e36-8751-245d0ca80ed4-config\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.749924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749887 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:57:56.749924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.749914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzxvw\" (UniqueName: \"kubernetes.io/projected/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-kube-api-access-dzxvw\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.763435 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.763411 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5hp\" (UniqueName: \"kubernetes.io/projected/67e96387-dddf-4ece-8df8-a122c49bf38c-kube-api-access-4w5hp\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:57:56.763435 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.763431 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm6gk\" (UniqueName: \"kubernetes.io/projected/042bc1d4-f728-4fc0-a339-2e11ef9aafc8-kube-api-access-gm6gk\") pod \"volume-data-source-validator-549c6d54cf-m4p9b\" (UID: \"042bc1d4-f728-4fc0-a339-2e11ef9aafc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b" Jul 26 17:57:56.798050 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.798024 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229"] Jul 26 17:57:56.802981 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.802964 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.807521 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.807485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 26 17:57:56.807521 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.807490 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 26 17:57:56.807914 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.807894 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 26 17:57:56.807989 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.807909 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b22xd\"" Jul 26 17:57:56.808137 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.808123 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 26 17:57:56.811087 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.811067 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c"] Jul 26 17:57:56.812841 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.812827 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-4nzlj"] Jul 26 17:57:56.812937 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.812922 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c" Jul 26 17:57:56.814275 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.814260 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.817155 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.817137 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 26 17:57:56.817155 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.817146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f4b5r\"" Jul 26 17:57:56.817367 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.817347 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 26 17:57:56.817438 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.817375 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m8w4h\"" Jul 26 17:57:56.817490 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.817478 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 26 17:57:56.818131 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.818115 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 26 17:57:56.823561 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.823455 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 26 17:57:56.823627 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.823599 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229"] Jul 26 17:57:56.827016 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.826994 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c"] Jul 26 17:57:56.828500 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.828485 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-4nzlj"] Jul 26 17:57:56.850671 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850624 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7mmm\" (UniqueName: \"kubernetes.io/projected/f9809214-22c8-4990-a8f4-770a1d3a989f-kube-api-access-l7mmm\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.850671 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsxd8\" (UniqueName: \"kubernetes.io/projected/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-kube-api-access-wsxd8\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.850791 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-tmp\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.850791 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8bb8\" (UniqueName: \"kubernetes.io/projected/121c3677-1b02-4b04-b32d-214d58e2bbcc-kube-api-access-k8bb8\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.850791 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/121c3677-1b02-4b04-b32d-214d58e2bbcc-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.850932 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-service-ca-bundle\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.850932 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9809214-22c8-4990-a8f4-770a1d3a989f-serving-cert\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.850932 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg8xz\" (UniqueName: \"kubernetes.io/projected/10feeaa6-5e25-4e36-8751-245d0ca80ed4-kube-api-access-hg8xz\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.850932 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850885 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10feeaa6-5e25-4e36-8751-245d0ca80ed4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.851111 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.850998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.851111 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851030 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-tmp\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.851111 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-snapshots\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.851111 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:57:56.851111 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:56.851106 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 26 17:57:56.851111 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq5s6\" (UniqueName: \"kubernetes.io/projected/c530d908-c94e-485d-8548-66270b878afd-kube-api-access-xq5s6\") pod \"network-check-source-7d88cb55d8-drh5c\" (UID: \"c530d908-c94e-485d-8548-66270b878afd\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c" Jul 26 17:57:56.851413 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851144 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-serving-cert\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.851413 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:56.851168 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls podName:121c3677-1b02-4b04-b32d-214d58e2bbcc nodeName:}" failed. No retries permitted until 2026-07-26 17:57:57.35114968 +0000 UTC m=+56.054876824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-pb2wt" (UID: "121c3677-1b02-4b04-b32d-214d58e2bbcc") : secret "cluster-monitoring-operator-tls" not found Jul 26 17:57:56.851413 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:56.851214 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 26 17:57:56.851413 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:56.851297 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert podName:0ad9951d-4903-4f6d-a3f6-37facf6c7bca nodeName:}" failed. No retries permitted until 2026-07-26 17:57:57.351281206 +0000 UTC m=+56.055008350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kjvrd" (UID: "0ad9951d-4903-4f6d-a3f6-37facf6c7bca") : secret "networking-console-plugin-cert" not found Jul 26 17:57:56.851413 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.851413 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9809214-22c8-4990-a8f4-770a1d3a989f-config\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851436 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-service-ca-bundle\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851491 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/121c3677-1b02-4b04-b32d-214d58e2bbcc-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10feeaa6-5e25-4e36-8751-245d0ca80ed4-config\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9809214-22c8-4990-a8f4-770a1d3a989f-trusted-ca\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851604 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-snapshots\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.851727 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.851621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzxvw\" (UniqueName: \"kubernetes.io/projected/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-kube-api-access-dzxvw\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.852147 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.852091 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:57:56.852147 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.852094 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10feeaa6-5e25-4e36-8751-245d0ca80ed4-config\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.852269 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.852247 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.853145 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.853127 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10feeaa6-5e25-4e36-8751-245d0ca80ed4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.853514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.853499 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-serving-cert\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.863975 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.863949 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg8xz\" (UniqueName: \"kubernetes.io/projected/10feeaa6-5e25-4e36-8751-245d0ca80ed4-kube-api-access-hg8xz\") pod \"service-ca-operator-5d6c75f84f-fwr5k\" (UID: \"10feeaa6-5e25-4e36-8751-245d0ca80ed4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:56.864391 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.864376 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8bb8\" (UniqueName: \"kubernetes.io/projected/121c3677-1b02-4b04-b32d-214d58e2bbcc-kube-api-access-k8bb8\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:56.865158 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.865138 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzxvw\" (UniqueName: \"kubernetes.io/projected/d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8-kube-api-access-dzxvw\") pod \"insights-operator-5885fdb759-mnrvx\" (UID: \"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8\") " pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:56.866548 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.866523 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:56.900483 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.900462 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f857c88c9-62tnm"] Jul 26 17:57:56.903121 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.903108 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:56.906188 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.906172 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 26 17:57:56.906296 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.906283 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xxltz\"" Jul 26 17:57:56.906907 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.906894 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 26 17:57:56.907184 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.907167 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 26 17:57:56.907257 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.907167 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 26 17:57:56.907257 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.907167 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 26 17:57:56.907257 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.907215 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 26 17:57:56.910496 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.910479 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b" Jul 26 17:57:56.916760 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.916739 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f857c88c9-62tnm"] Jul 26 17:57:56.948325 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.948280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:56.952263 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:56.952389 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952342 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq5s6\" (UniqueName: \"kubernetes.io/projected/c530d908-c94e-485d-8548-66270b878afd-kube-api-access-xq5s6\") pod \"network-check-source-7d88cb55d8-drh5c\" (UID: \"c530d908-c94e-485d-8548-66270b878afd\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c" Jul 26 17:57:56.952389 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.952599 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9809214-22c8-4990-a8f4-770a1d3a989f-config\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.952599 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q476h\" (UniqueName: \"kubernetes.io/projected/c83ddb99-6686-41e6-85c7-33e298be9ecd-kube-api-access-q476h\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:56.952599 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952491 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.952599 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:56.952599 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-stats-auth\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:56.952599 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952597 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9809214-22c8-4990-a8f4-770a1d3a989f-trusted-ca\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.952965 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7mmm\" (UniqueName: \"kubernetes.io/projected/f9809214-22c8-4990-a8f4-770a1d3a989f-kube-api-access-l7mmm\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.952965 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsxd8\" (UniqueName: \"kubernetes.io/projected/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-kube-api-access-wsxd8\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.952965 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-default-certificate\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:56.952965 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.952823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9809214-22c8-4990-a8f4-770a1d3a989f-serving-cert\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.953228 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.953178 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.953987 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.953901 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9809214-22c8-4990-a8f4-770a1d3a989f-trusted-ca\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.954129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.954079 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9809214-22c8-4990-a8f4-770a1d3a989f-config\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.956447 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.956425 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.956963 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.956941 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9809214-22c8-4990-a8f4-770a1d3a989f-serving-cert\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.959758 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.959737 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7mmm\" (UniqueName: \"kubernetes.io/projected/f9809214-22c8-4990-a8f4-770a1d3a989f-kube-api-access-l7mmm\") pod \"console-operator-584dcb6b54-4nzlj\" (UID: \"f9809214-22c8-4990-a8f4-770a1d3a989f\") " pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:56.960465 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.960447 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsxd8\" (UniqueName: \"kubernetes.io/projected/b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7-kube-api-access-wsxd8\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4v229\" (UID: \"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:56.960604 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:56.960583 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq5s6\" (UniqueName: \"kubernetes.io/projected/c530d908-c94e-485d-8548-66270b878afd-kube-api-access-xq5s6\") pod \"network-check-source-7d88cb55d8-drh5c\" (UID: \"c530d908-c94e-485d-8548-66270b878afd\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c" Jul 26 17:57:57.009748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.009717 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" Jul 26 17:57:57.016279 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.016249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-mnrvx" Jul 26 17:57:57.023308 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.023285 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b"] Jul 26 17:57:57.026797 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.026770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:57.027088 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:57.027048 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042bc1d4_f728_4fc0_a339_2e11ef9aafc8.slice/crio-baf431c247478833471cc090eb18849c652f059d9ee65528717bcff7a422f792 WatchSource:0}: Error finding container baf431c247478833471cc090eb18849c652f059d9ee65528717bcff7a422f792: Status 404 returned error can't find the container with id baf431c247478833471cc090eb18849c652f059d9ee65528717bcff7a422f792 Jul 26 17:57:57.054352 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.054257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-default-certificate\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.055009 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.054420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.055009 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.054523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q476h\" (UniqueName: \"kubernetes.io/projected/c83ddb99-6686-41e6-85c7-33e298be9ecd-kube-api-access-q476h\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.055009 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.054553 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.055009 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.054598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-stats-auth\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.055009 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.054970 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 26 17:57:57.055279 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.055038 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:57:57.555017346 +0000 UTC m=+56.258744498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : secret "router-metrics-certs-default" not found Jul 26 17:57:57.055279 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.055057 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:57:57.555048023 +0000 UTC m=+56.258775169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : configmap references non-existent config key: service-ca.crt Jul 26 17:57:57.058112 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.057206 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-stats-auth\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.058112 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.057218 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-default-certificate\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.076325 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.075077 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q476h\" (UniqueName: \"kubernetes.io/projected/c83ddb99-6686-41e6-85c7-33e298be9ecd-kube-api-access-q476h\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.111650 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.111619 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" Jul 26 17:57:57.121562 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.121533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c" Jul 26 17:57:57.126721 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.126502 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:57:57.127729 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.127613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:57.151876 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.151786 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k"] Jul 26 17:57:57.153872 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:57.153828 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10feeaa6_5e25_4e36_8751_245d0ca80ed4.slice/crio-bc69285a542c6bbd87f85bab415d6c830b4a5a113ae72f3fb6738868fab4aa98 WatchSource:0}: Error finding container bc69285a542c6bbd87f85bab415d6c830b4a5a113ae72f3fb6738868fab4aa98: Status 404 returned error can't find the container with id bc69285a542c6bbd87f85bab415d6c830b4a5a113ae72f3fb6738868fab4aa98 Jul 26 17:57:57.171806 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.171771 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mnrvx"] Jul 26 17:57:57.255275 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.255242 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229"] Jul 26 17:57:57.255746 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.255636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:57:57.255828 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.255815 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 26 17:57:57.255937 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.255895 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls podName:67e96387-dddf-4ece-8df8-a122c49bf38c nodeName:}" failed. No retries permitted until 2026-07-26 17:57:58.255871759 +0000 UTC m=+56.959598910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls") pod "cluster-samples-operator-6748489656-th2ng" (UID: "67e96387-dddf-4ece-8df8-a122c49bf38c") : secret "samples-operator-tls" not found Jul 26 17:57:57.257972 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:57.257951 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08b35c0_05aa_4fd4_a0aa_f76ea3c3e9f7.slice/crio-56784b5f8ba0d4e851d0136c8f8683f94d8c497a98d88ada716f519cb0f5efb2 WatchSource:0}: Error finding container 56784b5f8ba0d4e851d0136c8f8683f94d8c497a98d88ada716f519cb0f5efb2: Status 404 returned error can't find the container with id 56784b5f8ba0d4e851d0136c8f8683f94d8c497a98d88ada716f519cb0f5efb2 Jul 26 17:57:57.263360 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.263336 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" event={"ID":"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7","Type":"ContainerStarted","Data":"56784b5f8ba0d4e851d0136c8f8683f94d8c497a98d88ada716f519cb0f5efb2"} Jul 26 17:57:57.265080 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.265013 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c"] Jul 26 17:57:57.265080 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.265060 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mnrvx" event={"ID":"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8","Type":"ContainerStarted","Data":"8c1d5b7de27e27958afbeda22810e8553b3387d467762f13217ab5d4aaa7b5cc"} Jul 26 17:57:57.266192 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.266169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" event={"ID":"10feeaa6-5e25-4e36-8751-245d0ca80ed4","Type":"ContainerStarted","Data":"bc69285a542c6bbd87f85bab415d6c830b4a5a113ae72f3fb6738868fab4aa98"} Jul 26 17:57:57.267351 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.267288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b" event={"ID":"042bc1d4-f728-4fc0-a339-2e11ef9aafc8","Type":"ContainerStarted","Data":"baf431c247478833471cc090eb18849c652f059d9ee65528717bcff7a422f792"} Jul 26 17:57:57.268755 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:57.268724 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc530d908_c94e_485d_8548_66270b878afd.slice/crio-66f86e8060b65fa919a33c0178e058567b6b3a11fb79e58267bf996f71e3f9e5 WatchSource:0}: Error finding container 66f86e8060b65fa919a33c0178e058567b6b3a11fb79e58267bf996f71e3f9e5: Status 404 returned error can't find the container with id 66f86e8060b65fa919a33c0178e058567b6b3a11fb79e58267bf996f71e3f9e5 Jul 26 17:57:57.284748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.284728 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-4nzlj"] Jul 26 17:57:57.286809 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:57:57.286790 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9809214_22c8_4990_a8f4_770a1d3a989f.slice/crio-7c803e05bc71b4eca1a0aba83e8f07a88c4fd6f92799a165f5116a2e3632bb06 WatchSource:0}: Error finding container 7c803e05bc71b4eca1a0aba83e8f07a88c4fd6f92799a165f5116a2e3632bb06: Status 404 returned error can't find the container with id 7c803e05bc71b4eca1a0aba83e8f07a88c4fd6f92799a165f5116a2e3632bb06 Jul 26 17:57:57.356891 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.356827 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:57.356891 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.356868 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:57:57.357038 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.356954 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 26 17:57:57.357038 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.357010 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls podName:121c3677-1b02-4b04-b32d-214d58e2bbcc nodeName:}" failed. No retries permitted until 2026-07-26 17:57:58.356994455 +0000 UTC m=+57.060721591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-pb2wt" (UID: "121c3677-1b02-4b04-b32d-214d58e2bbcc") : secret "cluster-monitoring-operator-tls" not found Jul 26 17:57:57.357038 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.357030 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 26 17:57:57.357145 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.357077 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert podName:0ad9951d-4903-4f6d-a3f6-37facf6c7bca nodeName:}" failed. No retries permitted until 2026-07-26 17:57:58.357065119 +0000 UTC m=+57.060792255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kjvrd" (UID: "0ad9951d-4903-4f6d-a3f6-37facf6c7bca") : secret "networking-console-plugin-cert" not found Jul 26 17:57:57.558786 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.558754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.558916 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.558867 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:57.558950 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.558912 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 26 17:57:57.558990 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.558977 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:57:58.558960773 +0000 UTC m=+57.262687932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : secret "router-metrics-certs-default" not found Jul 26 17:57:57.559033 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:57.558991 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:57:58.55898579 +0000 UTC m=+57.262712927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : configmap references non-existent config key: service-ca.crt Jul 26 17:57:57.896149 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.896068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:57.997895 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:57.997830 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:58.265879 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.265289 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:57:58.265879 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.265504 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 26 17:57:58.265879 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.265565 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls podName:67e96387-dddf-4ece-8df8-a122c49bf38c nodeName:}" failed. No retries permitted until 2026-07-26 17:58:00.265546432 +0000 UTC m=+58.969273591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls") pod "cluster-samples-operator-6748489656-th2ng" (UID: "67e96387-dddf-4ece-8df8-a122c49bf38c") : secret "samples-operator-tls" not found Jul 26 17:57:58.272798 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.272723 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" event={"ID":"f9809214-22c8-4990-a8f4-770a1d3a989f","Type":"ContainerStarted","Data":"7c803e05bc71b4eca1a0aba83e8f07a88c4fd6f92799a165f5116a2e3632bb06"} Jul 26 17:57:58.275867 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.275841 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b" event={"ID":"042bc1d4-f728-4fc0-a339-2e11ef9aafc8","Type":"ContainerStarted","Data":"4ab7d6847d3dd8ce58b0a7deb2ce511452c5d142411ace9134ce64908876182f"} Jul 26 17:57:58.278013 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.277989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c" event={"ID":"c530d908-c94e-485d-8548-66270b878afd","Type":"ContainerStarted","Data":"66f86e8060b65fa919a33c0178e058567b6b3a11fb79e58267bf996f71e3f9e5"} Jul 26 17:57:58.290545 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.289774 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-m4p9b" podStartSLOduration=1.170374159 podStartE2EDuration="2.289757736s" totalImagesPullingTime="1.119383577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:58.289416072 +0000 UTC m=+56.993143230" watchObservedRunningTime="2026-07-26 17:57:58.289757736 +0000 UTC m=+56.993484894" Jul 26 17:57:58.364818 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.364787 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:58.367176 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.366469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:57:58.367176 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.366511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:57:58.367176 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.366681 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 26 17:57:58.367176 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.366737 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert podName:0ad9951d-4903-4f6d-a3f6-37facf6c7bca nodeName:}" failed. No retries permitted until 2026-07-26 17:58:00.366720793 +0000 UTC m=+59.070447948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kjvrd" (UID: "0ad9951d-4903-4f6d-a3f6-37facf6c7bca") : secret "networking-console-plugin-cert" not found Jul 26 17:57:58.367176 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.367089 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 26 17:57:58.367176 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.367142 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls podName:121c3677-1b02-4b04-b32d-214d58e2bbcc nodeName:}" failed. No retries permitted until 2026-07-26 17:58:00.367125983 +0000 UTC m=+59.070853139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-pb2wt" (UID: "121c3677-1b02-4b04-b32d-214d58e2bbcc") : secret "cluster-monitoring-operator-tls" not found Jul 26 17:57:58.468600 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.468504 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:57:58.567746 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.567705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:58.567915 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:57:58.567818 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:57:58.568007 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.567989 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 26 17:57:58.568102 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.568057 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:58:00.568039388 +0000 UTC m=+59.271766529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : secret "router-metrics-certs-default" not found Jul 26 17:57:58.568486 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:57:58.568461 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:58:00.568447183 +0000 UTC m=+59.272174337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : configmap references non-existent config key: service-ca.crt Jul 26 17:58:00.283907 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:00.283864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:58:00.284346 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.284024 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 26 17:58:00.284346 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.284113 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls podName:67e96387-dddf-4ece-8df8-a122c49bf38c nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.284093277 +0000 UTC m=+62.987820416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls") pod "cluster-samples-operator-6748489656-th2ng" (UID: "67e96387-dddf-4ece-8df8-a122c49bf38c") : secret "samples-operator-tls" not found Jul 26 17:58:00.384462 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:00.384427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:58:00.384610 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:00.384467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:58:00.384661 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.384609 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 26 17:58:00.384661 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.384637 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 26 17:58:00.384732 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.384688 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls podName:121c3677-1b02-4b04-b32d-214d58e2bbcc nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.384666346 +0000 UTC m=+63.088393487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-pb2wt" (UID: "121c3677-1b02-4b04-b32d-214d58e2bbcc") : secret "cluster-monitoring-operator-tls" not found Jul 26 17:58:00.384732 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.384707 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert podName:0ad9951d-4903-4f6d-a3f6-37facf6c7bca nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.384697595 +0000 UTC m=+63.088424747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kjvrd" (UID: "0ad9951d-4903-4f6d-a3f6-37facf6c7bca") : secret "networking-console-plugin-cert" not found Jul 26 17:58:00.586706 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:00.586671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:00.586883 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:00.586826 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:00.586883 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.586838 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 26 17:58:00.586974 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.586908 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.58689098 +0000 UTC m=+63.290618128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : secret "router-metrics-certs-default" not found Jul 26 17:58:00.586974 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:00.586945 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.586926067 +0000 UTC m=+63.290653203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : configmap references non-existent config key: service-ca.crt Jul 26 17:58:01.310371 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:01.310337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:01.369292 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:01.369253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:01.892796 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:01.892756 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:01.993790 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:01.993755 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:02.093960 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:02.093921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:02.205721 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:02.205655 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnltj" Jul 26 17:58:02.357638 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:02.357594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:02.457645 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:02.457572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:03.296077 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.296042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" event={"ID":"10feeaa6-5e25-4e36-8751-245d0ca80ed4","Type":"ContainerStarted","Data":"fd6bc89e6dc564c27c5ced6337227fdfe3cbd5d2e1246e4c102cd532724b2cc8"} Jul 26 17:58:03.298130 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.298094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" event={"ID":"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7","Type":"ContainerStarted","Data":"152ae3698a41f5e6541a9e2f22d4c0bd6b9e8b6ecae1431c09694fc8a152e5aa"} Jul 26 17:58:03.303726 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.303692 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c" event={"ID":"c530d908-c94e-485d-8548-66270b878afd","Type":"ContainerStarted","Data":"9763a0745e779aca9724524ed0dbe6f372a879c3ff3a5b36f3ab1dbc140fc5fb"} Jul 26 17:58:03.305578 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.305553 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mnrvx" event={"ID":"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8","Type":"ContainerStarted","Data":"18555220069b9e6208f353262567cfa1d5d4a48c09fb1e78665b8284e7a6452b"} Jul 26 17:58:03.307474 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.307457 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/0.log" Jul 26 17:58:03.307556 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.307493 2565 generic.go:356] "Generic (PLEG): container finished" podID="f9809214-22c8-4990-a8f4-770a1d3a989f" containerID="fa027c6298dade7a7bd668e7e504bb60adbd1d11fd44a1f619b367000323de10" exitCode=255 Jul 26 17:58:03.307556 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.307523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" event={"ID":"f9809214-22c8-4990-a8f4-770a1d3a989f","Type":"ContainerDied","Data":"fa027c6298dade7a7bd668e7e504bb60adbd1d11fd44a1f619b367000323de10"} Jul 26 17:58:03.307730 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.307714 2565 scope.go:117] "RemoveContainer" containerID="fa027c6298dade7a7bd668e7e504bb60adbd1d11fd44a1f619b367000323de10" Jul 26 17:58:03.322675 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.322630 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" podStartSLOduration=2.093107268 podStartE2EDuration="7.322615015s" totalImagesPullingTime="5.229507747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:03.321046412 +0000 UTC m=+62.024773570" watchObservedRunningTime="2026-07-26 17:58:03.322615015 +0000 UTC m=+62.026342173" Jul 26 17:58:03.347203 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.345468 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:03.347203 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.347058 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-mnrvx" podStartSLOduration=2.144436817 podStartE2EDuration="7.347040758s" totalImagesPullingTime="5.202603941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:03.344832623 +0000 UTC m=+62.048559782" watchObservedRunningTime="2026-07-26 17:58:03.347040758 +0000 UTC m=+62.050767918" Jul 26 17:58:03.388279 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.387208 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-drh5c" podStartSLOduration=2.2717687509999998 podStartE2EDuration="7.387188074s" totalImagesPullingTime="5.115419323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:03.386412133 +0000 UTC m=+62.090139290" watchObservedRunningTime="2026-07-26 17:58:03.387188074 +0000 UTC m=+62.090915235" Jul 26 17:58:03.388279 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.387682 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" podStartSLOduration=2.256188018 podStartE2EDuration="7.387674796s" totalImagesPullingTime="5.131486778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:03.365525918 +0000 UTC m=+62.069253078" watchObservedRunningTime="2026-07-26 17:58:03.387674796 +0000 UTC m=+62.091401958" Jul 26 17:58:03.439901 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.439805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:03.541060 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:03.541034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:04.178962 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.178911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:04.237172 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.237141 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:04.281652 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.281573 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-79l7x"] Jul 26 17:58:04.284170 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.284110 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.286724 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.286676 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 26 17:58:04.286825 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.286794 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2d24l\"" Jul 26 17:58:04.286983 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.286963 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 26 17:58:04.297722 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.297699 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79l7x"] Jul 26 17:58:04.312282 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.312265 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/1.log" Jul 26 17:58:04.312698 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.312682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/0.log" Jul 26 17:58:04.312771 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.312719 2565 generic.go:356] "Generic (PLEG): container finished" podID="f9809214-22c8-4990-a8f4-770a1d3a989f" containerID="540bab2aa17372878d635cde5d29712bb2cf649bdb0a52988deeafa2ec9b7523" exitCode=255 Jul 26 17:58:04.312826 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.312789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" event={"ID":"f9809214-22c8-4990-a8f4-770a1d3a989f","Type":"ContainerDied","Data":"540bab2aa17372878d635cde5d29712bb2cf649bdb0a52988deeafa2ec9b7523"} Jul 26 17:58:04.312860 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.312828 2565 scope.go:117] "RemoveContainer" containerID="fa027c6298dade7a7bd668e7e504bb60adbd1d11fd44a1f619b367000323de10" Jul 26 17:58:04.313011 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.312993 2565 scope.go:117] "RemoveContainer" containerID="540bab2aa17372878d635cde5d29712bb2cf649bdb0a52988deeafa2ec9b7523" Jul 26 17:58:04.313200 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.313173 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-4nzlj_openshift-console-operator(f9809214-22c8-4990-a8f4-770a1d3a989f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" podUID="f9809214-22c8-4990-a8f4-770a1d3a989f" Jul 26 17:58:04.321916 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.321900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmbr6\" (UniqueName: \"kubernetes.io/projected/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-api-access-xmbr6\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.321982 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.321952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.322027 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.321981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.322027 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.322015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70672d52-fcf2-4127-8521-9da6ff5b2066-crio-socket\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.322090 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.322037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70672d52-fcf2-4127-8521-9da6ff5b2066-data-volume\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.322090 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.322087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:58:04.322182 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.322168 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 26 17:58:04.322228 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.322219 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls podName:67e96387-dddf-4ece-8df8-a122c49bf38c nodeName:}" failed. No retries permitted until 2026-07-26 17:58:12.322206484 +0000 UTC m=+71.025933620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls") pod "cluster-samples-operator-6748489656-th2ng" (UID: "67e96387-dddf-4ece-8df8-a122c49bf38c") : secret "samples-operator-tls" not found Jul 26 17:58:04.347709 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.347690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:04.410702 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.410674 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:04.422591 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.422570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.422675 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.422610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.422737 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.422690 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 26 17:58:04.422789 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.422762 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.922741419 +0000 UTC m=+63.626468555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : configmap "kube-rbac-proxy" not found Jul 26 17:58:04.423036 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.422886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70672d52-fcf2-4127-8521-9da6ff5b2066-crio-socket\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.423036 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.422925 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 26 17:58:04.423036 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.422965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70672d52-fcf2-4127-8521-9da6ff5b2066-data-volume\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.423036 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.422992 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.922973082 +0000 UTC m=+63.626700222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : secret "insights-runtime-extractor-tls" not found Jul 26 17:58:04.423274 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.423036 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70672d52-fcf2-4127-8521-9da6ff5b2066-crio-socket\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.423274 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.423161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:58:04.423274 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.423198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:58:04.423448 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.423271 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70672d52-fcf2-4127-8521-9da6ff5b2066-data-volume\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.423448 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.423285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmbr6\" (UniqueName: \"kubernetes.io/projected/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-api-access-xmbr6\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.423448 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.423289 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 26 17:58:04.423448 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.423307 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 26 17:58:04.423448 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.423360 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls podName:121c3677-1b02-4b04-b32d-214d58e2bbcc nodeName:}" failed. No retries permitted until 2026-07-26 17:58:12.423346996 +0000 UTC m=+71.127074146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-pb2wt" (UID: "121c3677-1b02-4b04-b32d-214d58e2bbcc") : secret "cluster-monitoring-operator-tls" not found Jul 26 17:58:04.423448 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.423389 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert podName:0ad9951d-4903-4f6d-a3f6-37facf6c7bca nodeName:}" failed. No retries permitted until 2026-07-26 17:58:12.423379849 +0000 UTC m=+71.127106995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kjvrd" (UID: "0ad9951d-4903-4f6d-a3f6-37facf6c7bca") : secret "networking-console-plugin-cert" not found Jul 26 17:58:04.432069 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.432019 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmbr6\" (UniqueName: \"kubernetes.io/projected/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-api-access-xmbr6\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.624883 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.624854 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:04.624991 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.624919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:04.625030 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.625010 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:58:12.624996307 +0000 UTC m=+71.328723443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : configmap references non-existent config key: service-ca.crt Jul 26 17:58:04.625070 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.625026 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 26 17:58:04.625105 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.625080 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:58:12.625066158 +0000 UTC m=+71.328793311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : secret "router-metrics-certs-default" not found Jul 26 17:58:04.649355 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.649328 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:04.748826 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.748762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:04.859688 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.859665 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:04.928068 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.928043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.928185 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.928082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:04.928185 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.928159 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 26 17:58:04.928282 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.928195 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 26 17:58:04.928282 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.928225 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:05.928207727 +0000 UTC m=+64.631934879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : configmap "kube-rbac-proxy" not found Jul 26 17:58:04.928282 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:04.928244 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:05.928235386 +0000 UTC m=+64.631962530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : secret "insights-runtime-extractor-tls" not found Jul 26 17:58:04.947567 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:04.947546 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:05.320193 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:05.320161 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/1.log" Jul 26 17:58:05.320491 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:05.320474 2565 scope.go:117] "RemoveContainer" containerID="540bab2aa17372878d635cde5d29712bb2cf649bdb0a52988deeafa2ec9b7523" Jul 26 17:58:05.320626 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:05.320608 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-4nzlj_openshift-console-operator(f9809214-22c8-4990-a8f4-770a1d3a989f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" podUID="f9809214-22c8-4990-a8f4-770a1d3a989f" Jul 26 17:58:05.407655 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:05.407623 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:05.509875 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:05.509830 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:05.720285 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:05.720214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:05.788357 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:05.788329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:05.937363 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:05.937336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:05.937466 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:05.937371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:05.937466 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:05.937447 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 26 17:58:05.937555 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:05.937542 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:07.937522713 +0000 UTC m=+66.641249852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : configmap "kube-rbac-proxy" not found Jul 26 17:58:05.937626 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:05.937559 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 26 17:58:05.937626 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:05.937603 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:07.937594762 +0000 UTC m=+66.641321902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : secret "insights-runtime-extractor-tls" not found Jul 26 17:58:06.542196 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.542162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:58:06.544397 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.544379 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 26 17:58:06.553111 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:06.553094 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 26 17:58:06.553206 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:06.553148 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs podName:e82c225e-6d71-4825-b117-29957a7301c1 nodeName:}" failed. No retries permitted until 2026-07-26 17:59:10.553132788 +0000 UTC m=+129.256859925 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs") pod "network-metrics-daemon-vlzln" (UID: "e82c225e-6d71-4825-b117-29957a7301c1") : secret "metrics-daemon-secret" not found Jul 26 17:58:06.575353 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.575302 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:06.642957 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.642936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:58:06.643064 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.643046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:58:06.643960 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.643937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:06.645170 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.645153 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 26 17:58:06.645661 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.645645 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbfp\" (UniqueName: \"kubernetes.io/projected/8aa976c7-8d7d-4b67-8814-89a7c1ee2f41-kube-api-access-vkbfp\") pod \"network-check-target-k47mn\" (UID: \"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41\") " pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:58:06.655668 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.655650 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72aecfd4-b021-4785-b203-12a59b056341-original-pull-secret\") pod \"global-pull-secret-syncer-9fwzm\" (UID: \"72aecfd4-b021-4785-b203-12a59b056341\") " pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:58:06.755052 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.755029 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fwzm" Jul 26 17:58:06.864055 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.864031 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7vmj\"" Jul 26 17:58:06.870266 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.870198 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9fwzm"] Jul 26 17:58:06.871882 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.871866 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:58:06.873876 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:06.873847 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72aecfd4_b021_4785_b203_12a59b056341.slice/crio-0ef20604c3190ca75cbf98dbd1eedd027724078f0b75b0da15c0d48433cb2945 WatchSource:0}: Error finding container 0ef20604c3190ca75cbf98dbd1eedd027724078f0b75b0da15c0d48433cb2945: Status 404 returned error can't find the container with id 0ef20604c3190ca75cbf98dbd1eedd027724078f0b75b0da15c0d48433cb2945 Jul 26 17:58:06.988795 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:06.988699 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k47mn"] Jul 26 17:58:06.990963 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:06.990942 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa976c7_8d7d_4b67_8814_89a7c1ee2f41.slice/crio-447b680823a205d6c611c90b07ad65e1ef0951623788a6a12342d37f1faa3b5f WatchSource:0}: Error finding container 447b680823a205d6c611c90b07ad65e1ef0951623788a6a12342d37f1faa3b5f: Status 404 returned error can't find the container with id 447b680823a205d6c611c90b07ad65e1ef0951623788a6a12342d37f1faa3b5f Jul 26 17:58:07.098588 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.098564 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hggld_f216a66e-0611-4d7e-b7ab-6bf977bbfd6c/dns-node-resolver/0.log" Jul 26 17:58:07.127242 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.127219 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:58:07.127327 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.127267 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:58:07.127588 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.127575 2565 scope.go:117] "RemoveContainer" containerID="540bab2aa17372878d635cde5d29712bb2cf649bdb0a52988deeafa2ec9b7523" Jul 26 17:58:07.127731 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.127714 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-4nzlj_openshift-console-operator(f9809214-22c8-4990-a8f4-770a1d3a989f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" podUID="f9809214-22c8-4990-a8f4-770a1d3a989f" Jul 26 17:58:07.326763 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.326729 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k47mn" event={"ID":"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41","Type":"ContainerStarted","Data":"a4668e4b1213857e95695272d28d67aa8285c1646c9fc7f5922bc9fba421b7f5"} Jul 26 17:58:07.326914 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.326871 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:58:07.326914 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.326909 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k47mn" event={"ID":"8aa976c7-8d7d-4b67-8814-89a7c1ee2f41","Type":"ContainerStarted","Data":"447b680823a205d6c611c90b07ad65e1ef0951623788a6a12342d37f1faa3b5f"} Jul 26 17:58:07.327778 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.327758 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9fwzm" event={"ID":"72aecfd4-b021-4785-b203-12a59b056341","Type":"ContainerStarted","Data":"0ef20604c3190ca75cbf98dbd1eedd027724078f0b75b0da15c0d48433cb2945"} Jul 26 17:58:07.449965 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.449900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:58:07.449965 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.449952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:58:07.450136 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.450056 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 26 17:58:07.450136 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.450073 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-888964c5f-9ldfs: secret "image-registry-tls" not found Jul 26 17:58:07.450136 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.450117 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls podName:2adf0630-fd4d-4e7b-bc40-b2be54d1ae50 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:39.450102518 +0000 UTC m=+98.153829683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls") pod "image-registry-888964c5f-9ldfs" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50") : secret "image-registry-tls" not found Jul 26 17:58:07.450136 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.450121 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 26 17:58:07.450291 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.450177 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls podName:e4af50be-8015-404c-88fa-aada2c84ac2d nodeName:}" failed. No retries permitted until 2026-07-26 17:58:39.450159822 +0000 UTC m=+98.153886960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls") pod "dns-default-l5qjb" (UID: "e4af50be-8015-404c-88fa-aada2c84ac2d") : secret "dns-default-metrics-tls" not found Jul 26 17:58:07.487129 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.487105 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:07.897438 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.897409 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lzgg_a74e93c1-e880-4b9d-abdc-ec56742fbf45/node-ca/0.log" Jul 26 17:58:07.954526 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.954498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:07.954668 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:07.954548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:07.954668 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.954636 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 26 17:58:07.954745 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.954705 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:11.954685077 +0000 UTC m=+70.658412233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : configmap "kube-rbac-proxy" not found Jul 26 17:58:07.954796 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.954755 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 26 17:58:07.954837 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:07.954809 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:11.954793953 +0000 UTC m=+70.658521095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : secret "insights-runtime-extractor-tls" not found Jul 26 17:58:09.097995 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:09.097950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nk55l_7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba/serve-healthcheck-canary/0.log" Jul 26 17:58:09.700658 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:09.700624 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-4v229_b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7/kube-storage-version-migrator-operator/0.log" Jul 26 17:58:09.997150 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:09.997038 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:11.000178 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.000137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:11.141702 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.141676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:11.307191 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.307159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:11.341469 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.341443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9fwzm" event={"ID":"72aecfd4-b021-4785-b203-12a59b056341","Type":"ContainerStarted","Data":"e90c34bbb1de820c9dbb0c99e00befb6ec45b99435db243b685a93543b37b11a"} Jul 26 17:58:11.360369 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.360300 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9fwzm" podStartSLOduration=65.097117119 podStartE2EDuration="1m9.360286448s" totalImagesPullingTime="4.263169329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:11.360233556 +0000 UTC m=+70.063960712" watchObservedRunningTime="2026-07-26 17:58:11.360286448 +0000 UTC m=+70.064013606" Jul 26 17:58:11.360891 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.360867 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k47mn" podStartSLOduration=69.36086033 podStartE2EDuration="1m9.36086033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:07.343900231 +0000 UTC m=+66.047627388" watchObservedRunningTime="2026-07-26 17:58:11.36086033 +0000 UTC m=+70.064587488" Jul 26 17:58:11.375298 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.375264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:11.487890 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.487855 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:11.596274 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.596188 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:11.705466 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.705441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:11.989003 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.988936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:11.989003 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:11.988975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:11.989152 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:11.989051 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 26 17:58:11.989152 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:11.989097 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:19.989084346 +0000 UTC m=+78.692811499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : configmap "kube-rbac-proxy" not found Jul 26 17:58:11.989152 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:11.989134 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 26 17:58:11.989257 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:11.989179 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:19.989168645 +0000 UTC m=+78.692895782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : secret "insights-runtime-extractor-tls" not found Jul 26 17:58:12.391948 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.391914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:58:12.394211 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.394185 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/67e96387-dddf-4ece-8df8-a122c49bf38c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-th2ng\" (UID: \"67e96387-dddf-4ece-8df8-a122c49bf38c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:58:12.493110 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.493078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:58:12.493110 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.493113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:58:12.493343 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:12.493254 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 26 17:58:12.493343 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:12.493281 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 26 17:58:12.493443 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:12.493349 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls podName:121c3677-1b02-4b04-b32d-214d58e2bbcc nodeName:}" failed. No retries permitted until 2026-07-26 17:58:28.493328302 +0000 UTC m=+87.197055452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-pb2wt" (UID: "121c3677-1b02-4b04-b32d-214d58e2bbcc") : secret "cluster-monitoring-operator-tls" not found Jul 26 17:58:12.493443 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:12.493369 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert podName:0ad9951d-4903-4f6d-a3f6-37facf6c7bca nodeName:}" failed. No retries permitted until 2026-07-26 17:58:28.493359652 +0000 UTC m=+87.197086788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kjvrd" (UID: "0ad9951d-4903-4f6d-a3f6-37facf6c7bca") : secret "networking-console-plugin-cert" not found Jul 26 17:58:12.508394 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.508373 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l4gkp\"" Jul 26 17:58:12.516978 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.516957 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" Jul 26 17:58:12.633980 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.633944 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng"] Jul 26 17:58:12.694731 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.694704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:12.694824 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.694801 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:12.694893 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:12.694831 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 26 17:58:12.694942 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:12.694901 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:58:28.694880285 +0000 UTC m=+87.398607439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : secret "router-metrics-certs-default" not found Jul 26 17:58:12.694942 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:12.694921 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle podName:c83ddb99-6686-41e6-85c7-33e298be9ecd nodeName:}" failed. No retries permitted until 2026-07-26 17:58:28.694911764 +0000 UTC m=+87.398638906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle") pod "router-default-f857c88c9-62tnm" (UID: "c83ddb99-6686-41e6-85c7-33e298be9ecd") : configmap references non-existent config key: service-ca.crt Jul 26 17:58:12.896835 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:12.896796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:13.102661 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:13.102627 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:13.303875 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:13.303841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:13.349021 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:13.348994 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" event={"ID":"67e96387-dddf-4ece-8df8-a122c49bf38c","Type":"ContainerStarted","Data":"5a361ccee5db303201f60547e6e3be6ecf190af8e95d88a6cffc241dcd723f57"} Jul 26 17:58:13.506003 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:13.505915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:13.699539 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:13.699496 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:13.752843 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:13.752785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:14.354181 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:14.354149 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" event={"ID":"67e96387-dddf-4ece-8df8-a122c49bf38c","Type":"ContainerStarted","Data":"ba80822ac294b3f5b5c054b5b4c60b71a46b00902e553541f1eeac196cfd11be"} Jul 26 17:58:14.354308 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:14.354240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" event={"ID":"67e96387-dddf-4ece-8df8-a122c49bf38c","Type":"ContainerStarted","Data":"c84ea51d1d92f0c7ebd77b8be92bca6008fd44356c91d2a192f864eca6401b21"} Jul 26 17:58:14.369499 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:14.369449 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-th2ng" podStartSLOduration=16.832651757 podStartE2EDuration="18.369431548s" totalImagesPullingTime="1.536779791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:14.36816253 +0000 UTC m=+73.071889687" watchObservedRunningTime="2026-07-26 17:58:14.369431548 +0000 UTC m=+73.073158705" Jul 26 17:58:14.496959 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:14.496881 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:14.694570 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:14.694539 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:14.927900 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:14.927869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:15.324010 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:15.323979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:15.451023 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:15.450994 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:15.601022 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:15.600950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:15.905790 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:15.905715 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:16.005159 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:16.005130 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:16.506454 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:16.506419 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:16.865128 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:16.865099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:16.962570 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:16.962545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:17.117634 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:17.117563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:17.502988 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:17.502912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:18.095758 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:18.095726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:18.323333 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:18.323278 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:18.697631 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:18.697595 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:18.905974 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:18.905932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:19.104436 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:19.104402 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:19.504132 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:19.504047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:19.901812 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:19.901777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:20.054461 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:20.054432 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:20.054574 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:20.054469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:20.054612 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:20.054573 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 26 17:58:20.054650 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:20.054627 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls podName:70672d52-fcf2-4127-8521-9da6ff5b2066 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:36.054615076 +0000 UTC m=+94.758342213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79l7x" (UID: "70672d52-fcf2-4127-8521-9da6ff5b2066") : secret "insights-runtime-extractor-tls" not found Jul 26 17:58:20.054888 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:20.054870 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70672d52-fcf2-4127-8521-9da6ff5b2066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:20.696923 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:20.696892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:21.102613 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:21.102583 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:21.301924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:21.301894 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:21.496776 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:21.496708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:21.697617 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:21.697583 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:21.845809 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:21.845782 2565 scope.go:117] "RemoveContainer" containerID="540bab2aa17372878d635cde5d29712bb2cf649bdb0a52988deeafa2ec9b7523" Jul 26 17:58:22.379824 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:22.379798 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 17:58:22.380203 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:22.380187 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/1.log" Jul 26 17:58:22.380259 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:22.380219 2565 generic.go:356] "Generic (PLEG): container finished" podID="f9809214-22c8-4990-a8f4-770a1d3a989f" containerID="711baf96442c587a9b1812e1e0b4b85cdbca1398bdf4b4a2af02a312bd6c8fb1" exitCode=255 Jul 26 17:58:22.380304 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:22.380262 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" event={"ID":"f9809214-22c8-4990-a8f4-770a1d3a989f","Type":"ContainerDied","Data":"711baf96442c587a9b1812e1e0b4b85cdbca1398bdf4b4a2af02a312bd6c8fb1"} Jul 26 17:58:22.380358 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:22.380307 2565 scope.go:117] "RemoveContainer" containerID="540bab2aa17372878d635cde5d29712bb2cf649bdb0a52988deeafa2ec9b7523" Jul 26 17:58:22.380593 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:22.380575 2565 scope.go:117] "RemoveContainer" containerID="711baf96442c587a9b1812e1e0b4b85cdbca1398bdf4b4a2af02a312bd6c8fb1" Jul 26 17:58:22.380799 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:22.380778 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-4nzlj_openshift-console-operator(f9809214-22c8-4990-a8f4-770a1d3a989f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" podUID="f9809214-22c8-4990-a8f4-770a1d3a989f" Jul 26 17:58:23.384396 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:23.384366 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 17:58:25.917268 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:25.917135 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:26.124218 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:26.124183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:26.749494 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:26.749460 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:26.890501 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:26.890466 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:27.127716 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:27.127697 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:58:27.128030 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:27.127742 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:58:27.128030 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:27.127986 2565 scope.go:117] "RemoveContainer" containerID="711baf96442c587a9b1812e1e0b4b85cdbca1398bdf4b4a2af02a312bd6c8fb1" Jul 26 17:58:27.128129 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:27.128113 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-4nzlj_openshift-console-operator(f9809214-22c8-4990-a8f4-770a1d3a989f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" podUID="f9809214-22c8-4990-a8f4-770a1d3a989f" Jul 26 17:58:28.526205 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.526172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:58:28.526205 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.526205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:58:28.528450 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.528428 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad9951d-4903-4f6d-a3f6-37facf6c7bca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kjvrd\" (UID: \"0ad9951d-4903-4f6d-a3f6-37facf6c7bca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:58:28.528450 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.528439 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/121c3677-1b02-4b04-b32d-214d58e2bbcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-pb2wt\" (UID: \"121c3677-1b02-4b04-b32d-214d58e2bbcc\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:58:28.727049 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.727018 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:28.727162 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.727097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:28.727637 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.727615 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ddb99-6686-41e6-85c7-33e298be9ecd-service-ca-bundle\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:28.729136 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.729112 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83ddb99-6686-41e6-85c7-33e298be9ecd-metrics-certs\") pod \"router-default-f857c88c9-62tnm\" (UID: \"c83ddb99-6686-41e6-85c7-33e298be9ecd\") " pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:28.805231 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.805213 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xk5xr\"" Jul 26 17:58:28.813246 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.813230 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" Jul 26 17:58:28.825204 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.825187 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-79vhl\"" Jul 26 17:58:28.831775 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.831758 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" Jul 26 17:58:28.941811 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.941750 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd"] Jul 26 17:58:28.944140 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:28.944114 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad9951d_4903_4f6d_a3f6_37facf6c7bca.slice/crio-c5daa8316c911b2fb6509ae6d6025ad0a865cad5b59b6336a5fd05f2f8a1a561 WatchSource:0}: Error finding container c5daa8316c911b2fb6509ae6d6025ad0a865cad5b59b6336a5fd05f2f8a1a561: Status 404 returned error can't find the container with id c5daa8316c911b2fb6509ae6d6025ad0a865cad5b59b6336a5fd05f2f8a1a561 Jul 26 17:58:28.958217 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:28.958195 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt"] Jul 26 17:58:28.962493 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:28.962469 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121c3677_1b02_4b04_b32d_214d58e2bbcc.slice/crio-0336ae51745afb2df64f25b7324ab8fe9edd2543b1d17f38283fe89028439a94 WatchSource:0}: Error finding container 0336ae51745afb2df64f25b7324ab8fe9edd2543b1d17f38283fe89028439a94: Status 404 returned error can't find the container with id 0336ae51745afb2df64f25b7324ab8fe9edd2543b1d17f38283fe89028439a94 Jul 26 17:58:29.013470 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:29.013446 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xxltz\"" Jul 26 17:58:29.022161 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:29.022144 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:29.141995 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:29.141971 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f857c88c9-62tnm"] Jul 26 17:58:29.144107 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:29.144084 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83ddb99_6686_41e6_85c7_33e298be9ecd.slice/crio-ce005d9712a4ef797424c281526acfc437be2d04e5fb7c18a1df2ba4e2087350 WatchSource:0}: Error finding container ce005d9712a4ef797424c281526acfc437be2d04e5fb7c18a1df2ba4e2087350: Status 404 returned error can't find the container with id ce005d9712a4ef797424c281526acfc437be2d04e5fb7c18a1df2ba4e2087350 Jul 26 17:58:29.402654 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:29.402584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" event={"ID":"121c3677-1b02-4b04-b32d-214d58e2bbcc","Type":"ContainerStarted","Data":"0336ae51745afb2df64f25b7324ab8fe9edd2543b1d17f38283fe89028439a94"} Jul 26 17:58:29.403722 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:29.403700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" event={"ID":"0ad9951d-4903-4f6d-a3f6-37facf6c7bca","Type":"ContainerStarted","Data":"c5daa8316c911b2fb6509ae6d6025ad0a865cad5b59b6336a5fd05f2f8a1a561"} Jul 26 17:58:29.404949 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:29.404926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f857c88c9-62tnm" event={"ID":"c83ddb99-6686-41e6-85c7-33e298be9ecd","Type":"ContainerStarted","Data":"8bfc4d5a06432f66513ee9649b03fe7b7a65140981d562da21dd00806b913e3b"} Jul 26 17:58:29.405066 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:29.404968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f857c88c9-62tnm" event={"ID":"c83ddb99-6686-41e6-85c7-33e298be9ecd","Type":"ContainerStarted","Data":"ce005d9712a4ef797424c281526acfc437be2d04e5fb7c18a1df2ba4e2087350"} Jul 26 17:58:29.422482 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:29.422439 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f857c88c9-62tnm" podStartSLOduration=33.422425387 podStartE2EDuration="33.422425387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:29.421512812 +0000 UTC m=+88.125239969" watchObservedRunningTime="2026-07-26 17:58:29.422425387 +0000 UTC m=+88.126152537" Jul 26 17:58:30.022748 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:30.022658 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:30.025813 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:30.025792 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:30.411042 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:30.410974 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" event={"ID":"0ad9951d-4903-4f6d-a3f6-37facf6c7bca","Type":"ContainerStarted","Data":"730697a0e682b451211c51b89f4e81fd232c9af7ebf84c795d5b2edb73ea02a6"} Jul 26 17:58:30.411437 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:30.411418 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:30.412710 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:30.412686 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f857c88c9-62tnm" Jul 26 17:58:30.425681 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:30.425626 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kjvrd" podStartSLOduration=33.174361505 podStartE2EDuration="34.425607206s" totalImagesPullingTime="1.251245701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:30.42529237 +0000 UTC m=+89.129019528" watchObservedRunningTime="2026-07-26 17:58:30.425607206 +0000 UTC m=+89.129334363" Jul 26 17:58:30.525881 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:30.525841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:30.627511 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:30.627480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:31.185566 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:31.185478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:31.286608 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:31.286578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:31.380980 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:31.380945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:31.415691 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:31.415664 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" event={"ID":"121c3677-1b02-4b04-b32d-214d58e2bbcc","Type":"ContainerStarted","Data":"967be435b43e328730d3050b6ad86faa63084cac48cde23318eb568fb15df360"} Jul 26 17:58:31.434241 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:31.434197 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-pb2wt" podStartSLOduration=33.52653148 podStartE2EDuration="35.434181805s" totalImagesPullingTime="1.907650325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:31.433388913 +0000 UTC m=+90.137116070" watchObservedRunningTime="2026-07-26 17:58:31.434181805 +0000 UTC m=+90.137908962" Jul 26 17:58:31.461812 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:31.461739 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:33.808818 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:33.808778 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:33.869654 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:33.869621 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:35.973953 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:35.973918 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:36.075180 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:36.075145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:36.081109 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:36.081085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:36.083220 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:36.083204 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70672d52-fcf2-4127-8521-9da6ff5b2066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79l7x\" (UID: \"70672d52-fcf2-4127-8521-9da6ff5b2066\") " pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:36.095207 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:36.095185 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79l7x" Jul 26 17:58:36.263058 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:36.262962 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79l7x"] Jul 26 17:58:36.265495 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:36.265475 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70672d52_fcf2_4127_8521_9da6ff5b2066.slice/crio-2c1e7dc6cdddc50dadc5811a6243ce794f1b666f70ee2a161f97f27713dbf83f WatchSource:0}: Error finding container 2c1e7dc6cdddc50dadc5811a6243ce794f1b666f70ee2a161f97f27713dbf83f: Status 404 returned error can't find the container with id 2c1e7dc6cdddc50dadc5811a6243ce794f1b666f70ee2a161f97f27713dbf83f Jul 26 17:58:36.432309 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:36.432275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79l7x" event={"ID":"70672d52-fcf2-4127-8521-9da6ff5b2066","Type":"ContainerStarted","Data":"2c1e7dc6cdddc50dadc5811a6243ce794f1b666f70ee2a161f97f27713dbf83f"} Jul 26 17:58:37.401404 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:37.401374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:37.498775 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:37.498724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:37.620993 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:37.620958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:37.676514 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:37.676409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:38.333885 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:38.333855 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k47mn" Jul 26 17:58:39.511186 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.511151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:58:39.511691 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.511206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:58:39.513928 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.513900 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4af50be-8015-404c-88fa-aada2c84ac2d-metrics-tls\") pod \"dns-default-l5qjb\" (UID: \"e4af50be-8015-404c-88fa-aada2c84ac2d\") " pod="openshift-dns/dns-default-l5qjb" Jul 26 17:58:39.514051 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.513909 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"image-registry-888964c5f-9ldfs\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:58:39.527022 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.527000 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-566xh\"" Jul 26 17:58:39.534890 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.534866 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5qjb" Jul 26 17:58:39.784943 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.784840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:39.805964 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.805938 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rvncq\"" Jul 26 17:58:39.813865 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.813841 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:58:39.837142 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:39.837115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:40.845047 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:40.845020 2565 scope.go:117] "RemoveContainer" containerID="711baf96442c587a9b1812e1e0b4b85cdbca1398bdf4b4a2af02a312bd6c8fb1" Jul 26 17:58:40.845471 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:40.845171 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-4nzlj_openshift-console-operator(f9809214-22c8-4990-a8f4-770a1d3a989f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" podUID="f9809214-22c8-4990-a8f4-770a1d3a989f" Jul 26 17:58:41.174489 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.174459 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l5qjb"] Jul 26 17:58:41.178295 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:41.178267 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4af50be_8015_404c_88fa_aada2c84ac2d.slice/crio-6506a14ce267a7ce370bee5b723a4208e7e9cd487f2e1214cdec03a7f91eb5d4 WatchSource:0}: Error finding container 6506a14ce267a7ce370bee5b723a4208e7e9cd487f2e1214cdec03a7f91eb5d4: Status 404 returned error can't find the container with id 6506a14ce267a7ce370bee5b723a4208e7e9cd487f2e1214cdec03a7f91eb5d4 Jul 26 17:58:41.189482 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.189458 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-888964c5f-9ldfs"] Jul 26 17:58:41.193051 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:41.193021 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2adf0630_fd4d_4e7b_bc40_b2be54d1ae50.slice/crio-d832c05a7c0a52f349b113d9d5eca533cb067d5bd62312508f97cb89a14d254f WatchSource:0}: Error finding container d832c05a7c0a52f349b113d9d5eca533cb067d5bd62312508f97cb89a14d254f: Status 404 returned error can't find the container with id d832c05a7c0a52f349b113d9d5eca533cb067d5bd62312508f97cb89a14d254f Jul 26 17:58:41.455452 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.455350 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" event={"ID":"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50","Type":"ContainerStarted","Data":"447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217"} Jul 26 17:58:41.455452 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.455407 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" event={"ID":"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50","Type":"ContainerStarted","Data":"d832c05a7c0a52f349b113d9d5eca533cb067d5bd62312508f97cb89a14d254f"} Jul 26 17:58:41.455676 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.455460 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:58:41.456838 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.456810 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5qjb" event={"ID":"e4af50be-8015-404c-88fa-aada2c84ac2d","Type":"ContainerStarted","Data":"6506a14ce267a7ce370bee5b723a4208e7e9cd487f2e1214cdec03a7f91eb5d4"} Jul 26 17:58:41.458326 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.458291 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79l7x" event={"ID":"70672d52-fcf2-4127-8521-9da6ff5b2066","Type":"ContainerStarted","Data":"e7b2fde817ef2551beb747bc2ead52ba0df5d8d8da44cbf75a3cf566dcfb8597"} Jul 26 17:58:41.473768 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.473732 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" podStartSLOduration=99.473719539 podStartE2EDuration="1m39.473719539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:41.473282123 +0000 UTC m=+100.177009281" watchObservedRunningTime="2026-07-26 17:58:41.473719539 +0000 UTC m=+100.177446696" Jul 26 17:58:41.721096 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:41.720948 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:43.559865 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.559827 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:43.777475 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.777436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:43.793667 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.793635 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m"] Jul 26 17:58:43.863633 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.863554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:43.892895 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.892868 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:43.895479 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.895451 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 26 17:58:43.895479 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.895451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 26 17:58:43.895678 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.895481 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 26 17:58:43.896051 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.896032 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xkw44\"" Jul 26 17:58:43.899737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.899717 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m"] Jul 26 17:58:43.899850 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.899767 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pcwvb"] Jul 26 17:58:43.933207 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.933176 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:43.941150 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.941118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:43.943408 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.943376 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 26 17:58:43.943509 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.943425 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 26 17:58:43.943509 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.943377 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 26 17:58:43.943616 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:43.943376 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-47kbs\"" Jul 26 17:58:44.055839 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.055807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-wtmp\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.056006 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.055858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.056006 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.055890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.056006 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.055931 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.056006 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.055962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.056199 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.056072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.056199 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.056118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-metrics-client-ca\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.056199 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.056143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g94g\" (UniqueName: \"kubernetes.io/projected/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-kube-api-access-4g94g\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.056199 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.056171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-textfile\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.056199 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.056195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb5ql\" (UniqueName: \"kubernetes.io/projected/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-kube-api-access-nb5ql\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.056448 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.056232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-sys\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.056448 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.056256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-tls\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.056448 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.056298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-root\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.061030 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.061003 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:44.157592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-sys\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-tls\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-root\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-wtmp\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157633 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-sys\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:44.157724 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157652 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-root\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157730 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-wtmp\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:44.157780 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-tls podName:fdd8e7e3-6b47-46bb-ae1f-555765c9336d nodeName:}" failed. No retries permitted until 2026-07-26 17:58:44.657761145 +0000 UTC m=+103.361488282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-tls") pod "node-exporter-pcwvb" (UID: "fdd8e7e3-6b47-46bb-ae1f-555765c9336d") : secret "node-exporter-tls" not found Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.157859 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-metrics-client-ca\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.158451 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g94g\" (UniqueName: \"kubernetes.io/projected/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-kube-api-access-4g94g\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.158451 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-textfile\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.158451 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.157932 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb5ql\" (UniqueName: \"kubernetes.io/projected/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-kube-api-access-nb5ql\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.158451 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.158298 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.158644 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.158463 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-textfile\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.158644 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.158618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.158800 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.158771 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-metrics-client-ca\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.160215 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.160193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.160307 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.160264 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.160401 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.160387 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.168501 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.168475 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb5ql\" (UniqueName: \"kubernetes.io/projected/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-kube-api-access-nb5ql\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.168812 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.168790 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g94g\" (UniqueName: \"kubernetes.io/projected/fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36-kube-api-access-4g94g\") pod \"openshift-state-metrics-b8f49f5c6-9n85m\" (UID: \"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.200137 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.200111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:44.204996 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.204979 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" Jul 26 17:58:44.335564 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.335531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:44.437979 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.437887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:44.536557 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.536525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:44.662079 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.662046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-tls\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.664546 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.664522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdd8e7e3-6b47-46bb-ae1f-555765c9336d-node-exporter-tls\") pod \"node-exporter-pcwvb\" (UID: \"fdd8e7e3-6b47-46bb-ae1f-555765c9336d\") " pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.778729 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.778645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:44.851469 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.851439 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcwvb" Jul 26 17:58:44.877769 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:44.877735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:45.140790 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:45.140760 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd8e7e3_6b47_46bb_ae1f_555765c9336d.slice/crio-2887fbefd01bbc5e824ec1034e809e431d80d3c5ea367a981992b49dd94c8e19 WatchSource:0}: Error finding container 2887fbefd01bbc5e824ec1034e809e431d80d3c5ea367a981992b49dd94c8e19: Status 404 returned error can't find the container with id 2887fbefd01bbc5e824ec1034e809e431d80d3c5ea367a981992b49dd94c8e19 Jul 26 17:58:45.269923 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.269897 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m"] Jul 26 17:58:45.274376 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:45.274349 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbb5b02_b7d9_4cc5_abdb_a1c9d2791b36.slice/crio-28382a1f9908edbcf33e660645bb8e52b64528f6ab70f7cb57f1e75a5e75c2dd WatchSource:0}: Error finding container 28382a1f9908edbcf33e660645bb8e52b64528f6ab70f7cb57f1e75a5e75c2dd: Status 404 returned error can't find the container with id 28382a1f9908edbcf33e660645bb8e52b64528f6ab70f7cb57f1e75a5e75c2dd Jul 26 17:58:45.480477 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.480440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5qjb" event={"ID":"e4af50be-8015-404c-88fa-aada2c84ac2d","Type":"ContainerStarted","Data":"17e9314b972c1de1e436f87565018bd12b37dd6e3a979f6c2748162d13af93c0"} Jul 26 17:58:45.480776 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.480752 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l5qjb" Jul 26 17:58:45.480891 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.480791 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5qjb" event={"ID":"e4af50be-8015-404c-88fa-aada2c84ac2d","Type":"ContainerStarted","Data":"627e89dea753f2c96cddc4fe15c750a0cffbb86d921ca1faee708f2eae89cb3c"} Jul 26 17:58:45.481890 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.481864 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcwvb" event={"ID":"fdd8e7e3-6b47-46bb-ae1f-555765c9336d","Type":"ContainerStarted","Data":"2887fbefd01bbc5e824ec1034e809e431d80d3c5ea367a981992b49dd94c8e19"} Jul 26 17:58:45.483987 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.483957 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" event={"ID":"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36","Type":"ContainerStarted","Data":"8487f89d1dfe4eaee88b40e7ac8c341c3fb7de88da181cea21ac8ef170fe0be0"} Jul 26 17:58:45.484069 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.484016 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" event={"ID":"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36","Type":"ContainerStarted","Data":"99a36a46ba3f2be9d2aad4c8377ce823492a25f1a4f574fde84ec3301223afaa"} Jul 26 17:58:45.484069 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.484036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" event={"ID":"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36","Type":"ContainerStarted","Data":"28382a1f9908edbcf33e660645bb8e52b64528f6ab70f7cb57f1e75a5e75c2dd"} Jul 26 17:58:45.486151 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.486126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79l7x" event={"ID":"70672d52-fcf2-4127-8521-9da6ff5b2066","Type":"ContainerStarted","Data":"6c42ebbd63d5784093093c000915945d1a38edea514c35ed60f5627ce54b8d5a"} Jul 26 17:58:45.502439 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:45.502394 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l5qjb" podStartSLOduration=66.547700337 podStartE2EDuration="1m10.502377247s" totalImagesPullingTime="3.95467691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:45.501493875 +0000 UTC m=+104.205221035" watchObservedRunningTime="2026-07-26 17:58:45.502377247 +0000 UTC m=+104.206104406" Jul 26 17:58:46.492386 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.492356 2565 generic.go:356] "Generic (PLEG): container finished" podID="fdd8e7e3-6b47-46bb-ae1f-555765c9336d" containerID="681e76f8957e1ba514d1c277c73b8815b4b9d2fb97a2f6dab892e99aa0a6c0a4" exitCode=0 Jul 26 17:58:46.492749 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.492446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcwvb" event={"ID":"fdd8e7e3-6b47-46bb-ae1f-555765c9336d","Type":"ContainerDied","Data":"681e76f8957e1ba514d1c277c73b8815b4b9d2fb97a2f6dab892e99aa0a6c0a4"} Jul 26 17:58:46.495304 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.495229 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" event={"ID":"fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36","Type":"ContainerStarted","Data":"1c79e11903a671392a078944f79a288bb2567a52d0a3987c451a5005c187c117"} Jul 26 17:58:46.875182 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.875089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:46.962638 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.962590 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9n85m" podStartSLOduration=2.943991239 podStartE2EDuration="3.96256634s" totalImagesPullingTime="1.018575101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:46.605530968 +0000 UTC m=+105.309258127" watchObservedRunningTime="2026-07-26 17:58:46.96256634 +0000 UTC m=+105.666293498" Jul 26 17:58:46.962849 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.962831 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-97d7c8db5-nz2ct"] Jul 26 17:58:46.966645 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.966619 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.980008 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.979990 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 26 17:58:46.980419 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.980402 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5t56g\"" Jul 26 17:58:46.981302 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.981282 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 26 17:58:46.982566 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-tls\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.982669 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982632 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-metrics-client-ca\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.982669 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-grpc-tls\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.982779 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.982830 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.982830 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.982917 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.982917 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982853 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 26 17:58:46.982917 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.982856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85xtr\" (UniqueName: \"kubernetes.io/projected/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-kube-api-access-85xtr\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:46.983285 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.983257 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 26 17:58:46.983546 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.983529 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-744omadcjkfn8\"" Jul 26 17:58:46.985339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:46.985305 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 26 17:58:47.023483 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.023458 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-97d7c8db5-nz2ct"] Jul 26 17:58:47.068781 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.068743 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:47.083484 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.083458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-tls\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.083624 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.083517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-metrics-client-ca\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.083624 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.083545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-grpc-tls\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.083624 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.083584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.083815 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.083644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.083815 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.083672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.083815 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.083701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.083815 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.083724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85xtr\" (UniqueName: \"kubernetes.io/projected/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-kube-api-access-85xtr\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.084440 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.084411 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-metrics-client-ca\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.086699 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.086673 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.086890 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.086866 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.086954 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.086935 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.087054 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.087039 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.087403 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.087385 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-grpc-tls\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.089373 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.089353 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-secret-thanos-querier-tls\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.102034 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.102014 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85xtr\" (UniqueName: \"kubernetes.io/projected/b3df0c6a-871c-439f-9558-3cd7ec7cc05b-kube-api-access-85xtr\") pod \"thanos-querier-97d7c8db5-nz2ct\" (UID: \"b3df0c6a-871c-439f-9558-3cd7ec7cc05b\") " pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.277118 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.277041 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:47.306900 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.306859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:47.502221 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.502183 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcwvb" event={"ID":"fdd8e7e3-6b47-46bb-ae1f-555765c9336d","Type":"ContainerStarted","Data":"217e5ef2ab6f20637743708b743644b13762ccbfe99de8fa967bfef2455d9e7a"} Jul 26 17:58:47.502654 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.502247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcwvb" event={"ID":"fdd8e7e3-6b47-46bb-ae1f-555765c9336d","Type":"ContainerStarted","Data":"c0e1f1a25a56807667e754d94b4b75e18cf7d76a36a4fdc6fe17ffade5b18207"} Jul 26 17:58:47.526376 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.526197 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pcwvb" podStartSLOduration=3.5273225569999997 podStartE2EDuration="4.526181728s" totalImagesPullingTime="921.359737ms" totalInitContainerRuntime="77.499434ms" isStatefulPod=true podCreationTimestamp="2026-07-26 17:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:47.52557621 +0000 UTC m=+106.229303367" watchObservedRunningTime="2026-07-26 17:58:47.526181728 +0000 UTC m=+106.229908885" Jul 26 17:58:47.703788 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.703749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:47.798599 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.798559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:47.867252 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.867219 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-888964c5f-9ldfs"] Jul 26 17:58:47.962667 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:47.962581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:48.063504 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.063455 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:48.145717 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.145632 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-556b86c4f9-5cflt"] Jul 26 17:58:48.165487 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.165456 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-556b86c4f9-5cflt"] Jul 26 17:58:48.165650 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.165541 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.168142 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.168121 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wl9l8\"" Jul 26 17:58:48.168268 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.168179 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 26 17:58:48.168268 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.168224 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 26 17:58:48.168570 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.168546 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 26 17:58:48.168671 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.168550 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 26 17:58:48.168735 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.168555 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3is3e0ok79dhr\"" Jul 26 17:58:48.192927 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.192904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-client-ca-bundle\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.193027 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.192949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-secret-metrics-server-client-certs\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.193027 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.192973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ba80182c-b644-42e7-8215-dba94c05cb9d-metrics-server-audit-profiles\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.193154 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.193133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-secret-metrics-server-tls\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.193209 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.193174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ba80182c-b644-42e7-8215-dba94c05cb9d-audit-log\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.193256 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.193211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80182c-b644-42e7-8215-dba94c05cb9d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.193304 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.193272 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h794w\" (UniqueName: \"kubernetes.io/projected/ba80182c-b644-42e7-8215-dba94c05cb9d-kube-api-access-h794w\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.294199 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.294120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-secret-metrics-server-client-certs\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.294199 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.294171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ba80182c-b644-42e7-8215-dba94c05cb9d-metrics-server-audit-profiles\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.294421 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.294256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-secret-metrics-server-tls\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.294421 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.294281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ba80182c-b644-42e7-8215-dba94c05cb9d-audit-log\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.294421 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.294324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80182c-b644-42e7-8215-dba94c05cb9d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.294421 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.294354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h794w\" (UniqueName: \"kubernetes.io/projected/ba80182c-b644-42e7-8215-dba94c05cb9d-kube-api-access-h794w\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.294421 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.294387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-client-ca-bundle\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.295274 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.295119 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80182c-b644-42e7-8215-dba94c05cb9d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.295274 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.295223 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ba80182c-b644-42e7-8215-dba94c05cb9d-audit-log\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.295492 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.295470 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ba80182c-b644-42e7-8215-dba94c05cb9d-metrics-server-audit-profiles\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.297234 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.297209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-secret-metrics-server-tls\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.297346 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.297330 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-client-ca-bundle\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.297571 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.297547 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ba80182c-b644-42e7-8215-dba94c05cb9d-secret-metrics-server-client-certs\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.302553 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.302493 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h794w\" (UniqueName: \"kubernetes.io/projected/ba80182c-b644-42e7-8215-dba94c05cb9d-kube-api-access-h794w\") pod \"metrics-server-556b86c4f9-5cflt\" (UID: \"ba80182c-b644-42e7-8215-dba94c05cb9d\") " pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.477030 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.476982 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:58:48.566066 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.566035 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl"] Jul 26 17:58:48.568871 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.568824 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:48.571136 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.571119 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:48.573353 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.573332 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 26 17:58:48.573467 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.573390 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pr26v\"" Jul 26 17:58:48.576882 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.576857 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl"] Jul 26 17:58:48.597167 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.597141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-9fcwl\" (UID: \"e27ec3ec-a80d-4413-8f0b-7644b621fdd6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:48.597341 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.597302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jdgx\" (UniqueName: \"kubernetes.io/projected/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-kube-api-access-5jdgx\") pod \"monitoring-plugin-68b7fc9574-9fcwl\" (UID: \"e27ec3ec-a80d-4413-8f0b-7644b621fdd6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:48.698823 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.698788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-9fcwl\" (UID: \"e27ec3ec-a80d-4413-8f0b-7644b621fdd6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:48.698953 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.698938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jdgx\" (UniqueName: \"kubernetes.io/projected/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-kube-api-access-5jdgx\") pod \"monitoring-plugin-68b7fc9574-9fcwl\" (UID: \"e27ec3ec-a80d-4413-8f0b-7644b621fdd6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:48.699010 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:48.698945 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 26 17:58:48.699096 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:58:48.699083 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-monitoring-plugin-cert podName:e27ec3ec-a80d-4413-8f0b-7644b621fdd6 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:49.199059089 +0000 UTC m=+107.902786299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-9fcwl" (UID: "e27ec3ec-a80d-4413-8f0b-7644b621fdd6") : secret "monitoring-plugin-cert" not found Jul 26 17:58:48.709973 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.709943 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jdgx\" (UniqueName: \"kubernetes.io/projected/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-kube-api-access-5jdgx\") pod \"monitoring-plugin-68b7fc9574-9fcwl\" (UID: \"e27ec3ec-a80d-4413-8f0b-7644b621fdd6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:48.811921 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.811896 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-97d7c8db5-nz2ct"] Jul 26 17:58:48.815849 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:48.815825 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3df0c6a_871c_439f_9558_3cd7ec7cc05b.slice/crio-dc8465a10d000bf31dad3a7063c06a0c381d60834429b81b858ea1e1269f5fa2 WatchSource:0}: Error finding container dc8465a10d000bf31dad3a7063c06a0c381d60834429b81b858ea1e1269f5fa2: Status 404 returned error can't find the container with id dc8465a10d000bf31dad3a7063c06a0c381d60834429b81b858ea1e1269f5fa2 Jul 26 17:58:48.825277 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.825253 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-556b86c4f9-5cflt"] Jul 26 17:58:48.828062 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:48.828039 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba80182c_b644_42e7_8215_dba94c05cb9d.slice/crio-9f578cada0d2b9bf673170a8db0865a84674dbc76ad4baf3be48f52a76086006 WatchSource:0}: Error finding container 9f578cada0d2b9bf673170a8db0865a84674dbc76ad4baf3be48f52a76086006: Status 404 returned error can't find the container with id 9f578cada0d2b9bf673170a8db0865a84674dbc76ad4baf3be48f52a76086006 Jul 26 17:58:48.854054 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:48.854030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:49.203298 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:49.203219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-9fcwl\" (UID: \"e27ec3ec-a80d-4413-8f0b-7644b621fdd6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:49.205251 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:49.205234 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e27ec3ec-a80d-4413-8f0b-7644b621fdd6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-9fcwl\" (UID: \"e27ec3ec-a80d-4413-8f0b-7644b621fdd6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:49.482621 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:49.482548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:49.515135 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:49.515085 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" event={"ID":"ba80182c-b644-42e7-8215-dba94c05cb9d","Type":"ContainerStarted","Data":"9f578cada0d2b9bf673170a8db0865a84674dbc76ad4baf3be48f52a76086006"} Jul 26 17:58:49.518052 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:49.518018 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79l7x" event={"ID":"70672d52-fcf2-4127-8521-9da6ff5b2066","Type":"ContainerStarted","Data":"aa5bcb6d38ee56611d7752b6437cf25561a9d75f862050b2a1312dd8ba1d254e"} Jul 26 17:58:49.519541 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:49.519505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" event={"ID":"b3df0c6a-871c-439f-9558-3cd7ec7cc05b","Type":"ContainerStarted","Data":"dc8465a10d000bf31dad3a7063c06a0c381d60834429b81b858ea1e1269f5fa2"} Jul 26 17:58:49.535344 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:49.535254 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-79l7x" podStartSLOduration=33.211808678 podStartE2EDuration="45.535235151s" totalImagesPullingTime="12.323426473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:58:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:49.534725257 +0000 UTC m=+108.238452415" watchObservedRunningTime="2026-07-26 17:58:49.535235151 +0000 UTC m=+108.238962309" Jul 26 17:58:49.635189 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:49.635067 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl"] Jul 26 17:58:49.639428 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:49.639400 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27ec3ec_a80d_4413_8f0b_7644b621fdd6.slice/crio-9df9feea19a753adf92c7d6090ccac195a9d8daed5a38b00fdfded250d82b1e9 WatchSource:0}: Error finding container 9df9feea19a753adf92c7d6090ccac195a9d8daed5a38b00fdfded250d82b1e9: Status 404 returned error can't find the container with id 9df9feea19a753adf92c7d6090ccac195a9d8daed5a38b00fdfded250d82b1e9 Jul 26 17:58:50.403558 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:50.403533 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:50.526760 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:50.526720 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" event={"ID":"ba80182c-b644-42e7-8215-dba94c05cb9d","Type":"ContainerStarted","Data":"17aeb48aa9cb9300067506d2ef50ea9921e2f05c092225bb02a2f1258e4fc736"} Jul 26 17:58:50.528691 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:50.528663 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" event={"ID":"e27ec3ec-a80d-4413-8f0b-7644b621fdd6","Type":"ContainerStarted","Data":"9df9feea19a753adf92c7d6090ccac195a9d8daed5a38b00fdfded250d82b1e9"} Jul 26 17:58:50.543868 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:50.543777 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" podStartSLOduration=1.012235902 podStartE2EDuration="2.543763028s" totalImagesPullingTime="1.531527126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:50.543673306 +0000 UTC m=+109.247400466" watchObservedRunningTime="2026-07-26 17:58:50.543763028 +0000 UTC m=+109.247490185" Jul 26 17:58:50.549391 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:50.549349 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:51.533029 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:51.533003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" event={"ID":"e27ec3ec-a80d-4413-8f0b-7644b621fdd6","Type":"ContainerStarted","Data":"796a3b8fa5a24acb29d115a74bc7e86e1de4b8ee797b579e280a86ec62573487"} Jul 26 17:58:51.533389 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:51.533098 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:51.535486 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:51.535460 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" event={"ID":"b3df0c6a-871c-439f-9558-3cd7ec7cc05b","Type":"ContainerStarted","Data":"8ce032af2abdc12e671f32e2acc5d7ee92fed3418d60f187d065a961bc735bb4"} Jul 26 17:58:51.535601 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:51.535516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" event={"ID":"b3df0c6a-871c-439f-9558-3cd7ec7cc05b","Type":"ContainerStarted","Data":"68338989cd48e7566051204311ff4ce58555e4483ab73e73e97ea4d2bf8cb7df"} Jul 26 17:58:51.538670 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:51.538654 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" Jul 26 17:58:51.549403 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:51.549356 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9fcwl" podStartSLOduration=1.838707652 podStartE2EDuration="3.549341186s" totalImagesPullingTime="1.710633534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:51.548613438 +0000 UTC m=+110.252340596" watchObservedRunningTime="2026-07-26 17:58:51.549341186 +0000 UTC m=+110.253068342" Jul 26 17:58:51.846403 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:51.846379 2565 scope.go:117] "RemoveContainer" containerID="711baf96442c587a9b1812e1e0b4b85cdbca1398bdf4b4a2af02a312bd6c8fb1" Jul 26 17:58:52.541424 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.541342 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 17:58:52.541923 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.541464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" event={"ID":"f9809214-22c8-4990-a8f4-770a1d3a989f","Type":"ContainerStarted","Data":"b17aa13d473f0a94a5658f0bc099a40db4c917bf0a42cb8905acfdb233680986"} Jul 26 17:58:52.541923 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.541869 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:58:52.544831 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.544804 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" event={"ID":"b3df0c6a-871c-439f-9558-3cd7ec7cc05b","Type":"ContainerStarted","Data":"9fc931891fe81a50d0af6466d10266eac885fa2759040cb2199271a045e26c34"} Jul 26 17:58:52.544988 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.544880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" event={"ID":"b3df0c6a-871c-439f-9558-3cd7ec7cc05b","Type":"ContainerStarted","Data":"6aa32aaf9f5c00d20899fda317a9f99a022bb68e6563d67642e9cccd08c1fcf2"} Jul 26 17:58:52.544988 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.544923 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" event={"ID":"b3df0c6a-871c-439f-9558-3cd7ec7cc05b","Type":"ContainerStarted","Data":"20134461e1bc5b57f5019129f887709a5fa25995abaa333aee5ace3dbe188d96"} Jul 26 17:58:52.544988 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.544957 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" event={"ID":"b3df0c6a-871c-439f-9558-3cd7ec7cc05b","Type":"ContainerStarted","Data":"a0d85fa21391dc85ff847df9491716bb432f354a572a3aae9ccc64b9a889f0f6"} Jul 26 17:58:52.547009 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.546988 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" Jul 26 17:58:52.556878 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.556844 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-4nzlj" podStartSLOduration=51.459229447 podStartE2EDuration="56.556832174s" totalImagesPullingTime="5.097602727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:52.555967139 +0000 UTC m=+111.259694297" watchObservedRunningTime="2026-07-26 17:58:52.556832174 +0000 UTC m=+111.260559331" Jul 26 17:58:52.588848 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.588813 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" podStartSLOduration=3.387769749 podStartE2EDuration="6.588798988s" totalImagesPullingTime="3.201029239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:52.588170534 +0000 UTC m=+111.291897694" watchObservedRunningTime="2026-07-26 17:58:52.588798988 +0000 UTC m=+111.292526147" Jul 26 17:58:52.659730 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.659695 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-ggt62"] Jul 26 17:58:52.662267 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.662247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-ggt62" Jul 26 17:58:52.664204 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.664185 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 26 17:58:52.664330 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.664208 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 26 17:58:52.664330 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.664290 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dzds6\"" Jul 26 17:58:52.666330 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.666290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:52.671661 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.671642 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-ggt62"] Jul 26 17:58:52.736015 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.735974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w544\" (UniqueName: \"kubernetes.io/projected/d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd-kube-api-access-9w544\") pod \"downloads-7c97dc4555-ggt62\" (UID: \"d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd\") " pod="openshift-console/downloads-7c97dc4555-ggt62" Jul 26 17:58:52.767322 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.767288 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:52.836965 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.836940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w544\" (UniqueName: \"kubernetes.io/projected/d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd-kube-api-access-9w544\") pod \"downloads-7c97dc4555-ggt62\" (UID: \"d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd\") " pod="openshift-console/downloads-7c97dc4555-ggt62" Jul 26 17:58:52.844788 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.844765 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w544\" (UniqueName: \"kubernetes.io/projected/d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd-kube-api-access-9w544\") pod \"downloads-7c97dc4555-ggt62\" (UID: \"d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd\") " pod="openshift-console/downloads-7c97dc4555-ggt62" Jul 26 17:58:52.865721 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.865694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:52.965598 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.965569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:52.972396 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:52.972375 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-ggt62" Jul 26 17:58:53.104512 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.104439 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-ggt62"] Jul 26 17:58:53.107358 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:58:53.107330 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18545ef_1ed3_4b33_bc0d_5f7eeeb9effd.slice/crio-ee23fae71212c0a34750e027d0ac94f72a4911ac12e836f523271e5bcdb5f3db WatchSource:0}: Error finding container ee23fae71212c0a34750e027d0ac94f72a4911ac12e836f523271e5bcdb5f3db: Status 404 returned error can't find the container with id ee23fae71212c0a34750e027d0ac94f72a4911ac12e836f523271e5bcdb5f3db Jul 26 17:58:53.139063 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.139040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:53.240924 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.240898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:53.532850 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.532766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:53.549795 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.549762 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-ggt62" event={"ID":"d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd","Type":"ContainerStarted","Data":"ee23fae71212c0a34750e027d0ac94f72a4911ac12e836f523271e5bcdb5f3db"} Jul 26 17:58:53.550131 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.549991 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:58:53.594700 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.594663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:53.736470 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.736398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:53.960127 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:53.960020 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:54.063350 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:54.063256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:54.160804 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:54.160773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:54.215410 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:54.215304 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:54.339722 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:54.339689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:54.748223 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:54.748181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:55.055236 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:55.055202 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:55.156700 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:55.156630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:55.498225 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:55.498153 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l5qjb" Jul 26 17:58:56.161538 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:56.161503 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:56.230723 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:56.230647 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:58:57.873757 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:57.873730 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:58:59.561293 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:58:59.561261 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-97d7c8db5-nz2ct" Jul 26 17:59:00.169707 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:00.169658 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:00.268100 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:00.268008 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:01.862143 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:01.862108 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:01.925676 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:01.925635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:03.175420 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.175381 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84ccc577c5-tpw4v"] Jul 26 17:59:03.180529 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.180508 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.182958 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.182934 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 26 17:59:03.182958 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.182948 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cb2kl\"" Jul 26 17:59:03.183131 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.182949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 26 17:59:03.183573 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.183555 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 26 17:59:03.183668 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.183595 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 26 17:59:03.183723 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.183674 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 26 17:59:03.190356 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.190332 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ccc577c5-tpw4v"] Jul 26 17:59:03.228391 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.228349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdlb8\" (UniqueName: \"kubernetes.io/projected/960451df-c440-481d-be22-374235ed7808-kube-api-access-zdlb8\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.228563 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.228408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-service-ca\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.228563 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.228436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-oauth-serving-cert\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.228563 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.228467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-console-config\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.228563 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.228534 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-serving-cert\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.228760 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.228568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-oauth-config\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.329443 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.329409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdlb8\" (UniqueName: \"kubernetes.io/projected/960451df-c440-481d-be22-374235ed7808-kube-api-access-zdlb8\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.329615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.329462 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-service-ca\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.329615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.329486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-oauth-serving-cert\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.329737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.329652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-console-config\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.329794 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.329751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-serving-cert\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.329846 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.329803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-oauth-config\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.330250 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.330215 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-oauth-serving-cert\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.330250 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.330234 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-service-ca\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.330443 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.330255 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-console-config\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.332177 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.332159 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-serving-cert\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.332502 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.332486 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-oauth-config\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.338354 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.338333 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdlb8\" (UniqueName: \"kubernetes.io/projected/960451df-c440-481d-be22-374235ed7808-kube-api-access-zdlb8\") pod \"console-84ccc577c5-tpw4v\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:03.491571 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:03.491486 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:04.622576 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:04.622536 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:07.363305 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:07.363262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:07.442425 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:07.442381 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:08.477291 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:08.477256 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:59:08.477678 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:08.477357 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:59:08.729135 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:08.729111 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ccc577c5-tpw4v"] Jul 26 17:59:08.731373 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:59:08.731346 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960451df_c440_481d_be22_374235ed7808.slice/crio-1032c1ef2f6178a3703f2b844d402fe8a2198c33d4ca8b84f2344a3a720a51cc WatchSource:0}: Error finding container 1032c1ef2f6178a3703f2b844d402fe8a2198c33d4ca8b84f2344a3a720a51cc: Status 404 returned error can't find the container with id 1032c1ef2f6178a3703f2b844d402fe8a2198c33d4ca8b84f2344a3a720a51cc Jul 26 17:59:09.627991 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:09.627651 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-ggt62" event={"ID":"d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd","Type":"ContainerStarted","Data":"858be04cd31a8e30e5d027e41a753910fdd58d53fa22b0f3ff26d6e73a699856"} Jul 26 17:59:09.627991 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:09.627717 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-ggt62" Jul 26 17:59:09.630201 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:09.629921 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ccc577c5-tpw4v" event={"ID":"960451df-c440-481d-be22-374235ed7808","Type":"ContainerStarted","Data":"1032c1ef2f6178a3703f2b844d402fe8a2198c33d4ca8b84f2344a3a720a51cc"} Jul 26 17:59:09.644271 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:09.644245 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-ggt62" Jul 26 17:59:09.649110 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:09.648533 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-ggt62" podStartSLOduration=1.851044701 podStartE2EDuration="17.648516074s" totalImagesPullingTime="15.797471373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:59:09.646410575 +0000 UTC m=+128.350137756" watchObservedRunningTime="2026-07-26 17:59:09.648516074 +0000 UTC m=+128.352243233" Jul 26 17:59:09.964218 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:09.963487 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6466bb56-hwsgq"] Jul 26 17:59:10.003874 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.003831 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6466bb56-hwsgq"] Jul 26 17:59:10.004052 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.003955 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.011240 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.011063 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 26 17:59:10.098048 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.097950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-oauth-config\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.098048 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.097986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-service-ca\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.098048 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.098017 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-oauth-serving-cert\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.098352 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.098128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpttb\" (UniqueName: \"kubernetes.io/projected/3e08fa27-206e-4c79-b15d-ab8c14d23968-kube-api-access-gpttb\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.098352 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.098188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-serving-cert\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.098352 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.098215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-config\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.098352 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.098254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-trusted-ca-bundle\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.160449 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.160369 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:10.199246 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.199211 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpttb\" (UniqueName: \"kubernetes.io/projected/3e08fa27-206e-4c79-b15d-ab8c14d23968-kube-api-access-gpttb\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.199429 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.199273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-serving-cert\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.201220 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.199308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-config\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.201220 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.199676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-trusted-ca-bundle\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.201220 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.199742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-oauth-config\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.201220 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.199767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-service-ca\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.201220 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.199799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-oauth-serving-cert\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.201220 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.200539 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-oauth-serving-cert\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.201220 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.201094 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-config\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.201765 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.201740 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-service-ca\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.202702 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.202657 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-trusted-ca-bundle\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.204394 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.204260 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-serving-cert\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.208248 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.208206 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpttb\" (UniqueName: \"kubernetes.io/projected/3e08fa27-206e-4c79-b15d-ab8c14d23968-kube-api-access-gpttb\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.208680 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.208562 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-oauth-config\") pod \"console-6c6466bb56-hwsgq\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.226124 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.226067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:10.315343 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.315249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:10.534225 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.527694 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6466bb56-hwsgq"] Jul 26 17:59:10.604756 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.604710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:59:10.608013 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.607988 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e82c225e-6d71-4825-b117-29957a7301c1-metrics-certs\") pod \"network-metrics-daemon-vlzln\" (UID: \"e82c225e-6d71-4825-b117-29957a7301c1\") " pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:59:10.638257 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.638198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6466bb56-hwsgq" event={"ID":"3e08fa27-206e-4c79-b15d-ab8c14d23968","Type":"ContainerStarted","Data":"d9c302ea7905275cb338aff99bc36cc8b506b9d7ad411f5a5569b7fa11e66dd5"} Jul 26 17:59:10.758915 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.758881 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9fbzz\"" Jul 26 17:59:10.767612 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.767587 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlzln" Jul 26 17:59:10.945379 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:10.945283 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vlzln"] Jul 26 17:59:10.949578 ip-10-0-132-146 kubenswrapper[2565]: W0726 17:59:10.949536 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82c225e_6d71_4825_b117_29957a7301c1.slice/crio-16266fec36c0441c9897c0f23231595a5cff79c5b24bbb7f673e400752bcfdc6 WatchSource:0}: Error finding container 16266fec36c0441c9897c0f23231595a5cff79c5b24bbb7f673e400752bcfdc6: Status 404 returned error can't find the container with id 16266fec36c0441c9897c0f23231595a5cff79c5b24bbb7f673e400752bcfdc6 Jul 26 17:59:11.648234 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:11.648042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlzln" event={"ID":"e82c225e-6d71-4825-b117-29957a7301c1","Type":"ContainerStarted","Data":"16266fec36c0441c9897c0f23231595a5cff79c5b24bbb7f673e400752bcfdc6"} Jul 26 17:59:12.886873 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:12.886824 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" podUID="2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" containerName="registry" containerID="cri-o://447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217" gracePeriod=30 Jul 26 17:59:13.192677 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.192640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:13.291971 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.291936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:13.345352 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.345304 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:59:13.434332 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434215 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-trusted-ca\") pod \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " Jul 26 17:59:13.434332 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434245 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pddz2\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-kube-api-access-pddz2\") pod \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " Jul 26 17:59:13.434332 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434267 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-installation-pull-secrets\") pod \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " Jul 26 17:59:13.434332 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434283 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-ca-trust-extracted\") pod \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " Jul 26 17:59:13.434592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434345 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") pod \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " Jul 26 17:59:13.434592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434372 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-image-registry-private-configuration\") pod \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " Jul 26 17:59:13.434592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434423 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-bound-sa-token\") pod \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " Jul 26 17:59:13.434592 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434483 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-certificates\") pod \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\" (UID: \"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50\") " Jul 26 17:59:13.434774 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.434714 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 17:59:13.435816 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.435763 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 17:59:13.437854 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.437804 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 17:59:13.438561 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.438514 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 17:59:13.438561 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.438524 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 17:59:13.439523 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.439428 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 17:59:13.440632 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.440596 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-kube-api-access-pddz2" (OuterVolumeSpecName: "kube-api-access-pddz2") pod "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50"). InnerVolumeSpecName "kube-api-access-pddz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 17:59:13.446651 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.446622 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" (UID: "2adf0630-fd4d-4e7b-bc40-b2be54d1ae50"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 17:59:13.536339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.536192 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-trusted-ca\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:13.536339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.536228 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pddz2\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-kube-api-access-pddz2\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:13.536339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.536242 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-installation-pull-secrets\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:13.536339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.536255 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-ca-trust-extracted\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:13.536339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.536268 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-tls\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:13.536339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.536278 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-image-registry-private-configuration\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:13.536339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.536287 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-bound-sa-token\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:13.536339 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.536295 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50-registry-certificates\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:13.660852 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.660763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6466bb56-hwsgq" event={"ID":"3e08fa27-206e-4c79-b15d-ab8c14d23968","Type":"ContainerStarted","Data":"3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9"} Jul 26 17:59:13.662815 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.662771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ccc577c5-tpw4v" event={"ID":"960451df-c440-481d-be22-374235ed7808","Type":"ContainerStarted","Data":"332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5"} Jul 26 17:59:13.664990 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.664961 2565 generic.go:356] "Generic (PLEG): container finished" podID="10feeaa6-5e25-4e36-8751-245d0ca80ed4" containerID="fd6bc89e6dc564c27c5ced6337227fdfe3cbd5d2e1246e4c102cd532724b2cc8" exitCode=0 Jul 26 17:59:13.665093 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.665006 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" event={"ID":"10feeaa6-5e25-4e36-8751-245d0ca80ed4","Type":"ContainerDied","Data":"fd6bc89e6dc564c27c5ced6337227fdfe3cbd5d2e1246e4c102cd532724b2cc8"} Jul 26 17:59:13.666215 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.665376 2565 scope.go:117] "RemoveContainer" containerID="fd6bc89e6dc564c27c5ced6337227fdfe3cbd5d2e1246e4c102cd532724b2cc8" Jul 26 17:59:13.667622 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.667087 2565 generic.go:356] "Generic (PLEG): container finished" podID="2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" containerID="447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217" exitCode=0 Jul 26 17:59:13.667622 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.667127 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" event={"ID":"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50","Type":"ContainerDied","Data":"447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217"} Jul 26 17:59:13.667622 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.667163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" event={"ID":"2adf0630-fd4d-4e7b-bc40-b2be54d1ae50","Type":"ContainerDied","Data":"d832c05a7c0a52f349b113d9d5eca533cb067d5bd62312508f97cb89a14d254f"} Jul 26 17:59:13.667622 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.667166 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-888964c5f-9ldfs" Jul 26 17:59:13.667622 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.667242 2565 scope.go:117] "RemoveContainer" containerID="447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217" Jul 26 17:59:13.680297 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.678044 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6466bb56-hwsgq" podStartSLOduration=1.8716988460000001 podStartE2EDuration="4.678024564s" totalImagesPullingTime="2.806325718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:59:13.677086777 +0000 UTC m=+132.380813934" watchObservedRunningTime="2026-07-26 17:59:13.678024564 +0000 UTC m=+132.381751722" Jul 26 17:59:13.687808 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.687777 2565 scope.go:117] "RemoveContainer" containerID="447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217" Jul 26 17:59:13.688275 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:59:13.688194 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217\": container with ID starting with 447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217 not found: ID does not exist" containerID="447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217" Jul 26 17:59:13.688275 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.688234 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217"} err="failed to get container status \"447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217\": rpc error: code = NotFound desc = could not find container \"447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217\": container with ID starting with 447ef91424449673ebd58dca4e238d9176701f231e6771c48bbe2f9e06417217 not found: ID does not exist" Jul 26 17:59:13.712737 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.712688 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84ccc577c5-tpw4v" podStartSLOduration=6.107371588 podStartE2EDuration="10.712646993s" totalImagesPullingTime="4.605275405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:59:13.710786297 +0000 UTC m=+132.414513468" watchObservedRunningTime="2026-07-26 17:59:13.712646993 +0000 UTC m=+132.416374152" Jul 26 17:59:13.739212 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.738884 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-888964c5f-9ldfs"] Jul 26 17:59:13.741904 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.741884 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-888964c5f-9ldfs"] Jul 26 17:59:13.851350 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:13.851289 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" path="/var/lib/kubelet/pods/2adf0630-fd4d-4e7b-bc40-b2be54d1ae50/volumes" Jul 26 17:59:14.674273 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:14.674241 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fwr5k" event={"ID":"10feeaa6-5e25-4e36-8751-245d0ca80ed4","Type":"ContainerStarted","Data":"572c6a5da659a1074eb20ce36ab9886b43af4748c72faa9368b6faee01ad103d"} Jul 26 17:59:14.677786 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:14.677758 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlzln" event={"ID":"e82c225e-6d71-4825-b117-29957a7301c1","Type":"ContainerStarted","Data":"3c91395ac1e28a9d201e4c9b2af240a2eebca11bea1f30d947598f19df387b4e"} Jul 26 17:59:15.685243 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:15.685200 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlzln" event={"ID":"e82c225e-6d71-4825-b117-29957a7301c1","Type":"ContainerStarted","Data":"6e0f138596b99e6a33d0a89f33989be776c147389633ec42c5bd758e52017e1c"} Jul 26 17:59:15.703778 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:15.703718 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vlzln" podStartSLOduration=130.16622253 podStartE2EDuration="2m13.703700469s" totalImagesPullingTime="3.537477939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:59:15.701308517 +0000 UTC m=+134.405035675" watchObservedRunningTime="2026-07-26 17:59:15.703700469 +0000 UTC m=+134.407427630" Jul 26 17:59:15.796205 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:15.796163 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:15.853054 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:15.853017 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:16.854795 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:16.854757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:16.952215 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:16.952175 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:17.005650 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:17.005610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:18.698840 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:18.698806 2565 generic.go:356] "Generic (PLEG): container finished" podID="d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8" containerID="18555220069b9e6208f353262567cfa1d5d4a48c09fb1e78665b8284e7a6452b" exitCode=0 Jul 26 17:59:18.699235 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:18.698866 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mnrvx" event={"ID":"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8","Type":"ContainerDied","Data":"18555220069b9e6208f353262567cfa1d5d4a48c09fb1e78665b8284e7a6452b"} Jul 26 17:59:18.699235 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:18.699176 2565 scope.go:117] "RemoveContainer" containerID="18555220069b9e6208f353262567cfa1d5d4a48c09fb1e78665b8284e7a6452b" Jul 26 17:59:19.704814 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:19.704782 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mnrvx" event={"ID":"d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8","Type":"ContainerStarted","Data":"30df3db18d70f234485933f541c0a76b289ddf382cb01012e3946cb696a32ccd"} Jul 26 17:59:20.315794 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:20.315758 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:20.315961 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:20.315821 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:20.319961 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:20.319941 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:20.712387 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:20.712267 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 17:59:20.752875 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:20.752841 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ccc577c5-tpw4v"] Jul 26 17:59:20.861208 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:20.861175 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:20.915452 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:20.915427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:20.967447 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:20.967371 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:21.656554 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:21.656513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:21.707639 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:21.707612 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:21.714507 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:21.714453 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-pb2wt_121c3677-1b02-4b04-b32d-214d58e2bbcc/cluster-monitoring-operator/0.log" Jul 26 17:59:22.512456 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:22.512427 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-556b86c4f9-5cflt_ba80182c-b644-42e7-8215-dba94c05cb9d/metrics-server/0.log" Jul 26 17:59:22.711500 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:22.711466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-9fcwl_e27ec3ec-a80d-4413-8f0b-7644b621fdd6/monitoring-plugin/0.log" Jul 26 17:59:23.492512 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:23.492478 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:23.593672 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:23.593633 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:23.695132 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:23.695096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:23.722669 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:23.722634 2565 generic.go:356] "Generic (PLEG): container finished" podID="b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7" containerID="152ae3698a41f5e6541a9e2f22d4c0bd6b9e8b6ecae1431c09694fc8a152e5aa" exitCode=0 Jul 26 17:59:23.722827 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:23.722706 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" event={"ID":"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7","Type":"ContainerDied","Data":"152ae3698a41f5e6541a9e2f22d4c0bd6b9e8b6ecae1431c09694fc8a152e5aa"} Jul 26 17:59:23.723025 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:23.723012 2565 scope.go:117] "RemoveContainer" containerID="152ae3698a41f5e6541a9e2f22d4c0bd6b9e8b6ecae1431c09694fc8a152e5aa" Jul 26 17:59:23.794642 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:23.794603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:24.111745 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:24.111715 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcwvb_fdd8e7e3-6b47-46bb-ae1f-555765c9336d/init-textfile/0.log" Jul 26 17:59:24.312484 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:24.312449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcwvb_fdd8e7e3-6b47-46bb-ae1f-555765c9336d/node-exporter/0.log" Jul 26 17:59:24.511902 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:24.511823 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcwvb_fdd8e7e3-6b47-46bb-ae1f-555765c9336d/kube-rbac-proxy/0.log" Jul 26 17:59:24.711739 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:24.711704 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9n85m_fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36/kube-rbac-proxy-main/0.log" Jul 26 17:59:24.733782 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:24.733746 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4v229" event={"ID":"b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7","Type":"ContainerStarted","Data":"cedf5d00b6a4340e5003fc5254f8df4306986d4845a93804c997ad065288a469"} Jul 26 17:59:24.911584 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:24.911550 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9n85m_fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36/kube-rbac-proxy-self/0.log" Jul 26 17:59:25.116042 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:25.116007 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9n85m_fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36/openshift-state-metrics/0.log" Jul 26 17:59:27.312424 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:27.312398 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/thanos-query/0.log" Jul 26 17:59:27.511674 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:27.511643 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/kube-rbac-proxy-web/0.log" Jul 26 17:59:27.712037 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:27.711955 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/kube-rbac-proxy/0.log" Jul 26 17:59:27.912740 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:27.912709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/prom-label-proxy/0.log" Jul 26 17:59:28.112179 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:28.112143 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/kube-rbac-proxy-rules/0.log" Jul 26 17:59:28.312296 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:28.312263 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/kube-rbac-proxy-metrics/0.log" Jul 26 17:59:28.483067 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:28.482997 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:59:28.486615 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:28.486586 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-556b86c4f9-5cflt" Jul 26 17:59:28.514909 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:28.514882 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-kjvrd_0ad9951d-4903-4f6d-a3f6-37facf6c7bca/networking-console-plugin/0.log" Jul 26 17:59:28.711834 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:28.711803 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 17:59:28.914134 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:28.914100 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/3.log" Jul 26 17:59:29.112628 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:29.112600 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c6466bb56-hwsgq_3e08fa27-206e-4c79-b15d-ab8c14d23968/console/0.log" Jul 26 17:59:29.311964 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:29.311928 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84ccc577c5-tpw4v_960451df-c440-481d-be22-374235ed7808/console/0.log" Jul 26 17:59:29.514508 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:29.514478 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-ggt62_d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd/download-server/0.log" Jul 26 17:59:29.712789 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:29.712709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f857c88c9-62tnm_c83ddb99-6686-41e6-85c7-33e298be9ecd/router/0.log" Jul 26 17:59:30.312245 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:30.312212 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nk55l_7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba/serve-healthcheck-canary/0.log" Jul 26 17:59:38.630281 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:38.630244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:45.772420 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:45.772355 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84ccc577c5-tpw4v" podUID="960451df-c440-481d-be22-374235ed7808" containerName="console" containerID="cri-o://332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5" gracePeriod=15 Jul 26 17:59:46.046612 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.046536 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:46.098909 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.098879 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-service-ca\") pod \"960451df-c440-481d-be22-374235ed7808\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " Jul 26 17:59:46.099065 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.098924 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdlb8\" (UniqueName: \"kubernetes.io/projected/960451df-c440-481d-be22-374235ed7808-kube-api-access-zdlb8\") pod \"960451df-c440-481d-be22-374235ed7808\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " Jul 26 17:59:46.099065 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.098955 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-console-config\") pod \"960451df-c440-481d-be22-374235ed7808\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " Jul 26 17:59:46.099065 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.098975 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-serving-cert\") pod \"960451df-c440-481d-be22-374235ed7808\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " Jul 26 17:59:46.099065 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.098998 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-oauth-config\") pod \"960451df-c440-481d-be22-374235ed7808\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " Jul 26 17:59:46.099065 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.099062 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-oauth-serving-cert\") pod \"960451df-c440-481d-be22-374235ed7808\" (UID: \"960451df-c440-481d-be22-374235ed7808\") " Jul 26 17:59:46.099464 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.099433 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-service-ca" (OuterVolumeSpecName: "service-ca") pod "960451df-c440-481d-be22-374235ed7808" (UID: "960451df-c440-481d-be22-374235ed7808"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 17:59:46.099586 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.099462 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-console-config" (OuterVolumeSpecName: "console-config") pod "960451df-c440-481d-be22-374235ed7808" (UID: "960451df-c440-481d-be22-374235ed7808"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 17:59:46.099586 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.099536 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "960451df-c440-481d-be22-374235ed7808" (UID: "960451df-c440-481d-be22-374235ed7808"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 17:59:46.101203 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.101173 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960451df-c440-481d-be22-374235ed7808-kube-api-access-zdlb8" (OuterVolumeSpecName: "kube-api-access-zdlb8") pod "960451df-c440-481d-be22-374235ed7808" (UID: "960451df-c440-481d-be22-374235ed7808"). InnerVolumeSpecName "kube-api-access-zdlb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 17:59:46.101285 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.101192 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "960451df-c440-481d-be22-374235ed7808" (UID: "960451df-c440-481d-be22-374235ed7808"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 17:59:46.101285 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.101237 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "960451df-c440-481d-be22-374235ed7808" (UID: "960451df-c440-481d-be22-374235ed7808"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 17:59:46.200656 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.200620 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-service-ca\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:46.200656 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.200650 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdlb8\" (UniqueName: \"kubernetes.io/projected/960451df-c440-481d-be22-374235ed7808-kube-api-access-zdlb8\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:46.200656 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.200661 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-console-config\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:46.200920 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.200670 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-serving-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:46.200920 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.200678 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/960451df-c440-481d-be22-374235ed7808-console-oauth-config\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:46.200920 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.200686 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/960451df-c440-481d-be22-374235ed7808-oauth-serving-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 17:59:46.828429 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.828389 2565 generic.go:356] "Generic (PLEG): container finished" podID="960451df-c440-481d-be22-374235ed7808" containerID="332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5" exitCode=0 Jul 26 17:59:46.828892 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.828436 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ccc577c5-tpw4v" Jul 26 17:59:46.828892 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.828478 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ccc577c5-tpw4v" event={"ID":"960451df-c440-481d-be22-374235ed7808","Type":"ContainerDied","Data":"332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5"} Jul 26 17:59:46.828892 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.828532 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ccc577c5-tpw4v" event={"ID":"960451df-c440-481d-be22-374235ed7808","Type":"ContainerDied","Data":"1032c1ef2f6178a3703f2b844d402fe8a2198c33d4ca8b84f2344a3a720a51cc"} Jul 26 17:59:46.828892 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.828554 2565 scope.go:117] "RemoveContainer" containerID="332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5" Jul 26 17:59:46.836692 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.836677 2565 scope.go:117] "RemoveContainer" containerID="332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5" Jul 26 17:59:46.836920 ip-10-0-132-146 kubenswrapper[2565]: E0726 17:59:46.836905 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5\": container with ID starting with 332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5 not found: ID does not exist" containerID="332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5" Jul 26 17:59:46.836968 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.836928 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5"} err="failed to get container status \"332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5\": rpc error: code = NotFound desc = could not find container \"332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5\": container with ID starting with 332328d95c415dc446e397b24442558c49d493f9e1b456a098a9010393a55fa5 not found: ID does not exist" Jul 26 17:59:46.850459 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.850439 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ccc577c5-tpw4v"] Jul 26 17:59:46.854343 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.854308 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84ccc577c5-tpw4v"] Jul 26 17:59:46.861112 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.861090 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:46.913995 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:46.913974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 17:59:47.849432 ip-10-0-132-146 kubenswrapper[2565]: I0726 17:59:47.849400 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960451df-c440-481d-be22-374235ed7808" path="/var/lib/kubelet/pods/960451df-c440-481d-be22-374235ed7808/volumes" Jul 26 18:00:02.385191 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:02.385153 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:03.530147 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:03.530113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:03.703616 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:03.703558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:06.411832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.411794 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 26 18:00:06.412198 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.412109 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" containerName="registry" Jul 26 18:00:06.412198 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.412120 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" containerName="registry" Jul 26 18:00:06.412198 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.412140 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960451df-c440-481d-be22-374235ed7808" containerName="console" Jul 26 18:00:06.412198 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.412145 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="960451df-c440-481d-be22-374235ed7808" containerName="console" Jul 26 18:00:06.412198 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.412191 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="960451df-c440-481d-be22-374235ed7808" containerName="console" Jul 26 18:00:06.412391 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.412203 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2adf0630-fd4d-4e7b-bc40-b2be54d1ae50" containerName="registry" Jul 26 18:00:06.415600 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.415578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.419527 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419496 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 26 18:00:06.419677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419529 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 26 18:00:06.419677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419539 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 26 18:00:06.419677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419529 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 26 18:00:06.419677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419636 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-577xj\"" Jul 26 18:00:06.419677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419663 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 26 18:00:06.419923 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419892 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 26 18:00:06.419923 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419906 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 26 18:00:06.419923 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.419906 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 26 18:00:06.425986 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.425966 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 26 18:00:06.436620 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.436599 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 26 18:00:06.555492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555657 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555657 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e70b788-46c3-4b7b-829e-3404f0becf8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555657 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e70b788-46c3-4b7b-829e-3404f0becf8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555657 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7pl4\" (UniqueName: \"kubernetes.io/projected/4e70b788-46c3-4b7b-829e-3404f0becf8d-kube-api-access-k7pl4\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555657 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e70b788-46c3-4b7b-829e-3404f0becf8d-config-out\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555657 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555657 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-web-config\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555727 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e70b788-46c3-4b7b-829e-3404f0becf8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555748 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e70b788-46c3-4b7b-829e-3404f0becf8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.555866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.555764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657065 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657216 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657216 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e70b788-46c3-4b7b-829e-3404f0becf8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657216 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e70b788-46c3-4b7b-829e-3404f0becf8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657216 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657168 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7pl4\" (UniqueName: \"kubernetes.io/projected/4e70b788-46c3-4b7b-829e-3404f0becf8d-kube-api-access-k7pl4\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657216 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e70b788-46c3-4b7b-829e-3404f0becf8d-config-out\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-web-config\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e70b788-46c3-4b7b-829e-3404f0becf8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e70b788-46c3-4b7b-829e-3404f0becf8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657416 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.657831 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.657618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e70b788-46c3-4b7b-829e-3404f0becf8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.658296 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.658269 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e70b788-46c3-4b7b-829e-3404f0becf8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.659386 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.659362 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e70b788-46c3-4b7b-829e-3404f0becf8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.660146 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.660116 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e70b788-46c3-4b7b-829e-3404f0becf8d-config-out\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.660520 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.660278 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.660520 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.660463 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.660520 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.660475 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.660520 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.660479 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.660788 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.660657 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.660852 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.660834 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e70b788-46c3-4b7b-829e-3404f0becf8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.662242 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.662193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.662467 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.662447 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e70b788-46c3-4b7b-829e-3404f0becf8d-web-config\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.672062 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.672041 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7pl4\" (UniqueName: \"kubernetes.io/projected/4e70b788-46c3-4b7b-829e-3404f0becf8d-kube-api-access-k7pl4\") pod \"alertmanager-main-0\" (UID: \"4e70b788-46c3-4b7b-829e-3404f0becf8d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.724723 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.724686 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 26 18:00:06.868119 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.868092 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 26 18:00:06.870047 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:00:06.870020 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e70b788_46c3_4b7b_829e_3404f0becf8d.slice/crio-28aeb35953fdb640e7fe0265a1351de925568c40c347b3b9549cb50e391cf516 WatchSource:0}: Error finding container 28aeb35953fdb640e7fe0265a1351de925568c40c347b3b9549cb50e391cf516: Status 404 returned error can't find the container with id 28aeb35953fdb640e7fe0265a1351de925568c40c347b3b9549cb50e391cf516 Jul 26 18:00:06.904676 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:06.904640 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e70b788-46c3-4b7b-829e-3404f0becf8d","Type":"ContainerStarted","Data":"28aeb35953fdb640e7fe0265a1351de925568c40c347b3b9549cb50e391cf516"} Jul 26 18:00:08.492514 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.492480 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5"] Jul 26 18:00:08.494950 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.494929 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.497008 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.496987 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 26 18:00:08.497093 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.497078 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qw556\"" Jul 26 18:00:08.497257 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.497230 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 26 18:00:08.497391 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.497252 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 26 18:00:08.497541 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.497522 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 26 18:00:08.497611 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.497558 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 26 18:00:08.503412 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.503390 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 26 18:00:08.513970 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.511563 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5"] Jul 26 18:00:08.572188 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.572165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-telemeter-client-tls\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.572309 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.572230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9bt\" (UniqueName: \"kubernetes.io/projected/f74080fb-356a-44ed-bd8d-38bee3fa4c07-kube-api-access-pg9bt\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.572309 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.572255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-serving-certs-ca-bundle\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.572309 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.572274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-secret-telemeter-client\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.572437 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.572344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-metrics-client-ca\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.572437 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.572373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-federate-client-tls\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.572437 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.572391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.572437 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.572408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.673222 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.673192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-metrics-client-ca\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.673379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.673230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-federate-client-tls\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.673379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.673250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.673379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.673272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.673379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.673305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-telemeter-client-tls\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.673591 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.673392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9bt\" (UniqueName: \"kubernetes.io/projected/f74080fb-356a-44ed-bd8d-38bee3fa4c07-kube-api-access-pg9bt\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.673591 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.673428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-serving-certs-ca-bundle\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.673591 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.673457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-secret-telemeter-client\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.674063 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.674032 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-metrics-client-ca\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.674228 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.674201 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.674337 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.674206 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f74080fb-356a-44ed-bd8d-38bee3fa4c07-serving-certs-ca-bundle\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.675841 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.675821 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-federate-client-tls\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.675964 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.675935 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-secret-telemeter-client\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.676050 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.676028 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.676137 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.676121 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f74080fb-356a-44ed-bd8d-38bee3fa4c07-telemeter-client-tls\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.681079 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.681050 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9bt\" (UniqueName: \"kubernetes.io/projected/f74080fb-356a-44ed-bd8d-38bee3fa4c07-kube-api-access-pg9bt\") pod \"telemeter-client-6c4bd7fbdb-btcf5\" (UID: \"f74080fb-356a-44ed-bd8d-38bee3fa4c07\") " pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.805878 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.805850 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" Jul 26 18:00:08.920742 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.920708 2565 generic.go:356] "Generic (PLEG): container finished" podID="4e70b788-46c3-4b7b-829e-3404f0becf8d" containerID="8832cad9517166530e9fbdc53ea7a05dfbea0b2b0f83b713fef34e3c2e8ef90d" exitCode=0 Jul 26 18:00:08.920885 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.920769 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e70b788-46c3-4b7b-829e-3404f0becf8d","Type":"ContainerDied","Data":"8832cad9517166530e9fbdc53ea7a05dfbea0b2b0f83b713fef34e3c2e8ef90d"} Jul 26 18:00:08.934299 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:08.934197 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5"] Jul 26 18:00:08.936848 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:00:08.936827 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74080fb_356a_44ed_bd8d_38bee3fa4c07.slice/crio-c0f3055c2fd4140766d554bf2acfe5c74d57d96dd62be20c279452edf97ee1bb WatchSource:0}: Error finding container c0f3055c2fd4140766d554bf2acfe5c74d57d96dd62be20c279452edf97ee1bb: Status 404 returned error can't find the container with id c0f3055c2fd4140766d554bf2acfe5c74d57d96dd62be20c279452edf97ee1bb Jul 26 18:00:09.928153 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:09.928120 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" event={"ID":"f74080fb-356a-44ed-bd8d-38bee3fa4c07","Type":"ContainerStarted","Data":"c0f3055c2fd4140766d554bf2acfe5c74d57d96dd62be20c279452edf97ee1bb"} Jul 26 18:00:11.937917 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.937876 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" event={"ID":"f74080fb-356a-44ed-bd8d-38bee3fa4c07","Type":"ContainerStarted","Data":"06102407309e2861bc2ea7a87bfb3b628e50440559c364818ec458ba6270aa57"} Jul 26 18:00:11.938390 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.937945 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" event={"ID":"f74080fb-356a-44ed-bd8d-38bee3fa4c07","Type":"ContainerStarted","Data":"102c6fc2e070357e1c0c8795789ad8ee476815646ca611cb17be053b7e2a4c53"} Jul 26 18:00:11.938390 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.937974 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" event={"ID":"f74080fb-356a-44ed-bd8d-38bee3fa4c07","Type":"ContainerStarted","Data":"bc7ab136ba5674ea69c9e22a9ac58e6d72fe28b146f4e0b4c4b888276892dd9c"} Jul 26 18:00:11.940737 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.940702 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e70b788-46c3-4b7b-829e-3404f0becf8d","Type":"ContainerStarted","Data":"1d2e5b080468230a9e07c406f9f6ffc0f481e931203e443167d27b768a7cd1d7"} Jul 26 18:00:11.940848 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.940759 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e70b788-46c3-4b7b-829e-3404f0becf8d","Type":"ContainerStarted","Data":"d6d8213870c840ad65ad052316fff7ce42a23a0fef76a488bd65be5ebf14b00d"} Jul 26 18:00:11.940848 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.940786 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e70b788-46c3-4b7b-829e-3404f0becf8d","Type":"ContainerStarted","Data":"d46c066b4da60507acdfa1dac48465e744f2280d8957773650b855094847b935"} Jul 26 18:00:11.940848 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.940811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e70b788-46c3-4b7b-829e-3404f0becf8d","Type":"ContainerStarted","Data":"3f1617a920391c34799b5a20222a27acad4aa8129c5f6db4129a65468956f0dc"} Jul 26 18:00:11.940848 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.940844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e70b788-46c3-4b7b-829e-3404f0becf8d","Type":"ContainerStarted","Data":"83c627463875011b90736a280d33cb95a3c9c03e39c03715d8892de6ad64d135"} Jul 26 18:00:11.940998 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.940869 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e70b788-46c3-4b7b-829e-3404f0becf8d","Type":"ContainerStarted","Data":"b1137d205db249bb159e18d68404f746176172afb79839e8630d06e81a3aaf4b"} Jul 26 18:00:11.961225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.961176 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c4bd7fbdb-btcf5" podStartSLOduration=1.836000652 podStartE2EDuration="3.961162131s" totalImagesPullingTime="2.125161479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:00:11.958937259 +0000 UTC m=+190.662664415" watchObservedRunningTime="2026-07-26 18:00:11.961162131 +0000 UTC m=+190.664889288" Jul 26 18:00:11.983855 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:11.983808 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.747312759 podStartE2EDuration="5.983794714s" totalImagesPullingTime="3.22188446s" totalInitContainerRuntime="14.597495ms" isStatefulPod=false podCreationTimestamp="2026-07-26 18:00:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:00:11.981766065 +0000 UTC m=+190.685493222" watchObservedRunningTime="2026-07-26 18:00:11.983794714 +0000 UTC m=+190.687521871" Jul 26 18:00:12.730379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.730344 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c9fd4bb4f-88w4t"] Jul 26 18:00:12.732768 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.732741 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.742899 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.742867 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c9fd4bb4f-88w4t"] Jul 26 18:00:12.781211 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.781181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:12.824266 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.824238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjj79\" (UniqueName: \"kubernetes.io/projected/b0531d62-b181-40c7-8305-714616d2916b-kube-api-access-kjj79\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.824405 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.824285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-oauth-serving-cert\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.824405 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.824307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-console-config\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.824405 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.824354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-serving-cert\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.824405 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.824375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-oauth-config\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.824405 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.824388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-service-ca\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.824570 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.824453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-trusted-ca-bundle\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.881889 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.881861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:12.925201 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.925177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-trusted-ca-bundle\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.925308 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.925211 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjj79\" (UniqueName: \"kubernetes.io/projected/b0531d62-b181-40c7-8305-714616d2916b-kube-api-access-kjj79\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.925308 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.925254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-oauth-serving-cert\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.925308 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.925275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-console-config\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.925308 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.925292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-serving-cert\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.925541 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.925335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-oauth-config\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.925541 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.925354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-service-ca\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.926102 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.926077 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-console-config\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.926208 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.926108 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-service-ca\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.926208 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.926077 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-oauth-serving-cert\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.926208 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.926158 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-trusted-ca-bundle\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.927707 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.927682 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-oauth-config\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.927811 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.927794 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-serving-cert\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:12.932693 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:12.932673 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjj79\" (UniqueName: \"kubernetes.io/projected/b0531d62-b181-40c7-8305-714616d2916b-kube-api-access-kjj79\") pod \"console-6c9fd4bb4f-88w4t\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:13.045689 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:13.045599 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:13.173003 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:13.172978 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c9fd4bb4f-88w4t"] Jul 26 18:00:13.175482 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:00:13.175453 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0531d62_b181_40c7_8305_714616d2916b.slice/crio-8aba32c6a983215a7577e724c5f403550fe65b1714d95dedb754013c39a8ae86 WatchSource:0}: Error finding container 8aba32c6a983215a7577e724c5f403550fe65b1714d95dedb754013c39a8ae86: Status 404 returned error can't find the container with id 8aba32c6a983215a7577e724c5f403550fe65b1714d95dedb754013c39a8ae86 Jul 26 18:00:13.950866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:13.950828 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9fd4bb4f-88w4t" event={"ID":"b0531d62-b181-40c7-8305-714616d2916b","Type":"ContainerStarted","Data":"eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea"} Jul 26 18:00:13.950866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:13.950873 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9fd4bb4f-88w4t" event={"ID":"b0531d62-b181-40c7-8305-714616d2916b","Type":"ContainerStarted","Data":"8aba32c6a983215a7577e724c5f403550fe65b1714d95dedb754013c39a8ae86"} Jul 26 18:00:13.968114 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:13.968065 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c9fd4bb4f-88w4t" podStartSLOduration=1.9680507139999999 podStartE2EDuration="1.968050714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:00:13.966526568 +0000 UTC m=+192.670253719" watchObservedRunningTime="2026-07-26 18:00:13.968050714 +0000 UTC m=+192.671777872" Jul 26 18:00:16.535307 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:16.535265 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:16.636793 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:16.636759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:23.045741 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:23.045713 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:23.046255 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:23.045789 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:23.050376 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:23.050355 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:24.003241 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:24.003204 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:00:24.046129 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:24.046098 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6466bb56-hwsgq"] Jul 26 18:00:24.143904 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:24.143867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:24.195050 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:24.195019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:49.066843 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.066775 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c6466bb56-hwsgq" podUID="3e08fa27-206e-4c79-b15d-ab8c14d23968" containerName="console" containerID="cri-o://3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9" gracePeriod=15 Jul 26 18:00:49.310709 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.310677 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 18:00:49.388136 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388068 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-oauth-serving-cert\") pod \"3e08fa27-206e-4c79-b15d-ab8c14d23968\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " Jul 26 18:00:49.388278 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388155 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-trusted-ca-bundle\") pod \"3e08fa27-206e-4c79-b15d-ab8c14d23968\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " Jul 26 18:00:49.388278 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388183 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-service-ca\") pod \"3e08fa27-206e-4c79-b15d-ab8c14d23968\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " Jul 26 18:00:49.388278 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388215 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-config\") pod \"3e08fa27-206e-4c79-b15d-ab8c14d23968\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " Jul 26 18:00:49.388473 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388334 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpttb\" (UniqueName: \"kubernetes.io/projected/3e08fa27-206e-4c79-b15d-ab8c14d23968-kube-api-access-gpttb\") pod \"3e08fa27-206e-4c79-b15d-ab8c14d23968\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " Jul 26 18:00:49.388473 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388417 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-oauth-config\") pod \"3e08fa27-206e-4c79-b15d-ab8c14d23968\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " Jul 26 18:00:49.388473 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388463 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-serving-cert\") pod \"3e08fa27-206e-4c79-b15d-ab8c14d23968\" (UID: \"3e08fa27-206e-4c79-b15d-ab8c14d23968\") " Jul 26 18:00:49.388615 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388553 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e08fa27-206e-4c79-b15d-ab8c14d23968" (UID: "3e08fa27-206e-4c79-b15d-ab8c14d23968"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:00:49.388615 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388584 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e08fa27-206e-4c79-b15d-ab8c14d23968" (UID: "3e08fa27-206e-4c79-b15d-ab8c14d23968"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:00:49.388702 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388644 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-config" (OuterVolumeSpecName: "console-config") pod "3e08fa27-206e-4c79-b15d-ab8c14d23968" (UID: "3e08fa27-206e-4c79-b15d-ab8c14d23968"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:00:49.388775 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.388696 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3e08fa27-206e-4c79-b15d-ab8c14d23968" (UID: "3e08fa27-206e-4c79-b15d-ab8c14d23968"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:00:49.389094 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.389079 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-trusted-ca-bundle\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:00:49.389128 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.389096 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-service-ca\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:00:49.389128 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.389107 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-config\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:00:49.389128 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.389115 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e08fa27-206e-4c79-b15d-ab8c14d23968-oauth-serving-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:00:49.390977 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.390937 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e08fa27-206e-4c79-b15d-ab8c14d23968-kube-api-access-gpttb" (OuterVolumeSpecName: "kube-api-access-gpttb") pod "3e08fa27-206e-4c79-b15d-ab8c14d23968" (UID: "3e08fa27-206e-4c79-b15d-ab8c14d23968"). InnerVolumeSpecName "kube-api-access-gpttb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:00:49.390977 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.390952 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e08fa27-206e-4c79-b15d-ab8c14d23968" (UID: "3e08fa27-206e-4c79-b15d-ab8c14d23968"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:00:49.391192 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.391169 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e08fa27-206e-4c79-b15d-ab8c14d23968" (UID: "3e08fa27-206e-4c79-b15d-ab8c14d23968"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:00:49.489714 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.489680 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-oauth-config\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:00:49.489714 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.489711 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e08fa27-206e-4c79-b15d-ab8c14d23968-console-serving-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:00:49.489714 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:49.489721 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpttb\" (UniqueName: \"kubernetes.io/projected/3e08fa27-206e-4c79-b15d-ab8c14d23968-kube-api-access-gpttb\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:00:50.078558 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.078518 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:50.109743 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.109713 2565 generic.go:356] "Generic (PLEG): container finished" podID="3e08fa27-206e-4c79-b15d-ab8c14d23968" containerID="3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9" exitCode=0 Jul 26 18:00:50.109905 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.109758 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6466bb56-hwsgq" event={"ID":"3e08fa27-206e-4c79-b15d-ab8c14d23968","Type":"ContainerDied","Data":"3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9"} Jul 26 18:00:50.109905 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.109783 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6466bb56-hwsgq" Jul 26 18:00:50.109905 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.109796 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6466bb56-hwsgq" event={"ID":"3e08fa27-206e-4c79-b15d-ab8c14d23968","Type":"ContainerDied","Data":"d9c302ea7905275cb338aff99bc36cc8b506b9d7ad411f5a5569b7fa11e66dd5"} Jul 26 18:00:50.109905 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.109814 2565 scope.go:117] "RemoveContainer" containerID="3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9" Jul 26 18:00:50.118070 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.118052 2565 scope.go:117] "RemoveContainer" containerID="3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9" Jul 26 18:00:50.118343 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:00:50.118300 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9\": container with ID starting with 3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9 not found: ID does not exist" containerID="3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9" Jul 26 18:00:50.118442 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.118349 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9"} err="failed to get container status \"3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9\": rpc error: code = NotFound desc = could not find container \"3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9\": container with ID starting with 3a83bd06c48fccf19815f96de6d5e1369f4e2c34829fdd555005d50846f63fa9 not found: ID does not exist" Jul 26 18:00:50.124687 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.124668 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6466bb56-hwsgq"] Jul 26 18:00:50.129029 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.129008 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c6466bb56-hwsgq"] Jul 26 18:00:50.134000 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:50.133978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:00:51.849644 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:00:51.849613 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e08fa27-206e-4c79-b15d-ab8c14d23968" path="/var/lib/kubelet/pods/3e08fa27-206e-4c79-b15d-ab8c14d23968/volumes" Jul 26 18:01:18.690396 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:18.690358 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:01:18.745753 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:18.745714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:01:30.715251 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:30.715154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:01:30.766741 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:30.766711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:01:46.869772 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:46.869735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:01:46.970294 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:46.970256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:01:47.315470 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:47.315434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:01:52.673082 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.673043 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bdc8769d6-6dnst"] Jul 26 18:01:52.673579 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.673567 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e08fa27-206e-4c79-b15d-ab8c14d23968" containerName="console" Jul 26 18:01:52.673641 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.673582 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e08fa27-206e-4c79-b15d-ab8c14d23968" containerName="console" Jul 26 18:01:52.673686 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.673673 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e08fa27-206e-4c79-b15d-ab8c14d23968" containerName="console" Jul 26 18:01:52.676645 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.676624 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.687644 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.687622 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdc8769d6-6dnst"] Jul 26 18:01:52.749126 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.749085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:01:52.870981 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.870957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfw4j\" (UniqueName: \"kubernetes.io/projected/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-kube-api-access-bfw4j\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.871136 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.871000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-oauth-serving-cert\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.871136 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.871022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-serving-cert\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.871136 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.871094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-trusted-ca-bundle\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.871136 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.871130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-oauth-config\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.871366 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.871169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-config\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.871366 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.871258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-service-ca\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.972511 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.972446 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-oauth-config\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.972511 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.972479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-config\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.972677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.972515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-service-ca\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.972677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.972533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfw4j\" (UniqueName: \"kubernetes.io/projected/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-kube-api-access-bfw4j\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.972677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.972564 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-oauth-serving-cert\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.972677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.972591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-serving-cert\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.972677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.972630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-trusted-ca-bundle\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.973575 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.973551 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-config\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.973721 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.973692 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-trusted-ca-bundle\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.973721 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.973630 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-oauth-serving-cert\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.973884 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.973557 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-service-ca\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.975105 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.975079 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-oauth-config\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.975249 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.975234 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-serving-cert\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.979784 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.979766 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfw4j\" (UniqueName: \"kubernetes.io/projected/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-kube-api-access-bfw4j\") pod \"console-7bdc8769d6-6dnst\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:52.985587 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:52.985566 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:01:53.113021 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:53.112872 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdc8769d6-6dnst"] Jul 26 18:01:53.115838 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:01:53.115812 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987a3c77_fa47_43ab_a0c0_a3bc2dabb15e.slice/crio-007aa46c62c68c750a6ad81a4198190e4066bed0f63471e86a55d3fb65e3145c WatchSource:0}: Error finding container 007aa46c62c68c750a6ad81a4198190e4066bed0f63471e86a55d3fb65e3145c: Status 404 returned error can't find the container with id 007aa46c62c68c750a6ad81a4198190e4066bed0f63471e86a55d3fb65e3145c Jul 26 18:01:53.366821 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:53.366781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdc8769d6-6dnst" event={"ID":"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e","Type":"ContainerStarted","Data":"7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa"} Jul 26 18:01:53.366992 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:01:53.366833 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdc8769d6-6dnst" event={"ID":"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e","Type":"ContainerStarted","Data":"007aa46c62c68c750a6ad81a4198190e4066bed0f63471e86a55d3fb65e3145c"} Jul 26 18:02:01.719483 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:01.719455 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:02:01.726882 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:01.726861 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:02:01.726882 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:01.726876 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:02:01.732060 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:01.732044 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 26 18:02:01.734488 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:01.734466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:02:02.986246 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:02.986219 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:02:02.988504 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:02.986264 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:02:02.990389 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:02.990370 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:02:03.005550 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:03.005510 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bdc8769d6-6dnst" podStartSLOduration=11.005498339 podStartE2EDuration="11.005498339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:01:53.383002185 +0000 UTC m=+292.086729343" watchObservedRunningTime="2026-07-26 18:02:03.005498339 +0000 UTC m=+301.709225496" Jul 26 18:02:03.413816 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:03.413788 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:02:03.457124 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:03.457093 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c9fd4bb4f-88w4t"] Jul 26 18:02:03.578363 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:03.578332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:03.733677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:03.733598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:03.790819 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:03.790789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:23.261035 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:23.261002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:23.357225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:23.357189 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:28.477093 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.477051 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c9fd4bb4f-88w4t" podUID="b0531d62-b181-40c7-8305-714616d2916b" containerName="console" containerID="cri-o://eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea" gracePeriod=15 Jul 26 18:02:28.710792 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.710768 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:02:28.843748 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.843720 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-service-ca\") pod \"b0531d62-b181-40c7-8305-714616d2916b\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " Jul 26 18:02:28.843892 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.843752 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-oauth-serving-cert\") pod \"b0531d62-b181-40c7-8305-714616d2916b\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " Jul 26 18:02:28.843892 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.843790 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjj79\" (UniqueName: \"kubernetes.io/projected/b0531d62-b181-40c7-8305-714616d2916b-kube-api-access-kjj79\") pod \"b0531d62-b181-40c7-8305-714616d2916b\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " Jul 26 18:02:28.843892 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.843805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-serving-cert\") pod \"b0531d62-b181-40c7-8305-714616d2916b\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " Jul 26 18:02:28.843892 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.843840 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-oauth-config\") pod \"b0531d62-b181-40c7-8305-714616d2916b\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " Jul 26 18:02:28.843892 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.843871 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-trusted-ca-bundle\") pod \"b0531d62-b181-40c7-8305-714616d2916b\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " Jul 26 18:02:28.844157 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.843965 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-console-config\") pod \"b0531d62-b181-40c7-8305-714616d2916b\" (UID: \"b0531d62-b181-40c7-8305-714616d2916b\") " Jul 26 18:02:28.844212 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.844180 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0531d62-b181-40c7-8305-714616d2916b" (UID: "b0531d62-b181-40c7-8305-714616d2916b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:02:28.844307 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.844205 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0531d62-b181-40c7-8305-714616d2916b" (UID: "b0531d62-b181-40c7-8305-714616d2916b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:02:28.844404 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.844384 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b0531d62-b181-40c7-8305-714616d2916b" (UID: "b0531d62-b181-40c7-8305-714616d2916b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:02:28.844508 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.844481 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-console-config" (OuterVolumeSpecName: "console-config") pod "b0531d62-b181-40c7-8305-714616d2916b" (UID: "b0531d62-b181-40c7-8305-714616d2916b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:02:28.845988 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.845966 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0531d62-b181-40c7-8305-714616d2916b" (UID: "b0531d62-b181-40c7-8305-714616d2916b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:02:28.846063 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.846038 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0531d62-b181-40c7-8305-714616d2916b-kube-api-access-kjj79" (OuterVolumeSpecName: "kube-api-access-kjj79") pod "b0531d62-b181-40c7-8305-714616d2916b" (UID: "b0531d62-b181-40c7-8305-714616d2916b"). InnerVolumeSpecName "kube-api-access-kjj79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:02:28.846063 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.846035 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0531d62-b181-40c7-8305-714616d2916b" (UID: "b0531d62-b181-40c7-8305-714616d2916b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:02:28.945215 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.945191 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-console-config\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:02:28.945337 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.945218 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-service-ca\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:02:28.945337 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.945232 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-oauth-serving-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:02:28.945337 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.945245 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjj79\" (UniqueName: \"kubernetes.io/projected/b0531d62-b181-40c7-8305-714616d2916b-kube-api-access-kjj79\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:02:28.945337 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.945259 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-serving-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:02:28.945337 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.945272 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0531d62-b181-40c7-8305-714616d2916b-console-oauth-config\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:02:28.945337 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:28.945285 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0531d62-b181-40c7-8305-714616d2916b-trusted-ca-bundle\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:02:29.528766 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.528730 2565 generic.go:356] "Generic (PLEG): container finished" podID="b0531d62-b181-40c7-8305-714616d2916b" containerID="eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea" exitCode=0 Jul 26 18:02:29.529219 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.528775 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9fd4bb4f-88w4t" event={"ID":"b0531d62-b181-40c7-8305-714616d2916b","Type":"ContainerDied","Data":"eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea"} Jul 26 18:02:29.529219 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.528780 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9fd4bb4f-88w4t" Jul 26 18:02:29.529219 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.528812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9fd4bb4f-88w4t" event={"ID":"b0531d62-b181-40c7-8305-714616d2916b","Type":"ContainerDied","Data":"8aba32c6a983215a7577e724c5f403550fe65b1714d95dedb754013c39a8ae86"} Jul 26 18:02:29.529219 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.528836 2565 scope.go:117] "RemoveContainer" containerID="eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea" Jul 26 18:02:29.537289 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.537272 2565 scope.go:117] "RemoveContainer" containerID="eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea" Jul 26 18:02:29.537520 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:02:29.537503 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea\": container with ID starting with eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea not found: ID does not exist" containerID="eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea" Jul 26 18:02:29.537569 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.537526 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea"} err="failed to get container status \"eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea\": rpc error: code = NotFound desc = could not find container \"eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea\": container with ID starting with eec595ab3a82f914994278ad69ebcc1e289169c8e11d725861b1295e2466ebea not found: ID does not exist" Jul 26 18:02:29.549445 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.549415 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c9fd4bb4f-88w4t"] Jul 26 18:02:29.556200 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.556168 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c9fd4bb4f-88w4t"] Jul 26 18:02:29.849733 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:29.849703 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0531d62-b181-40c7-8305-714616d2916b" path="/var/lib/kubelet/pods/b0531d62-b181-40c7-8305-714616d2916b/volumes" Jul 26 18:02:44.978983 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:44.978952 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:46.445882 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.445845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:46.933759 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.933720 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq"] Jul 26 18:02:46.934152 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.934133 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0531d62-b181-40c7-8305-714616d2916b" containerName="console" Jul 26 18:02:46.934235 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.934155 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0531d62-b181-40c7-8305-714616d2916b" containerName="console" Jul 26 18:02:46.934290 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.934276 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0531d62-b181-40c7-8305-714616d2916b" containerName="console" Jul 26 18:02:46.938693 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.938672 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" Jul 26 18:02:46.941805 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.941787 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 26 18:02:46.941913 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.941895 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 26 18:02:46.941979 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.941938 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xpgwk\"" Jul 26 18:02:46.955182 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:46.955161 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq"] Jul 26 18:02:47.091874 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.091834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stjtc\" (UniqueName: \"kubernetes.io/projected/a1b6b05e-c210-4942-b2a9-02c1dafc71cf-kube-api-access-stjtc\") pod \"cert-manager-operator-controller-manager-55c444bf86-g4nsq\" (UID: \"a1b6b05e-c210-4942-b2a9-02c1dafc71cf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" Jul 26 18:02:47.092059 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.091933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b6b05e-c210-4942-b2a9-02c1dafc71cf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g4nsq\" (UID: \"a1b6b05e-c210-4942-b2a9-02c1dafc71cf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" Jul 26 18:02:47.193500 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.193415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b6b05e-c210-4942-b2a9-02c1dafc71cf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g4nsq\" (UID: \"a1b6b05e-c210-4942-b2a9-02c1dafc71cf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" Jul 26 18:02:47.193500 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.193472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stjtc\" (UniqueName: \"kubernetes.io/projected/a1b6b05e-c210-4942-b2a9-02c1dafc71cf-kube-api-access-stjtc\") pod \"cert-manager-operator-controller-manager-55c444bf86-g4nsq\" (UID: \"a1b6b05e-c210-4942-b2a9-02c1dafc71cf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" Jul 26 18:02:47.193841 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.193820 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b6b05e-c210-4942-b2a9-02c1dafc71cf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g4nsq\" (UID: \"a1b6b05e-c210-4942-b2a9-02c1dafc71cf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" Jul 26 18:02:47.204931 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.204907 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stjtc\" (UniqueName: \"kubernetes.io/projected/a1b6b05e-c210-4942-b2a9-02c1dafc71cf-kube-api-access-stjtc\") pod \"cert-manager-operator-controller-manager-55c444bf86-g4nsq\" (UID: \"a1b6b05e-c210-4942-b2a9-02c1dafc71cf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" Jul 26 18:02:47.247922 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.247890 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" Jul 26 18:02:47.387507 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.387475 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq"] Jul 26 18:02:47.391256 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:02:47.391225 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b6b05e_c210_4942_b2a9_02c1dafc71cf.slice/crio-9092dd8d8b2c5be0ff411fae42b563bae3db4f541575910777117aa85206221f WatchSource:0}: Error finding container 9092dd8d8b2c5be0ff411fae42b563bae3db4f541575910777117aa85206221f: Status 404 returned error can't find the container with id 9092dd8d8b2c5be0ff411fae42b563bae3db4f541575910777117aa85206221f Jul 26 18:02:47.393938 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.393923 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 26 18:02:47.617011 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:47.616979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" event={"ID":"a1b6b05e-c210-4942-b2a9-02c1dafc71cf","Type":"ContainerStarted","Data":"9092dd8d8b2c5be0ff411fae42b563bae3db4f541575910777117aa85206221f"} Jul 26 18:02:48.608962 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:48.608925 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:48.692825 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:48.692786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:50.633836 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:50.633793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" event={"ID":"a1b6b05e-c210-4942-b2a9-02c1dafc71cf","Type":"ContainerStarted","Data":"802eb6e79c77db90bdd9d6f6d210bbc64bfe179c87ecf28d65fc74156189bbf2"} Jul 26 18:02:50.657259 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:50.657187 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g4nsq" podStartSLOduration=2.284080351 podStartE2EDuration="4.657166923s" totalImagesPullingTime="2.373086572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:02:50.655033756 +0000 UTC m=+349.358760914" watchObservedRunningTime="2026-07-26 18:02:50.657166923 +0000 UTC m=+349.360894081" Jul 26 18:02:50.705574 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:50.705542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:50.807745 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:50.807709 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:51.102800 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:51.102763 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:51.218103 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:51.218069 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:52.706056 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:52.706021 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:53.092515 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.092484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:53.358164 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.358083 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt"] Jul 26 18:02:53.361520 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.361504 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" Jul 26 18:02:53.363858 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.363835 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 26 18:02:53.364465 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.364445 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 26 18:02:53.364552 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.364447 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-26h2n\"" Jul 26 18:02:53.368438 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.368206 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt"] Jul 26 18:02:53.555773 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.555734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f327c96-80a1-494c-ae31-3ecc44fdedf3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hzpzt\" (UID: \"1f327c96-80a1-494c-ae31-3ecc44fdedf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" Jul 26 18:02:53.555956 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.555788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t598f\" (UniqueName: \"kubernetes.io/projected/1f327c96-80a1-494c-ae31-3ecc44fdedf3-kube-api-access-t598f\") pod \"cert-manager-cainjector-559cdd8c87-hzpzt\" (UID: \"1f327c96-80a1-494c-ae31-3ecc44fdedf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" Jul 26 18:02:53.656598 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.656511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t598f\" (UniqueName: \"kubernetes.io/projected/1f327c96-80a1-494c-ae31-3ecc44fdedf3-kube-api-access-t598f\") pod \"cert-manager-cainjector-559cdd8c87-hzpzt\" (UID: \"1f327c96-80a1-494c-ae31-3ecc44fdedf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" Jul 26 18:02:53.656747 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.656602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f327c96-80a1-494c-ae31-3ecc44fdedf3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hzpzt\" (UID: \"1f327c96-80a1-494c-ae31-3ecc44fdedf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" Jul 26 18:02:53.664735 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.664707 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f327c96-80a1-494c-ae31-3ecc44fdedf3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hzpzt\" (UID: \"1f327c96-80a1-494c-ae31-3ecc44fdedf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" Jul 26 18:02:53.664875 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.664855 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t598f\" (UniqueName: \"kubernetes.io/projected/1f327c96-80a1-494c-ae31-3ecc44fdedf3-kube-api-access-t598f\") pod \"cert-manager-cainjector-559cdd8c87-hzpzt\" (UID: \"1f327c96-80a1-494c-ae31-3ecc44fdedf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" Jul 26 18:02:53.678618 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.678596 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" Jul 26 18:02:53.804869 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:53.804838 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt"] Jul 26 18:02:53.807695 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:02:53.807667 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f327c96_80a1_494c_ae31_3ecc44fdedf3.slice/crio-92dff8d5ad4338cbeb06d7c1c83993fd116418acb31c44a981f5207743af1c21 WatchSource:0}: Error finding container 92dff8d5ad4338cbeb06d7c1c83993fd116418acb31c44a981f5207743af1c21: Status 404 returned error can't find the container with id 92dff8d5ad4338cbeb06d7c1c83993fd116418acb31c44a981f5207743af1c21 Jul 26 18:02:54.653568 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:54.653481 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" event={"ID":"1f327c96-80a1-494c-ae31-3ecc44fdedf3","Type":"ContainerStarted","Data":"92dff8d5ad4338cbeb06d7c1c83993fd116418acb31c44a981f5207743af1c21"} Jul 26 18:02:55.583042 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:55.583004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:55.646183 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:55.646142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:56.671498 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:56.671461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" event={"ID":"1f327c96-80a1-494c-ae31-3ecc44fdedf3","Type":"ContainerStarted","Data":"7e444a017bf5183b41ad2f839e40348644ebcf85db56e942d1b782ecdc39c75e"} Jul 26 18:02:56.709747 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:56.709684 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzpzt" podStartSLOduration=1.264802736 podStartE2EDuration="3.709666945s" totalImagesPullingTime="2.444864209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:02:56.708475911 +0000 UTC m=+355.412203070" watchObservedRunningTime="2026-07-26 18:02:56.709666945 +0000 UTC m=+355.413394102" Jul 26 18:02:57.081784 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:57.081744 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:02:57.185077 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:02:57.185011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:01.507580 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:01.507539 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:07.187748 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:07.187707 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:07.288871 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:07.288833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:13.640524 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:13.640483 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:13.740462 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:13.740424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:15.807217 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:15.807183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:27.379832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:27.379770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:27.486308 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:27.486268 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:27.995695 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:27.995662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:28.199277 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.199226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:28.295244 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.295130 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:28.327735 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.327700 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng"] Jul 26 18:03:28.331100 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.331082 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.334207 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.334184 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 26 18:03:28.334366 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.334220 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 26 18:03:28.334366 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.334232 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 26 18:03:28.334366 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.334263 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 26 18:03:28.334366 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.334359 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sx8j6\"" Jul 26 18:03:28.347634 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.347601 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng"] Jul 26 18:03:28.435390 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.435356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72301901-b909-43fb-94de-4b78522c1699-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.435785 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.435403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72301901-b909-43fb-94de-4b78522c1699-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.435785 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.435424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjgtr\" (UniqueName: \"kubernetes.io/projected/72301901-b909-43fb-94de-4b78522c1699-kube-api-access-tjgtr\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.435785 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.435448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72301901-b909-43fb-94de-4b78522c1699-tmp\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.435785 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.435520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72301901-b909-43fb-94de-4b78522c1699-manifests\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.480395 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.480357 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:28.535985 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.535944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72301901-b909-43fb-94de-4b78522c1699-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.535985 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.535990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72301901-b909-43fb-94de-4b78522c1699-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.536253 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.536007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjgtr\" (UniqueName: \"kubernetes.io/projected/72301901-b909-43fb-94de-4b78522c1699-kube-api-access-tjgtr\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.536253 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.536028 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72301901-b909-43fb-94de-4b78522c1699-tmp\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.536253 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.536060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72301901-b909-43fb-94de-4b78522c1699-manifests\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.536489 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.536470 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72301901-b909-43fb-94de-4b78522c1699-manifests\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.538446 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.538417 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72301901-b909-43fb-94de-4b78522c1699-tmp\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.538571 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.538561 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72301901-b909-43fb-94de-4b78522c1699-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.538713 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.538693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72301901-b909-43fb-94de-4b78522c1699-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.544277 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.544251 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjgtr\" (UniqueName: \"kubernetes.io/projected/72301901-b909-43fb-94de-4b78522c1699-kube-api-access-tjgtr\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-5gzng\" (UID: \"72301901-b909-43fb-94de-4b78522c1699\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.578763 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.578731 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:28.642113 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.642075 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:28.680626 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.680585 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:28.784337 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.784285 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng"] Jul 26 18:03:28.787980 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:03:28.787949 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72301901_b909_43fb_94de_4b78522c1699.slice/crio-a3818b64a60e18437d7573be87c1299ac39f8f5e0c4c0fb5c0dc303348d12e9b WatchSource:0}: Error finding container a3818b64a60e18437d7573be87c1299ac39f8f5e0c4c0fb5c0dc303348d12e9b: Status 404 returned error can't find the container with id a3818b64a60e18437d7573be87c1299ac39f8f5e0c4c0fb5c0dc303348d12e9b Jul 26 18:03:28.790757 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.790725 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:28.821375 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.821337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" event={"ID":"72301901-b909-43fb-94de-4b78522c1699","Type":"ContainerStarted","Data":"a3818b64a60e18437d7573be87c1299ac39f8f5e0c4c0fb5c0dc303348d12e9b"} Jul 26 18:03:28.881099 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.881014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:28.981461 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:28.981419 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:29.084471 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:29.084438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:32.844298 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:32.844257 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" event={"ID":"72301901-b909-43fb-94de-4b78522c1699","Type":"ContainerStarted","Data":"2c19746a9b18e2fdc99b8da2fc7209e30e0a16f22946efcb60a59b4ac9ef1906"} Jul 26 18:03:33.850379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:33.850345 2565 generic.go:356] "Generic (PLEG): container finished" podID="72301901-b909-43fb-94de-4b78522c1699" containerID="2c19746a9b18e2fdc99b8da2fc7209e30e0a16f22946efcb60a59b4ac9ef1906" exitCode=0 Jul 26 18:03:33.850865 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:33.850432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" event={"ID":"72301901-b909-43fb-94de-4b78522c1699","Type":"ContainerDied","Data":"2c19746a9b18e2fdc99b8da2fc7209e30e0a16f22946efcb60a59b4ac9ef1906"} Jul 26 18:03:34.856550 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:34.856514 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" event={"ID":"72301901-b909-43fb-94de-4b78522c1699","Type":"ContainerStarted","Data":"4f87a1dda6bb4fe21e916cace0019d848e88b376e3c7630daf0b815dda0854c4"} Jul 26 18:03:34.856928 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:34.856652 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:34.879858 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:34.879803 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" podStartSLOduration=2.326247875 podStartE2EDuration="6.879788598s" totalImagesPullingTime="3.528287949s" totalInitContainerRuntime="1.025252774s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:03:34.878822277 +0000 UTC m=+393.582549435" watchObservedRunningTime="2026-07-26 18:03:34.879788598 +0000 UTC m=+393.583515756" Jul 26 18:03:40.878173 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:40.878130 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:40.973746 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:40.973705 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:44.036811 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:44.036768 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:44.096784 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:44.096749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:44.461129 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:44.461093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:44.561970 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:44.561936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:45.684294 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:45.684258 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:45.862773 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:45.862742 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-5gzng" Jul 26 18:03:47.533867 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:47.533821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:47.698741 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:47.698705 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:48.215571 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.215534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:48.292872 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.292832 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-679f49c568-j7cq2"] Jul 26 18:03:48.301714 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.301683 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.305518 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.305483 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 26 18:03:48.308584 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.308564 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 26 18:03:48.327099 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.327068 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-679f49c568-j7cq2"] Jul 26 18:03:48.421573 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.421533 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tmp\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.421762 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.421612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tls-certs\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.421762 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.421647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nhzx\" (UniqueName: \"kubernetes.io/projected/2d16840f-e5b6-423c-9c76-a927dd6dbd02-kube-api-access-4nhzx\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.442062 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.442025 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-d5x5v"] Jul 26 18:03:48.445594 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.445578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:48.448334 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.448295 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 26 18:03:48.448440 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.448359 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cpks2\"" Jul 26 18:03:48.460044 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.460021 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-d5x5v"] Jul 26 18:03:48.522415 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.522303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tmp\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.522415 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.522409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tls-certs\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.522644 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.522446 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nhzx\" (UniqueName: \"kubernetes.io/projected/2d16840f-e5b6-423c-9c76-a927dd6dbd02-kube-api-access-4nhzx\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.522644 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:03:48.522541 2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 26 18:03:48.522644 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:03:48.522599 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tls-certs podName:2d16840f-e5b6-423c-9c76-a927dd6dbd02 nodeName:}" failed. No retries permitted until 2026-07-26 18:03:49.022584427 +0000 UTC m=+407.726311564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tls-certs") pod "kube-auth-proxy-679f49c568-j7cq2" (UID: "2d16840f-e5b6-423c-9c76-a927dd6dbd02") : secret "kube-auth-proxy-tls" not found Jul 26 18:03:48.524668 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.524644 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tmp\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.538346 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.538302 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nhzx\" (UniqueName: \"kubernetes.io/projected/2d16840f-e5b6-423c-9c76-a927dd6dbd02-kube-api-access-4nhzx\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:48.551352 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.551300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:48.622992 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.622958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkngf\" (UniqueName: \"kubernetes.io/projected/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-kube-api-access-jkngf\") pod \"odh-model-controller-7998c67dc4-d5x5v\" (UID: \"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18\") " pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:48.622992 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.623002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-cert\") pod \"odh-model-controller-7998c67dc4-d5x5v\" (UID: \"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18\") " pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:48.651604 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.651525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:48.723897 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.723849 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkngf\" (UniqueName: \"kubernetes.io/projected/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-kube-api-access-jkngf\") pod \"odh-model-controller-7998c67dc4-d5x5v\" (UID: \"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18\") " pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:48.724070 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.723912 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-cert\") pod \"odh-model-controller-7998c67dc4-d5x5v\" (UID: \"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18\") " pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:48.724116 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:03:48.724067 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 26 18:03:48.724157 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:03:48.724144 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-cert podName:ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18 nodeName:}" failed. No retries permitted until 2026-07-26 18:03:49.224126981 +0000 UTC m=+407.927854119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-cert") pod "odh-model-controller-7998c67dc4-d5x5v" (UID: "ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18") : secret "odh-model-controller-webhook-cert" not found Jul 26 18:03:48.740886 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.740856 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkngf\" (UniqueName: \"kubernetes.io/projected/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-kube-api-access-jkngf\") pod \"odh-model-controller-7998c67dc4-d5x5v\" (UID: \"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18\") " pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:48.753031 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.753007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:48.865303 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:48.865269 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:49.026083 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.026049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tls-certs\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:49.028457 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.028434 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d16840f-e5b6-423c-9c76-a927dd6dbd02-tls-certs\") pod \"kube-auth-proxy-679f49c568-j7cq2\" (UID: \"2d16840f-e5b6-423c-9c76-a927dd6dbd02\") " pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:49.211096 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.211002 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" Jul 26 18:03:49.229190 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.228911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-cert\") pod \"odh-model-controller-7998c67dc4-d5x5v\" (UID: \"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18\") " pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:49.231837 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.231808 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18-cert\") pod \"odh-model-controller-7998c67dc4-d5x5v\" (UID: \"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18\") " pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:49.278057 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.277990 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:49.355889 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.355847 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:49.358638 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.358611 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-679f49c568-j7cq2"] Jul 26 18:03:49.361640 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:03:49.361614 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d16840f_e5b6_423c_9c76_a927dd6dbd02.slice/crio-8bc3f5a34c0a38a7eaa22cdf9337b546f3ad82eaabab29201a6ad2e2772f27f0 WatchSource:0}: Error finding container 8bc3f5a34c0a38a7eaa22cdf9337b546f3ad82eaabab29201a6ad2e2772f27f0: Status 404 returned error can't find the container with id 8bc3f5a34c0a38a7eaa22cdf9337b546f3ad82eaabab29201a6ad2e2772f27f0 Jul 26 18:03:49.389903 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.389855 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sxvxg"] Jul 26 18:03:49.395703 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.395674 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:49.396450 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.396423 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sxvxg"] Jul 26 18:03:49.398122 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.398099 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 26 18:03:49.398251 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.398104 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hs6sz\"" Jul 26 18:03:49.511425 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.511397 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-d5x5v"] Jul 26 18:03:49.513487 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:03:49.513459 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad836a39_a7e5_4bb4_b1c6_88e0a54b2a18.slice/crio-fffabfcedfee0782f29f9988848272753fa4ecef7887416c9d9404075266ebb3 WatchSource:0}: Error finding container fffabfcedfee0782f29f9988848272753fa4ecef7887416c9d9404075266ebb3: Status 404 returned error can't find the container with id fffabfcedfee0782f29f9988848272753fa4ecef7887416c9d9404075266ebb3 Jul 26 18:03:49.531450 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.531419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r849x\" (UniqueName: \"kubernetes.io/projected/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-kube-api-access-r849x\") pod \"model-serving-api-54d89bd5fc-sxvxg\" (UID: \"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:49.531606 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.531475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-tls-certs\") pod \"model-serving-api-54d89bd5fc-sxvxg\" (UID: \"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:49.602590 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.602551 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl"] Jul 26 18:03:49.605447 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.605420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:49.606334 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.606301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.610718 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.610700 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 26 18:03:49.610829 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.610701 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 26 18:03:49.610947 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.610934 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 26 18:03:49.611510 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.611493 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cxvvc\"" Jul 26 18:03:49.611710 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.611695 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 26 18:03:49.627334 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.627295 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl"] Jul 26 18:03:49.632637 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.632609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r849x\" (UniqueName: \"kubernetes.io/projected/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-kube-api-access-r849x\") pod \"model-serving-api-54d89bd5fc-sxvxg\" (UID: \"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:49.632749 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.632667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-tls-certs\") pod \"model-serving-api-54d89bd5fc-sxvxg\" (UID: \"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:49.632808 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:03:49.632795 2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 26 18:03:49.632890 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:03:49.632849 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-tls-certs podName:f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe nodeName:}" failed. No retries permitted until 2026-07-26 18:03:50.132833872 +0000 UTC m=+408.836561008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-tls-certs") pod "model-serving-api-54d89bd5fc-sxvxg" (UID: "f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe") : secret "model-serving-api-tls" not found Jul 26 18:03:49.647755 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.647723 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r849x\" (UniqueName: \"kubernetes.io/projected/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-kube-api-access-r849x\") pod \"model-serving-api-54d89bd5fc-sxvxg\" (UID: \"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:49.694145 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.694106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:49.734139 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.734096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.734327 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.734153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz779\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-kube-api-access-jz779\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.734327 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.734180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.734327 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.734197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.734516 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.734383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.734516 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.734433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e16e4-df15-4111-8147-55fd4d50250a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.734516 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.734458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.811102 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.811031 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:49.835039 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.834999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.835190 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.835064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e16e4-df15-4111-8147-55fd4d50250a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.835190 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.835090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.835521 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.835495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.835631 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.835549 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz779\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-kube-api-access-jz779\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.835631 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.835588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.835631 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.835616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.836390 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.836365 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.838367 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.838020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e16e4-df15-4111-8147-55fd4d50250a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.838367 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.838208 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.838367 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.838298 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.838541 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.838442 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.854578 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.854546 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz779\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-kube-api-access-jz779\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.856997 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.856974 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-dhscl\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.915950 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.915905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:49.932049 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.932008 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" event={"ID":"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18","Type":"ContainerStarted","Data":"fffabfcedfee0782f29f9988848272753fa4ecef7887416c9d9404075266ebb3"} Jul 26 18:03:49.933504 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:49.933476 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" event={"ID":"2d16840f-e5b6-423c-9c76-a927dd6dbd02","Type":"ContainerStarted","Data":"8bc3f5a34c0a38a7eaa22cdf9337b546f3ad82eaabab29201a6ad2e2772f27f0"} Jul 26 18:03:50.086481 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:50.086452 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl"] Jul 26 18:03:50.088947 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:03:50.088912 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14e16e4_df15_4111_8147_55fd4d50250a.slice/crio-97429c6c7d495d8f330b0d46a8540c6a74ba012a3684f24a9ff7ad42ca86a4b4 WatchSource:0}: Error finding container 97429c6c7d495d8f330b0d46a8540c6a74ba012a3684f24a9ff7ad42ca86a4b4: Status 404 returned error can't find the container with id 97429c6c7d495d8f330b0d46a8540c6a74ba012a3684f24a9ff7ad42ca86a4b4 Jul 26 18:03:50.139207 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:50.139170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-tls-certs\") pod \"model-serving-api-54d89bd5fc-sxvxg\" (UID: \"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:50.142241 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:50.142214 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe-tls-certs\") pod \"model-serving-api-54d89bd5fc-sxvxg\" (UID: \"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:50.309889 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:50.309834 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:50.477640 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:50.477603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sxvxg"] Jul 26 18:03:50.480261 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:03:50.480228 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cf2d67_d9b4_4d47_a5bc_26234df7b1fe.slice/crio-9265884118ba5817e48f3ad9f7068ab88fb2128c86fdef6359f9df0074d32bf5 WatchSource:0}: Error finding container 9265884118ba5817e48f3ad9f7068ab88fb2128c86fdef6359f9df0074d32bf5: Status 404 returned error can't find the container with id 9265884118ba5817e48f3ad9f7068ab88fb2128c86fdef6359f9df0074d32bf5 Jul 26 18:03:50.788681 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:50.788583 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:50.944415 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:50.944369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" event={"ID":"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe","Type":"ContainerStarted","Data":"9265884118ba5817e48f3ad9f7068ab88fb2128c86fdef6359f9df0074d32bf5"} Jul 26 18:03:50.946035 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:50.945996 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" event={"ID":"b14e16e4-df15-4111-8147-55fd4d50250a","Type":"ContainerStarted","Data":"97429c6c7d495d8f330b0d46a8540c6a74ba012a3684f24a9ff7ad42ca86a4b4"} Jul 26 18:03:53.965088 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:53.965026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" event={"ID":"ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18","Type":"ContainerStarted","Data":"42bec446c41f228c1bdd61b673459def2efc835054dd0eff6acb3d73c05d771d"} Jul 26 18:03:53.965684 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:53.965112 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:03:53.966677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:53.966655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" event={"ID":"2d16840f-e5b6-423c-9c76-a927dd6dbd02","Type":"ContainerStarted","Data":"4a0edb8804d2963e474a901277439d7f64777251fa344ac51e90f3084794a061"} Jul 26 18:03:53.981359 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:53.981289 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" podStartSLOduration=2.507531261 podStartE2EDuration="5.981273478s" totalImagesPullingTime="3.473742217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:03:53.979847338 +0000 UTC m=+412.683574497" watchObservedRunningTime="2026-07-26 18:03:53.981273478 +0000 UTC m=+412.685000694" Jul 26 18:03:53.997131 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:53.997074 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-679f49c568-j7cq2" podStartSLOduration=2.430855876 podStartE2EDuration="5.9970537s" totalImagesPullingTime="3.566197824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:03:53.995065394 +0000 UTC m=+412.698792553" watchObservedRunningTime="2026-07-26 18:03:53.9970537 +0000 UTC m=+412.700780859" Jul 26 18:03:54.616541 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:54.616504 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 26 18:03:54.616639 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:54.616571 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 26 18:03:54.974101 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:54.974056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" event={"ID":"f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe","Type":"ContainerStarted","Data":"b68eaa08e80147ed20163f2e15f23284c30dbad28bae610504ff55137fa39e7d"} Jul 26 18:03:54.975009 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:54.974188 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:03:54.976384 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:54.976355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" event={"ID":"b14e16e4-df15-4111-8147-55fd4d50250a","Type":"ContainerStarted","Data":"35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f"} Jul 26 18:03:54.976722 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:54.976645 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:54.993011 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:54.992963 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" podStartSLOduration=1.929040148 podStartE2EDuration="5.992948081s" totalImagesPullingTime="4.063907933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:03:54.9911658 +0000 UTC m=+413.694892959" watchObservedRunningTime="2026-07-26 18:03:54.992948081 +0000 UTC m=+413.696675239" Jul 26 18:03:55.016534 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:55.016473 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" podStartSLOduration=1.4914600789999999 podStartE2EDuration="6.016456545s" totalImagesPullingTime="4.524996466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:03:55.01373716 +0000 UTC m=+413.717464319" watchObservedRunningTime="2026-07-26 18:03:55.016456545 +0000 UTC m=+413.720183703" Jul 26 18:03:55.651827 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:55.651786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:55.756344 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:55.756300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:55.852260 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:55.852223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:55.983661 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:55.983582 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-dhscl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 26 18:03:55.983661 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:55.983636 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" podUID="b14e16e4-df15-4111-8147-55fd4d50250a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 26 18:03:56.344873 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:56.344837 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:56.567220 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:56.567183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:56.659632 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:56.659531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:57.007583 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.007495 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g"] Jul 26 18:03:57.011081 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.011061 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.014945 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.014913 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 26 18:03:57.014945 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.014925 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 26 18:03:57.014945 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.014939 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 26 18:03:57.015229 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.014925 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6nlhm\"" Jul 26 18:03:57.015229 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.014964 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 26 18:03:57.015229 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.014926 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 26 18:03:57.027009 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.026980 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g"] Jul 26 18:03:57.103042 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.102995 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-cert\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.103220 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.103073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-manager-config\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.103220 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.103118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-metrics-cert\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.103220 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.103181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfwd2\" (UniqueName: \"kubernetes.io/projected/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-kube-api-access-cfwd2\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.204373 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.204307 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-cert\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.204585 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.204391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-manager-config\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.204585 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.204422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-metrics-cert\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.204585 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.204446 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfwd2\" (UniqueName: \"kubernetes.io/projected/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-kube-api-access-cfwd2\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.205063 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.205038 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-manager-config\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.206884 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.206860 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-metrics-cert\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.206988 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.206905 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-cert\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.221430 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.221396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfwd2\" (UniqueName: \"kubernetes.io/projected/5082057d-4b1b-49d8-8ae7-1c3a47f50ae2-kube-api-access-cfwd2\") pod \"lws-controller-manager-7b54d88cb5-ctm4g\" (UID: \"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.321366 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.321307 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:03:57.467117 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.467082 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g"] Jul 26 18:03:57.470715 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:03:57.470684 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5082057d_4b1b_49d8_8ae7_1c3a47f50ae2.slice/crio-73ed7baa9ddcc45eebbb6f8c9a533022e74c45e29fafe4c4a1edf247426f7c3b WatchSource:0}: Error finding container 73ed7baa9ddcc45eebbb6f8c9a533022e74c45e29fafe4c4a1edf247426f7c3b: Status 404 returned error can't find the container with id 73ed7baa9ddcc45eebbb6f8c9a533022e74c45e29fafe4c4a1edf247426f7c3b Jul 26 18:03:57.995008 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:57.994968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" event={"ID":"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2","Type":"ContainerStarted","Data":"73ed7baa9ddcc45eebbb6f8c9a533022e74c45e29fafe4c4a1edf247426f7c3b"} Jul 26 18:03:58.505456 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:58.505423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:58.624006 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:58.623904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:58.872700 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:58.872670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:58.978257 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:58.978218 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:58.982647 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:58.982624 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:03:59.080909 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:59.080872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:03:59.587150 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:03:59.587118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:04:00.957872 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:00.957836 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl"] Jul 26 18:04:00.958340 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:00.958003 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" podUID="b14e16e4-df15-4111-8147-55fd4d50250a" containerName="discovery" containerID="cri-o://35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f" gracePeriod=30 Jul 26 18:04:01.018029 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.017991 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" event={"ID":"5082057d-4b1b-49d8-8ae7-1c3a47f50ae2","Type":"ContainerStarted","Data":"4951b7f641b4720bdda754bde99d7f6822b0ce49ba88653d356915b793bd8080"} Jul 26 18:04:01.018205 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.018142 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:04:01.043014 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.042961 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" podStartSLOduration=2.4711935289999998 podStartE2EDuration="5.042946152s" totalImagesPullingTime="2.571752623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:04:01.040592297 +0000 UTC m=+419.744319456" watchObservedRunningTime="2026-07-26 18:04:01.042946152 +0000 UTC m=+419.746673312" Jul 26 18:04:01.212970 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.212905 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:04:01.242751 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.242713 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz779\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-kube-api-access-jz779\") pod \"b14e16e4-df15-4111-8147-55fd4d50250a\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " Jul 26 18:04:01.242751 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.242754 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-cacerts\") pod \"b14e16e4-df15-4111-8147-55fd4d50250a\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " Jul 26 18:04:01.242934 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.242825 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-ca-configmap\") pod \"b14e16e4-df15-4111-8147-55fd4d50250a\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " Jul 26 18:04:01.242934 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.242846 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-dns-cert\") pod \"b14e16e4-df15-4111-8147-55fd4d50250a\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " Jul 26 18:04:01.242934 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.242908 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-kubeconfig\") pod \"b14e16e4-df15-4111-8147-55fd4d50250a\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " Jul 26 18:04:01.242934 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.242931 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e16e4-df15-4111-8147-55fd4d50250a-local-certs\") pod \"b14e16e4-df15-4111-8147-55fd4d50250a\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " Jul 26 18:04:01.243131 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.242960 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-istio-token\") pod \"b14e16e4-df15-4111-8147-55fd4d50250a\" (UID: \"b14e16e4-df15-4111-8147-55fd4d50250a\") " Jul 26 18:04:01.243305 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.243264 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b14e16e4-df15-4111-8147-55fd4d50250a" (UID: "b14e16e4-df15-4111-8147-55fd4d50250a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:04:01.245272 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.245242 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b14e16e4-df15-4111-8147-55fd4d50250a" (UID: "b14e16e4-df15-4111-8147-55fd4d50250a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:04:01.245555 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.245333 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b14e16e4-df15-4111-8147-55fd4d50250a" (UID: "b14e16e4-df15-4111-8147-55fd4d50250a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:04:01.245555 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.245456 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14e16e4-df15-4111-8147-55fd4d50250a-local-certs" (OuterVolumeSpecName: "local-certs") pod "b14e16e4-df15-4111-8147-55fd4d50250a" (UID: "b14e16e4-df15-4111-8147-55fd4d50250a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:04:01.245555 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.245509 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-cacerts" (OuterVolumeSpecName: "cacerts") pod "b14e16e4-df15-4111-8147-55fd4d50250a" (UID: "b14e16e4-df15-4111-8147-55fd4d50250a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:04:01.245555 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.245547 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-kube-api-access-jz779" (OuterVolumeSpecName: "kube-api-access-jz779") pod "b14e16e4-df15-4111-8147-55fd4d50250a" (UID: "b14e16e4-df15-4111-8147-55fd4d50250a"). InnerVolumeSpecName "kube-api-access-jz779". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:04:01.245711 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.245545 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b14e16e4-df15-4111-8147-55fd4d50250a" (UID: "b14e16e4-df15-4111-8147-55fd4d50250a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:04:01.344654 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.344594 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-dns-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:04:01.344654 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.344651 2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-istio-kubeconfig\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:04:01.344654 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.344660 2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e16e4-df15-4111-8147-55fd4d50250a-local-certs\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:04:01.344899 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.344669 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-istio-token\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:04:01.344899 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.344677 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz779\" (UniqueName: \"kubernetes.io/projected/b14e16e4-df15-4111-8147-55fd4d50250a-kube-api-access-jz779\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:04:01.344899 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.344685 2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b14e16e4-df15-4111-8147-55fd4d50250a-cacerts\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:04:01.344899 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:01.344695 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b14e16e4-df15-4111-8147-55fd4d50250a-istio-csr-ca-configmap\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:04:02.023720 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.023685 2565 generic.go:356] "Generic (PLEG): container finished" podID="b14e16e4-df15-4111-8147-55fd4d50250a" containerID="35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f" exitCode=0 Jul 26 18:04:02.023720 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.023723 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" Jul 26 18:04:02.024217 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.023771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" event={"ID":"b14e16e4-df15-4111-8147-55fd4d50250a","Type":"ContainerDied","Data":"35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f"} Jul 26 18:04:02.024217 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.023822 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl" event={"ID":"b14e16e4-df15-4111-8147-55fd4d50250a","Type":"ContainerDied","Data":"97429c6c7d495d8f330b0d46a8540c6a74ba012a3684f24a9ff7ad42ca86a4b4"} Jul 26 18:04:02.024217 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.023848 2565 scope.go:117] "RemoveContainer" containerID="35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f" Jul 26 18:04:02.035089 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.035063 2565 scope.go:117] "RemoveContainer" containerID="35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f" Jul 26 18:04:02.035608 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:04:02.035584 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f\": container with ID starting with 35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f not found: ID does not exist" containerID="35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f" Jul 26 18:04:02.035703 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.035629 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f"} err="failed to get container status \"35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f\": rpc error: code = NotFound desc = could not find container \"35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f\": container with ID starting with 35d845b8185cb3e33ebfc4b047d22043833fb98d1032b8613621b2fec6b0cc7f not found: ID does not exist" Jul 26 18:04:02.047858 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.047828 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl"] Jul 26 18:04:02.057125 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:02.057097 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-dhscl"] Jul 26 18:04:03.092605 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:03.092561 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:04:03.851006 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:03.850974 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14e16e4-df15-4111-8147-55fd4d50250a" path="/var/lib/kubelet/pods/b14e16e4-df15-4111-8147-55fd4d50250a/volumes" Jul 26 18:04:04.978636 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:04.978605 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-d5x5v" Jul 26 18:04:05.985899 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:05.985867 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-sxvxg" Jul 26 18:04:12.026809 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:12.026778 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-ctm4g" Jul 26 18:04:22.562351 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:22.562296 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:04:22.663736 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:22.663700 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:04:24.515256 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:24.515157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:04:24.569688 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:24.569646 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:04:48.875533 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:48.875485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:04:48.979408 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:48.979368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:04:49.068967 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:04:49.068931 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:12.808814 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:12.808773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:16.041011 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:16.040978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:16.383899 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:16.383850 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:16.940405 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:16.940359 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f465cd6b-8vjmg"] Jul 26 18:05:16.940792 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:16.940776 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14e16e4-df15-4111-8147-55fd4d50250a" containerName="discovery" Jul 26 18:05:16.940792 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:16.940793 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14e16e4-df15-4111-8147-55fd4d50250a" containerName="discovery" Jul 26 18:05:16.940923 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:16.940876 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14e16e4-df15-4111-8147-55fd4d50250a" containerName="discovery" Jul 26 18:05:16.945349 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:16.945324 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:16.960536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:16.960510 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f465cd6b-8vjmg"] Jul 26 18:05:17.032472 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.032434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-service-ca\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.032689 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.032527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-trusted-ca-bundle\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.032689 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.032575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/965033dc-ee96-4d41-9744-1394bd7f2317-console-serving-cert\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.032689 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.032594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/965033dc-ee96-4d41-9744-1394bd7f2317-console-oauth-config\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.032689 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.032647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crrrw\" (UniqueName: \"kubernetes.io/projected/965033dc-ee96-4d41-9744-1394bd7f2317-kube-api-access-crrrw\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.032689 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.032678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-oauth-serving-cert\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.032884 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.032726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-console-config\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.094747 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.094708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:17.133923 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.133894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-trusted-ca-bundle\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134121 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.133950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/965033dc-ee96-4d41-9744-1394bd7f2317-console-serving-cert\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134121 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.133974 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/965033dc-ee96-4d41-9744-1394bd7f2317-console-oauth-config\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134121 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.134017 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrrw\" (UniqueName: \"kubernetes.io/projected/965033dc-ee96-4d41-9744-1394bd7f2317-kube-api-access-crrrw\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134121 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.134049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-oauth-serving-cert\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134121 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.134077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-console-config\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134426 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.134131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-service-ca\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134778 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.134750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-oauth-serving-cert\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134915 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.134891 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-trusted-ca-bundle\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134958 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.134893 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-service-ca\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.134958 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.134892 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/965033dc-ee96-4d41-9744-1394bd7f2317-console-config\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.137060 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.137033 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/965033dc-ee96-4d41-9744-1394bd7f2317-console-oauth-config\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.137150 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.137117 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/965033dc-ee96-4d41-9744-1394bd7f2317-console-serving-cert\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.155010 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.154990 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrrw\" (UniqueName: \"kubernetes.io/projected/965033dc-ee96-4d41-9744-1394bd7f2317-kube-api-access-crrrw\") pod \"console-66f465cd6b-8vjmg\" (UID: \"965033dc-ee96-4d41-9744-1394bd7f2317\") " pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.239891 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.239803 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:17.254729 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.254700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:17.433551 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:05:17.433518 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965033dc_ee96_4d41_9744_1394bd7f2317.slice/crio-b62e3ee54c892a68e04f21dcb0915e79deb896060b9133c6fe8ca32bf7fe01c6 WatchSource:0}: Error finding container b62e3ee54c892a68e04f21dcb0915e79deb896060b9133c6fe8ca32bf7fe01c6: Status 404 returned error can't find the container with id b62e3ee54c892a68e04f21dcb0915e79deb896060b9133c6fe8ca32bf7fe01c6 Jul 26 18:05:17.434450 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:17.434383 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f465cd6b-8vjmg"] Jul 26 18:05:18.396684 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:18.396642 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f465cd6b-8vjmg" event={"ID":"965033dc-ee96-4d41-9744-1394bd7f2317","Type":"ContainerStarted","Data":"0820133cb7cc2767574d1983117be8ed02373fc9a4964c753ec952e19c021bd5"} Jul 26 18:05:18.397120 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:18.396740 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f465cd6b-8vjmg" event={"ID":"965033dc-ee96-4d41-9744-1394bd7f2317","Type":"ContainerStarted","Data":"b62e3ee54c892a68e04f21dcb0915e79deb896060b9133c6fe8ca32bf7fe01c6"} Jul 26 18:05:18.445019 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:18.444956 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f465cd6b-8vjmg" podStartSLOduration=2.444939706 podStartE2EDuration="2.444939706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:05:18.4429268 +0000 UTC m=+497.146653961" watchObservedRunningTime="2026-07-26 18:05:18.444939706 +0000 UTC m=+497.148666865" Jul 26 18:05:20.877830 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:20.877786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:21.464960 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:21.464920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:24.884097 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:24.884062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:26.841735 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:26.841706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:27.255564 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:27.255466 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:27.255564 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:27.255539 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:27.260085 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:27.260063 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:27.445397 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:27.445369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66f465cd6b-8vjmg" Jul 26 18:05:27.551794 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:27.551768 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdc8769d6-6dnst"] Jul 26 18:05:27.773391 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:27.773359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:27.936047 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:27.935946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:28.072204 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:28.072164 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:30.304070 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.304031 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6"] Jul 26 18:05:30.307577 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.307558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.313550 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.313525 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 26 18:05:30.313701 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.313557 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 26 18:05:30.313849 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.313828 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 26 18:05:30.314425 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.314388 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 26 18:05:30.314425 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.314413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-szp9z\"" Jul 26 18:05:30.318610 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.318583 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:30.332759 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.332730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6"] Jul 26 18:05:30.459487 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.459453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.459697 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.459601 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.459697 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.459640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985hq\" (UniqueName: \"kubernetes.io/projected/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-kube-api-access-985hq\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.522462 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.522430 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:30.561083 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.560991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.561234 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.561099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.561234 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.561122 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-985hq\" (UniqueName: \"kubernetes.io/projected/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-kube-api-access-985hq\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.561766 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.561746 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.563588 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.563568 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.569824 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.569801 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-985hq\" (UniqueName: \"kubernetes.io/projected/99a3f27a-436e-46e3-ae45-b0fd8b01a34a-kube-api-access-985hq\") pod \"kuadrant-console-plugin-66b5774985-mbgh6\" (UID: \"99a3f27a-436e-46e3-ae45-b0fd8b01a34a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.617694 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.617655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" Jul 26 18:05:30.760456 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:30.760429 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6"] Jul 26 18:05:30.762463 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:05:30.762426 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99a3f27a_436e_46e3_ae45_b0fd8b01a34a.slice/crio-edc0a938d3ede910264c878730312ab7e150cf9a3d1b71518b69e2e885871213 WatchSource:0}: Error finding container edc0a938d3ede910264c878730312ab7e150cf9a3d1b71518b69e2e885871213: Status 404 returned error can't find the container with id edc0a938d3ede910264c878730312ab7e150cf9a3d1b71518b69e2e885871213 Jul 26 18:05:31.461630 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:31.461584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" event={"ID":"99a3f27a-436e-46e3-ae45-b0fd8b01a34a","Type":"ContainerStarted","Data":"edc0a938d3ede910264c878730312ab7e150cf9a3d1b71518b69e2e885871213"} Jul 26 18:05:31.658953 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:31.658888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:31.781626 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:31.781536 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:35.063941 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:35.063895 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:35.205605 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:35.205567 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:36.515063 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:36.515024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:36.684096 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:36.684057 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:36.845296 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:36.845246 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:45.800293 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:45.800251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:45.982077 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:45.982032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:48.309874 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:48.309839 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:48.667301 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:48.667212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:52.524793 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:52.524752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:52.571019 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:52.570979 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bdc8769d6-6dnst" podUID="987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" containerName="console" containerID="cri-o://7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa" gracePeriod=15 Jul 26 18:05:52.631172 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:52.631133 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:52.735908 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:52.735871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:53.071986 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.071965 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:05:53.191400 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191277 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-oauth-serving-cert\") pod \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " Jul 26 18:05:53.191400 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191343 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-config\") pod \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " Jul 26 18:05:53.191400 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191376 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-serving-cert\") pod \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " Jul 26 18:05:53.191400 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191404 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-oauth-config\") pod \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " Jul 26 18:05:53.191749 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191443 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-trusted-ca-bundle\") pod \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " Jul 26 18:05:53.191749 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191499 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-service-ca\") pod \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " Jul 26 18:05:53.191749 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191527 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfw4j\" (UniqueName: \"kubernetes.io/projected/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-kube-api-access-bfw4j\") pod \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\" (UID: \"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e\") " Jul 26 18:05:53.191749 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191685 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-config" (OuterVolumeSpecName: "console-config") pod "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" (UID: "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:05:53.191979 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191921 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-service-ca" (OuterVolumeSpecName: "service-ca") pod "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" (UID: "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:05:53.192033 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191969 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" (UID: "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:05:53.192033 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.191976 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" (UID: "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:05:53.192201 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.192184 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-service-ca\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:05:53.192242 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.192205 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-oauth-serving-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:05:53.192242 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.192214 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-config\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:05:53.192242 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.192222 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-trusted-ca-bundle\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:05:53.193570 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.193545 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" (UID: "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:05:53.194004 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.193987 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" (UID: "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:05:53.194054 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.193994 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-kube-api-access-bfw4j" (OuterVolumeSpecName: "kube-api-access-bfw4j") pod "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" (UID: "987a3c77-fa47-43ab-a0c0-a3bc2dabb15e"). InnerVolumeSpecName "kube-api-access-bfw4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:05:53.293386 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.293353 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfw4j\" (UniqueName: \"kubernetes.io/projected/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-kube-api-access-bfw4j\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:05:53.293386 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.293379 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-serving-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:05:53.293386 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.293390 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e-console-oauth-config\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:05:53.603879 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.603841 2565 generic.go:356] "Generic (PLEG): container finished" podID="987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" containerID="7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa" exitCode=0 Jul 26 18:05:53.604399 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.603885 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdc8769d6-6dnst" Jul 26 18:05:53.604399 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.603937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdc8769d6-6dnst" event={"ID":"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e","Type":"ContainerDied","Data":"7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa"} Jul 26 18:05:53.604399 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.604021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdc8769d6-6dnst" event={"ID":"987a3c77-fa47-43ab-a0c0-a3bc2dabb15e","Type":"ContainerDied","Data":"007aa46c62c68c750a6ad81a4198190e4066bed0f63471e86a55d3fb65e3145c"} Jul 26 18:05:53.604399 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.604044 2565 scope.go:117] "RemoveContainer" containerID="7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa" Jul 26 18:05:53.605646 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.605626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" event={"ID":"99a3f27a-436e-46e3-ae45-b0fd8b01a34a","Type":"ContainerStarted","Data":"5accf26cf16198af30380848946ebb2cb9616c542a28aeb6bceb6c75c5008e4c"} Jul 26 18:05:53.613556 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.613540 2565 scope.go:117] "RemoveContainer" containerID="7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa" Jul 26 18:05:53.613797 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:05:53.613778 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa\": container with ID starting with 7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa not found: ID does not exist" containerID="7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa" Jul 26 18:05:53.613901 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.613809 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa"} err="failed to get container status \"7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa\": rpc error: code = NotFound desc = could not find container \"7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa\": container with ID starting with 7731ee66c32b5778da16085445797d542c86bb6e2fe584d2955a02624c4e9caa not found: ID does not exist" Jul 26 18:05:53.636704 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.636653 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mbgh6" podStartSLOduration=1.406249161 podStartE2EDuration="23.636636723s" totalImagesPullingTime="22.230387562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:05:53.636149663 +0000 UTC m=+532.339876823" watchObservedRunningTime="2026-07-26 18:05:53.636636723 +0000 UTC m=+532.340363882" Jul 26 18:05:53.659301 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.659268 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdc8769d6-6dnst"] Jul 26 18:05:53.663421 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.663396 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bdc8769d6-6dnst"] Jul 26 18:05:53.850922 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:53.850879 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" path="/var/lib/kubelet/pods/987a3c77-fa47-43ab-a0c0-a3bc2dabb15e/volumes" Jul 26 18:05:54.736555 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:54.736518 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:05:54.839200 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:05:54.839149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:03.603160 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:03.603122 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:03.699067 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:03.699033 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:06.125689 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:06.125653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:06.202429 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:06.202390 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:10.552225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:10.552177 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:10.724428 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:10.724390 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:13.295729 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:13.295691 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:13.413950 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:13.413914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:14.539098 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:14.539066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:14.664241 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:14.664209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:17.099513 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:17.099476 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:17.252142 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:17.252107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:18.279347 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.279300 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xxjfr"] Jul 26 18:06:18.279764 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.279694 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" containerName="console" Jul 26 18:06:18.279764 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.279705 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" containerName="console" Jul 26 18:06:18.279852 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.279789 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="987a3c77-fa47-43ab-a0c0-a3bc2dabb15e" containerName="console" Jul 26 18:06:18.318070 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.318031 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxjfr"] Jul 26 18:06:18.318231 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.318132 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xxjfr" Jul 26 18:06:18.321710 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.321686 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hg5gm\"" Jul 26 18:06:18.349080 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.349053 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:18.422170 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.422121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xln5t\" (UniqueName: \"kubernetes.io/projected/ca090fea-7201-4bd6-bf86-168c7049e753-kube-api-access-xln5t\") pod \"authorino-58cd955675-xxjfr\" (UID: \"ca090fea-7201-4bd6-bf86-168c7049e753\") " pod="kuadrant-system/authorino-58cd955675-xxjfr" Jul 26 18:06:18.496637 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.496604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:18.523422 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.523386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xln5t\" (UniqueName: \"kubernetes.io/projected/ca090fea-7201-4bd6-bf86-168c7049e753-kube-api-access-xln5t\") pod \"authorino-58cd955675-xxjfr\" (UID: \"ca090fea-7201-4bd6-bf86-168c7049e753\") " pod="kuadrant-system/authorino-58cd955675-xxjfr" Jul 26 18:06:18.535639 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.535574 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xln5t\" (UniqueName: \"kubernetes.io/projected/ca090fea-7201-4bd6-bf86-168c7049e753-kube-api-access-xln5t\") pod \"authorino-58cd955675-xxjfr\" (UID: \"ca090fea-7201-4bd6-bf86-168c7049e753\") " pod="kuadrant-system/authorino-58cd955675-xxjfr" Jul 26 18:06:18.627418 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.627378 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xxjfr" Jul 26 18:06:18.670792 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.670752 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5btqf"] Jul 26 18:06:18.675799 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.675771 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5btqf" Jul 26 18:06:18.699263 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.699217 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5btqf"] Jul 26 18:06:18.725927 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.725897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhwv5\" (UniqueName: \"kubernetes.io/projected/15890bbf-958d-42f5-a107-9731629f72a8-kube-api-access-mhwv5\") pod \"authorino-75d556bd77-5btqf\" (UID: \"15890bbf-958d-42f5-a107-9731629f72a8\") " pod="kuadrant-system/authorino-75d556bd77-5btqf" Jul 26 18:06:18.806243 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.806205 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxjfr"] Jul 26 18:06:18.808682 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:06:18.808654 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca090fea_7201_4bd6_bf86_168c7049e753.slice/crio-846293ddd997e963a706148945e31809a43519bcea33f9ba4e3a6de59c74bcca WatchSource:0}: Error finding container 846293ddd997e963a706148945e31809a43519bcea33f9ba4e3a6de59c74bcca: Status 404 returned error can't find the container with id 846293ddd997e963a706148945e31809a43519bcea33f9ba4e3a6de59c74bcca Jul 26 18:06:18.826686 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.826645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhwv5\" (UniqueName: \"kubernetes.io/projected/15890bbf-958d-42f5-a107-9731629f72a8-kube-api-access-mhwv5\") pod \"authorino-75d556bd77-5btqf\" (UID: \"15890bbf-958d-42f5-a107-9731629f72a8\") " pod="kuadrant-system/authorino-75d556bd77-5btqf" Jul 26 18:06:18.839669 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.839640 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhwv5\" (UniqueName: \"kubernetes.io/projected/15890bbf-958d-42f5-a107-9731629f72a8-kube-api-access-mhwv5\") pod \"authorino-75d556bd77-5btqf\" (UID: \"15890bbf-958d-42f5-a107-9731629f72a8\") " pod="kuadrant-system/authorino-75d556bd77-5btqf" Jul 26 18:06:18.986929 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:18.986891 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5btqf" Jul 26 18:06:19.158618 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:19.158591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5btqf"] Jul 26 18:06:19.161386 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:06:19.161358 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15890bbf_958d_42f5_a107_9731629f72a8.slice/crio-b2f062ec20085b9be8e5beb3f797ba663a36d1f735e81b52b2546a64042b6833 WatchSource:0}: Error finding container b2f062ec20085b9be8e5beb3f797ba663a36d1f735e81b52b2546a64042b6833: Status 404 returned error can't find the container with id b2f062ec20085b9be8e5beb3f797ba663a36d1f735e81b52b2546a64042b6833 Jul 26 18:06:19.753123 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:19.753086 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5btqf" event={"ID":"15890bbf-958d-42f5-a107-9731629f72a8","Type":"ContainerStarted","Data":"b2f062ec20085b9be8e5beb3f797ba663a36d1f735e81b52b2546a64042b6833"} Jul 26 18:06:19.755008 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:19.754973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xxjfr" event={"ID":"ca090fea-7201-4bd6-bf86-168c7049e753","Type":"ContainerStarted","Data":"846293ddd997e963a706148945e31809a43519bcea33f9ba4e3a6de59c74bcca"} Jul 26 18:06:22.775520 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:22.775482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xxjfr" event={"ID":"ca090fea-7201-4bd6-bf86-168c7049e753","Type":"ContainerStarted","Data":"74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff"} Jul 26 18:06:22.776939 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:22.776908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5btqf" event={"ID":"15890bbf-958d-42f5-a107-9731629f72a8","Type":"ContainerStarted","Data":"98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2"} Jul 26 18:06:22.799248 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:22.799203 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xxjfr" podStartSLOduration=1.347712664 podStartE2EDuration="4.799190421s" totalImagesPullingTime="3.451477757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:06:22.797331699 +0000 UTC m=+561.501058847" watchObservedRunningTime="2026-07-26 18:06:22.799190421 +0000 UTC m=+561.502917579" Jul 26 18:06:22.911177 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:22.911123 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5btqf" podStartSLOduration=1.80155594 podStartE2EDuration="4.911104837s" totalImagesPullingTime="3.109548897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:06:22.844400434 +0000 UTC m=+561.548127593" watchObservedRunningTime="2026-07-26 18:06:22.911104837 +0000 UTC m=+561.614831994" Jul 26 18:06:22.911609 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:22.911593 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxjfr"] Jul 26 18:06:23.077820 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:23.077785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:23.193134 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:23.193102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:23.317578 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:23.317538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:23.438669 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:23.438588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:24.786668 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:24.786610 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xxjfr" podUID="ca090fea-7201-4bd6-bf86-168c7049e753" containerName="authorino" containerID="cri-o://74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff" gracePeriod=30 Jul 26 18:06:24.910938 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:24.910905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:25.066384 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.066346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:25.524950 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.524925 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xxjfr" Jul 26 18:06:25.591814 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.591781 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xln5t\" (UniqueName: \"kubernetes.io/projected/ca090fea-7201-4bd6-bf86-168c7049e753-kube-api-access-xln5t\") pod \"ca090fea-7201-4bd6-bf86-168c7049e753\" (UID: \"ca090fea-7201-4bd6-bf86-168c7049e753\") " Jul 26 18:06:25.594005 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.593969 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca090fea-7201-4bd6-bf86-168c7049e753-kube-api-access-xln5t" (OuterVolumeSpecName: "kube-api-access-xln5t") pod "ca090fea-7201-4bd6-bf86-168c7049e753" (UID: "ca090fea-7201-4bd6-bf86-168c7049e753"). InnerVolumeSpecName "kube-api-access-xln5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:06:25.693023 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.692938 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xln5t\" (UniqueName: \"kubernetes.io/projected/ca090fea-7201-4bd6-bf86-168c7049e753-kube-api-access-xln5t\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:06:25.793278 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.793236 2565 generic.go:356] "Generic (PLEG): container finished" podID="ca090fea-7201-4bd6-bf86-168c7049e753" containerID="74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff" exitCode=0 Jul 26 18:06:25.793278 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.793280 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xxjfr" Jul 26 18:06:25.793747 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.793341 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xxjfr" event={"ID":"ca090fea-7201-4bd6-bf86-168c7049e753","Type":"ContainerDied","Data":"74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff"} Jul 26 18:06:25.793747 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.793386 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xxjfr" event={"ID":"ca090fea-7201-4bd6-bf86-168c7049e753","Type":"ContainerDied","Data":"846293ddd997e963a706148945e31809a43519bcea33f9ba4e3a6de59c74bcca"} Jul 26 18:06:25.793747 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.793403 2565 scope.go:117] "RemoveContainer" containerID="74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff" Jul 26 18:06:25.802124 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.802108 2565 scope.go:117] "RemoveContainer" containerID="74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff" Jul 26 18:06:25.802384 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:06:25.802366 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff\": container with ID starting with 74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff not found: ID does not exist" containerID="74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff" Jul 26 18:06:25.802437 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.802393 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff"} err="failed to get container status \"74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff\": rpc error: code = NotFound desc = could not find container \"74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff\": container with ID starting with 74883f581dc08dc28e2b149d028cb8d6020b1bd7df82886859345d3d452278ff not found: ID does not exist" Jul 26 18:06:25.819486 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.819454 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxjfr"] Jul 26 18:06:25.826975 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.826954 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xxjfr"] Jul 26 18:06:25.850953 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:25.850925 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca090fea-7201-4bd6-bf86-168c7049e753" path="/var/lib/kubelet/pods/ca090fea-7201-4bd6-bf86-168c7049e753/volumes" Jul 26 18:06:38.187834 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:38.187796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:38.308095 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:38.308061 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:38.712525 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:38.712480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:51.232896 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.232857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:51.450800 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.450764 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4dwxc"] Jul 26 18:06:51.451185 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.451171 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca090fea-7201-4bd6-bf86-168c7049e753" containerName="authorino" Jul 26 18:06:51.451228 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.451188 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca090fea-7201-4bd6-bf86-168c7049e753" containerName="authorino" Jul 26 18:06:51.451287 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.451279 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca090fea-7201-4bd6-bf86-168c7049e753" containerName="authorino" Jul 26 18:06:51.458849 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.458816 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4dwxc" Jul 26 18:06:51.459805 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.459781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4dwxc"] Jul 26 18:06:51.615632 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.615599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:51.634363 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.634299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j457z\" (UniqueName: \"kubernetes.io/projected/e6686dac-dcda-4875-9978-b979472fe999-kube-api-access-j457z\") pod \"authorino-5d4b67c446-4dwxc\" (UID: \"e6686dac-dcda-4875-9978-b979472fe999\") " pod="kuadrant-system/authorino-5d4b67c446-4dwxc" Jul 26 18:06:51.673269 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.673235 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4dwxc"] Jul 26 18:06:51.673577 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:06:51.673557 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j457z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-4dwxc" podUID="e6686dac-dcda-4875-9978-b979472fe999" Jul 26 18:06:51.720803 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.720767 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56cfcb9945-w9n8w"] Jul 26 18:06:51.723543 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.723526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" Jul 26 18:06:51.735503 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.735480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmzdj\" (UniqueName: \"kubernetes.io/projected/5cb98a4c-43bb-4bf3-96a4-b5d3280e381e-kube-api-access-dmzdj\") pod \"authorino-56cfcb9945-w9n8w\" (UID: \"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e\") " pod="kuadrant-system/authorino-56cfcb9945-w9n8w" Jul 26 18:06:51.735638 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.735514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j457z\" (UniqueName: \"kubernetes.io/projected/e6686dac-dcda-4875-9978-b979472fe999-kube-api-access-j457z\") pod \"authorino-5d4b67c446-4dwxc\" (UID: \"e6686dac-dcda-4875-9978-b979472fe999\") " pod="kuadrant-system/authorino-5d4b67c446-4dwxc" Jul 26 18:06:51.737840 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.737817 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cfcb9945-w9n8w"] Jul 26 18:06:51.748293 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.748265 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j457z\" (UniqueName: \"kubernetes.io/projected/e6686dac-dcda-4875-9978-b979472fe999-kube-api-access-j457z\") pod \"authorino-5d4b67c446-4dwxc\" (UID: \"e6686dac-dcda-4875-9978-b979472fe999\") " pod="kuadrant-system/authorino-5d4b67c446-4dwxc" Jul 26 18:06:51.836877 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.836838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmzdj\" (UniqueName: \"kubernetes.io/projected/5cb98a4c-43bb-4bf3-96a4-b5d3280e381e-kube-api-access-dmzdj\") pod \"authorino-56cfcb9945-w9n8w\" (UID: \"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e\") " pod="kuadrant-system/authorino-56cfcb9945-w9n8w" Jul 26 18:06:51.847455 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.847427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmzdj\" (UniqueName: \"kubernetes.io/projected/5cb98a4c-43bb-4bf3-96a4-b5d3280e381e-kube-api-access-dmzdj\") pod \"authorino-56cfcb9945-w9n8w\" (UID: \"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e\") " pod="kuadrant-system/authorino-56cfcb9945-w9n8w" Jul 26 18:06:51.919726 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.919643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4dwxc" Jul 26 18:06:51.925822 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.925801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4dwxc" Jul 26 18:06:51.937201 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.937152 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j457z\" (UniqueName: \"kubernetes.io/projected/e6686dac-dcda-4875-9978-b979472fe999-kube-api-access-j457z\") pod \"e6686dac-dcda-4875-9978-b979472fe999\" (UID: \"e6686dac-dcda-4875-9978-b979472fe999\") " Jul 26 18:06:51.939515 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.939486 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6686dac-dcda-4875-9978-b979472fe999-kube-api-access-j457z" (OuterVolumeSpecName: "kube-api-access-j457z") pod "e6686dac-dcda-4875-9978-b979472fe999" (UID: "e6686dac-dcda-4875-9978-b979472fe999"). InnerVolumeSpecName "kube-api-access-j457z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:06:51.943641 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.943609 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cfcb9945-w9n8w"] Jul 26 18:06:51.944783 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.944536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" Jul 26 18:06:51.969225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.969192 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bdcfcf989-9bqnc"] Jul 26 18:06:51.971811 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.971791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:06:51.974225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.974193 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 26 18:06:51.984388 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:51.984363 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bdcfcf989-9bqnc"] Jul 26 18:06:52.038042 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.037975 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-tls-cert\") pod \"authorino-7bdcfcf989-9bqnc\" (UID: \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\") " pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:06:52.038042 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.038019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2brh\" (UniqueName: \"kubernetes.io/projected/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-kube-api-access-f2brh\") pod \"authorino-7bdcfcf989-9bqnc\" (UID: \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\") " pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:06:52.038245 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.038145 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j457z\" (UniqueName: \"kubernetes.io/projected/e6686dac-dcda-4875-9978-b979472fe999-kube-api-access-j457z\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:06:52.091183 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.091114 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cfcb9945-w9n8w"] Jul 26 18:06:52.093695 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:06:52.093668 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cb98a4c_43bb_4bf3_96a4_b5d3280e381e.slice/crio-32b19287bec04e45631d0d3bc0f53de435dce9d48565c3750a53db70d97c763d WatchSource:0}: Error finding container 32b19287bec04e45631d0d3bc0f53de435dce9d48565c3750a53db70d97c763d: Status 404 returned error can't find the container with id 32b19287bec04e45631d0d3bc0f53de435dce9d48565c3750a53db70d97c763d Jul 26 18:06:52.139026 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.138991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-tls-cert\") pod \"authorino-7bdcfcf989-9bqnc\" (UID: \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\") " pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:06:52.139026 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.139027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2brh\" (UniqueName: \"kubernetes.io/projected/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-kube-api-access-f2brh\") pod \"authorino-7bdcfcf989-9bqnc\" (UID: \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\") " pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:06:52.141323 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.141295 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-tls-cert\") pod \"authorino-7bdcfcf989-9bqnc\" (UID: \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\") " pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:06:52.147155 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.147140 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2brh\" (UniqueName: \"kubernetes.io/projected/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-kube-api-access-f2brh\") pod \"authorino-7bdcfcf989-9bqnc\" (UID: \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\") " pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:06:52.211896 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.211820 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:52.283446 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.283411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:06:52.416373 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.416339 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bdcfcf989-9bqnc"] Jul 26 18:06:52.419430 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:06:52.419395 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b6ac751_dc7d_4e8c_a29b_3cfaa238bc2b.slice/crio-8a89b6b0d63d6c77c31f18aa44130f1b303bf5012a91059ed1c14b59017a5af3 WatchSource:0}: Error finding container 8a89b6b0d63d6c77c31f18aa44130f1b303bf5012a91059ed1c14b59017a5af3: Status 404 returned error can't find the container with id 8a89b6b0d63d6c77c31f18aa44130f1b303bf5012a91059ed1c14b59017a5af3 Jul 26 18:06:52.926299 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.926253 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" event={"ID":"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b","Type":"ContainerStarted","Data":"7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c"} Jul 26 18:06:52.926504 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.926305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" event={"ID":"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b","Type":"ContainerStarted","Data":"8a89b6b0d63d6c77c31f18aa44130f1b303bf5012a91059ed1c14b59017a5af3"} Jul 26 18:06:52.927779 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.927748 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" podUID="5cb98a4c-43bb-4bf3-96a4-b5d3280e381e" containerName="authorino" containerID="cri-o://f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513" gracePeriod=30 Jul 26 18:06:52.927902 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.927799 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4dwxc" Jul 26 18:06:52.927902 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.927757 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" event={"ID":"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e","Type":"ContainerStarted","Data":"f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513"} Jul 26 18:06:52.927902 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.927860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" event={"ID":"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e","Type":"ContainerStarted","Data":"32b19287bec04e45631d0d3bc0f53de435dce9d48565c3750a53db70d97c763d"} Jul 26 18:06:52.943649 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.943607 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" podStartSLOduration=1.618045121 podStartE2EDuration="1.943592284s" totalImagesPullingTime="325.547163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:06:52.942429607 +0000 UTC m=+591.646156765" watchObservedRunningTime="2026-07-26 18:06:52.943592284 +0000 UTC m=+591.647319442" Jul 26 18:06:52.967864 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.967810 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" podStartSLOduration=1.601339617 podStartE2EDuration="1.967793306s" totalImagesPullingTime="366.453689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:06:52.965724216 +0000 UTC m=+591.669451356" watchObservedRunningTime="2026-07-26 18:06:52.967793306 +0000 UTC m=+591.671520464" Jul 26 18:06:52.973683 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.973655 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5btqf"] Jul 26 18:06:52.973853 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:52.973809 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5btqf" podUID="15890bbf-958d-42f5-a107-9731629f72a8" containerName="authorino" containerID="cri-o://98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2" gracePeriod=30 Jul 26 18:06:53.090673 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.090645 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4dwxc"] Jul 26 18:06:53.096938 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.096905 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4dwxc"] Jul 26 18:06:53.224029 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.224004 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" Jul 26 18:06:53.231425 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.231405 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5btqf" Jul 26 18:06:53.248970 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.248899 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhwv5\" (UniqueName: \"kubernetes.io/projected/15890bbf-958d-42f5-a107-9731629f72a8-kube-api-access-mhwv5\") pod \"15890bbf-958d-42f5-a107-9731629f72a8\" (UID: \"15890bbf-958d-42f5-a107-9731629f72a8\") " Jul 26 18:06:53.249097 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.249028 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmzdj\" (UniqueName: \"kubernetes.io/projected/5cb98a4c-43bb-4bf3-96a4-b5d3280e381e-kube-api-access-dmzdj\") pod \"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e\" (UID: \"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e\") " Jul 26 18:06:53.250884 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.250850 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15890bbf-958d-42f5-a107-9731629f72a8-kube-api-access-mhwv5" (OuterVolumeSpecName: "kube-api-access-mhwv5") pod "15890bbf-958d-42f5-a107-9731629f72a8" (UID: "15890bbf-958d-42f5-a107-9731629f72a8"). InnerVolumeSpecName "kube-api-access-mhwv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:06:53.250884 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.250868 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb98a4c-43bb-4bf3-96a4-b5d3280e381e-kube-api-access-dmzdj" (OuterVolumeSpecName: "kube-api-access-dmzdj") pod "5cb98a4c-43bb-4bf3-96a4-b5d3280e381e" (UID: "5cb98a4c-43bb-4bf3-96a4-b5d3280e381e"). InnerVolumeSpecName "kube-api-access-dmzdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:06:53.350209 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.350172 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmzdj\" (UniqueName: \"kubernetes.io/projected/5cb98a4c-43bb-4bf3-96a4-b5d3280e381e-kube-api-access-dmzdj\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:06:53.350209 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.350203 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhwv5\" (UniqueName: \"kubernetes.io/projected/15890bbf-958d-42f5-a107-9731629f72a8-kube-api-access-mhwv5\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:06:53.850820 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.850788 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6686dac-dcda-4875-9978-b979472fe999" path="/var/lib/kubelet/pods/e6686dac-dcda-4875-9978-b979472fe999/volumes" Jul 26 18:06:53.934474 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.934437 2565 generic.go:356] "Generic (PLEG): container finished" podID="5cb98a4c-43bb-4bf3-96a4-b5d3280e381e" containerID="f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513" exitCode=0 Jul 26 18:06:53.934666 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.934478 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" Jul 26 18:06:53.934666 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.934523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" event={"ID":"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e","Type":"ContainerDied","Data":"f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513"} Jul 26 18:06:53.934666 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.934563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cfcb9945-w9n8w" event={"ID":"5cb98a4c-43bb-4bf3-96a4-b5d3280e381e","Type":"ContainerDied","Data":"32b19287bec04e45631d0d3bc0f53de435dce9d48565c3750a53db70d97c763d"} Jul 26 18:06:53.934666 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.934586 2565 scope.go:117] "RemoveContainer" containerID="f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513" Jul 26 18:06:53.936003 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.935977 2565 generic.go:356] "Generic (PLEG): container finished" podID="15890bbf-958d-42f5-a107-9731629f72a8" containerID="98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2" exitCode=0 Jul 26 18:06:53.936118 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.936018 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5btqf" Jul 26 18:06:53.936118 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.936062 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5btqf" event={"ID":"15890bbf-958d-42f5-a107-9731629f72a8","Type":"ContainerDied","Data":"98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2"} Jul 26 18:06:53.936118 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.936102 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5btqf" event={"ID":"15890bbf-958d-42f5-a107-9731629f72a8","Type":"ContainerDied","Data":"b2f062ec20085b9be8e5beb3f797ba663a36d1f735e81b52b2546a64042b6833"} Jul 26 18:06:53.943102 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.943085 2565 scope.go:117] "RemoveContainer" containerID="f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513" Jul 26 18:06:53.943365 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:06:53.943340 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513\": container with ID starting with f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513 not found: ID does not exist" containerID="f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513" Jul 26 18:06:53.943457 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.943369 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513"} err="failed to get container status \"f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513\": rpc error: code = NotFound desc = could not find container \"f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513\": container with ID starting with f1a74dd984b971887cae46df5aa00fda692c63305e7acf8ccd0e54ba7989f513 not found: ID does not exist" Jul 26 18:06:53.943457 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.943386 2565 scope.go:117] "RemoveContainer" containerID="98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2" Jul 26 18:06:53.950941 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.950926 2565 scope.go:117] "RemoveContainer" containerID="98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2" Jul 26 18:06:53.951168 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:06:53.951150 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2\": container with ID starting with 98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2 not found: ID does not exist" containerID="98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2" Jul 26 18:06:53.951208 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.951176 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2"} err="failed to get container status \"98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2\": rpc error: code = NotFound desc = could not find container \"98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2\": container with ID starting with 98c77193d926a7a91d4fd907312d1ee94fa9cc46397e714c202bdae8d9a405d2 not found: ID does not exist" Jul 26 18:06:53.954567 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.954545 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cfcb9945-w9n8w"] Jul 26 18:06:53.960093 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.960075 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56cfcb9945-w9n8w"] Jul 26 18:06:53.969987 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.969966 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5btqf"] Jul 26 18:06:53.978278 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:53.978257 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5btqf"] Jul 26 18:06:55.849982 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:55.849945 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15890bbf-958d-42f5-a107-9731629f72a8" path="/var/lib/kubelet/pods/15890bbf-958d-42f5-a107-9731629f72a8/volumes" Jul 26 18:06:55.850397 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:55.850278 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cb98a4c-43bb-4bf3-96a4-b5d3280e381e" path="/var/lib/kubelet/pods/5cb98a4c-43bb-4bf3-96a4-b5d3280e381e/volumes" Jul 26 18:06:57.517961 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:57.517925 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:57.611062 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:57.611025 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:06:57.700667 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:06:57.700630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:00.668709 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:00.668669 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:00.828459 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:00.828418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:01.753849 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:01.753820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:07:01.759260 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:01.759237 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:07:01.761077 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:01.761054 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:07:01.766363 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:01.766345 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:07:10.245918 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:10.245878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:32.424380 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:32.424271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:32.513157 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:32.513096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:33.090916 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:33.090875 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:33.262175 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:33.262145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:33.756854 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:33.756819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:33.865720 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:33.865666 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:43.808711 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:43.808666 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:43.899052 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:43.899019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:47.546379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.546345 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq"] Jul 26 18:07:47.546768 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.546729 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15890bbf-958d-42f5-a107-9731629f72a8" containerName="authorino" Jul 26 18:07:47.546768 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.546740 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="15890bbf-958d-42f5-a107-9731629f72a8" containerName="authorino" Jul 26 18:07:47.546768 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.546760 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cb98a4c-43bb-4bf3-96a4-b5d3280e381e" containerName="authorino" Jul 26 18:07:47.546768 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.546766 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cb98a4c-43bb-4bf3-96a4-b5d3280e381e" containerName="authorino" Jul 26 18:07:47.546930 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.546838 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cb98a4c-43bb-4bf3-96a4-b5d3280e381e" containerName="authorino" Jul 26 18:07:47.546930 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.546851 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="15890bbf-958d-42f5-a107-9731629f72a8" containerName="authorino" Jul 26 18:07:47.550305 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.550283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.554902 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.554877 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sc8sl\"" Jul 26 18:07:47.555176 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.555156 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 26 18:07:47.555435 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.555415 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 26 18:07:47.555435 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.555425 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 26 18:07:47.568358 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.568304 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq"] Jul 26 18:07:47.607091 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.607048 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:47.646856 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.646822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.647004 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.646874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ac0942-58eb-4693-ad9b-9222edfc007f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.647004 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.646979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.647076 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.647043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.647076 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.647070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhw7k\" (UniqueName: \"kubernetes.io/projected/88ac0942-58eb-4693-ad9b-9222edfc007f-kube-api-access-bhw7k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.647146 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.647096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.748451 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.748413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.748626 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.748459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhw7k\" (UniqueName: \"kubernetes.io/projected/88ac0942-58eb-4693-ad9b-9222edfc007f-kube-api-access-bhw7k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.748626 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.748492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.748626 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.748533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.748626 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.748579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ac0942-58eb-4693-ad9b-9222edfc007f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.748833 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.748633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.748988 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.748957 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.749078 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.748997 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.749078 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.749021 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.750927 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.750902 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ac0942-58eb-4693-ad9b-9222edfc007f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.751194 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.751177 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ac0942-58eb-4693-ad9b-9222edfc007f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.757161 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.757135 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhw7k\" (UniqueName: \"kubernetes.io/projected/88ac0942-58eb-4693-ad9b-9222edfc007f-kube-api-access-bhw7k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq\" (UID: \"88ac0942-58eb-4693-ad9b-9222edfc007f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:47.863786 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:47.863754 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:48.008584 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:48.008540 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq"] Jul 26 18:07:48.009787 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:07:48.009745 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ac0942_58eb_4693_ad9b_9222edfc007f.slice/crio-816d07465bee1b2b88991d7848732c395b1e89b5699f1fc57f03588c58a1facf WatchSource:0}: Error finding container 816d07465bee1b2b88991d7848732c395b1e89b5699f1fc57f03588c58a1facf: Status 404 returned error can't find the container with id 816d07465bee1b2b88991d7848732c395b1e89b5699f1fc57f03588c58a1facf Jul 26 18:07:48.011164 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:48.011144 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 26 18:07:48.217226 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:48.217141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" event={"ID":"88ac0942-58eb-4693-ad9b-9222edfc007f","Type":"ContainerStarted","Data":"816d07465bee1b2b88991d7848732c395b1e89b5699f1fc57f03588c58a1facf"} Jul 26 18:07:49.224205 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:49.224167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" event={"ID":"88ac0942-58eb-4693-ad9b-9222edfc007f","Type":"ContainerStarted","Data":"d57fe6a65e6f7961b515f6ff881690e9f3f081fbe618d4622dd75679802f9745"} Jul 26 18:07:49.246025 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:49.245947 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" podStartSLOduration=1.153844334 podStartE2EDuration="2.245929233s" totalImagesPullingTime="1.092084899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:07:49.243780782 +0000 UTC m=+647.947507945" watchObservedRunningTime="2026-07-26 18:07:49.245929233 +0000 UTC m=+647.949656392" Jul 26 18:07:51.629069 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:51.629010 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:51.702506 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:51.702459 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:57.864777 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:57.864734 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:57.865228 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:57.864831 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:57.877448 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:57.877422 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:58.281073 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:58.280981 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq" Jul 26 18:07:59.632677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.632643 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t"] Jul 26 18:07:59.636026 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.636010 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.638408 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.638391 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 26 18:07:59.661550 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.661522 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t"] Jul 26 18:07:59.739889 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.739838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:07:59.760028 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.759999 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.760129 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.760032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.760129 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.760061 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t8pz\" (UniqueName: \"kubernetes.io/projected/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-kube-api-access-8t8pz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.760204 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.760146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.760204 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.760185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.760204 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.760202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.861445 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t8pz\" (UniqueName: \"kubernetes.io/projected/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-kube-api-access-8t8pz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.861445 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.861702 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.861702 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.861702 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.861702 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.861921 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861894 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.861967 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861910 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.862006 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.861973 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.863901 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.863877 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.864053 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.864013 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.869065 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.869043 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t8pz\" (UniqueName: \"kubernetes.io/projected/053b03bf-1e35-4ee1-89eb-8dbab08ccd9d-kube-api-access-8t8pz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-98c4t\" (UID: \"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:07:59.946378 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:07:59.946278 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:08:00.084544 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:00.084514 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t"] Jul 26 18:08:00.086528 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:08:00.086504 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053b03bf_1e35_4ee1_89eb_8dbab08ccd9d.slice/crio-d019cc8a4bdd29d6cf41c9c1902246ecb3d5e43f577cbe4f83a98cd705122584 WatchSource:0}: Error finding container d019cc8a4bdd29d6cf41c9c1902246ecb3d5e43f577cbe4f83a98cd705122584: Status 404 returned error can't find the container with id d019cc8a4bdd29d6cf41c9c1902246ecb3d5e43f577cbe4f83a98cd705122584 Jul 26 18:08:00.282625 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:00.282596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" event={"ID":"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d","Type":"ContainerStarted","Data":"d019cc8a4bdd29d6cf41c9c1902246ecb3d5e43f577cbe4f83a98cd705122584"} Jul 26 18:08:01.292280 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:01.292233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" event={"ID":"053b03bf-1e35-4ee1-89eb-8dbab08ccd9d","Type":"ContainerStarted","Data":"3b560089beb4c16d2ac93b7ef5a3a6aa2bc0de115178762131de87b2c8eaf56f"} Jul 26 18:08:01.332982 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:01.332925 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" podStartSLOduration=2.157153209 podStartE2EDuration="2.332907394s" totalImagesPullingTime="175.754185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:08:01.331053262 +0000 UTC m=+660.034780422" watchObservedRunningTime="2026-07-26 18:08:01.332907394 +0000 UTC m=+660.036634553" Jul 26 18:08:09.946669 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:09.946625 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:08:09.946669 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:09.946682 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:08:09.959283 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:09.959257 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:08:10.354023 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:10.353990 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-98c4t" Jul 26 18:08:14.870303 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:14.870264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:08:19.377101 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:19.377068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:08:25.657135 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:25.657093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:08:32.328970 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.328926 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w"] Jul 26 18:08:32.333473 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.333444 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.336145 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.336119 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 26 18:08:32.345018 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.344989 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w"] Jul 26 18:08:32.368076 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.368042 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:08:32.379105 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.379075 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.379195 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.379121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.379241 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.379215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.379284 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.379248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0032c294-df19-4e16-901c-8ae3cd20d972-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.379352 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.379339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t6g8\" (UniqueName: \"kubernetes.io/projected/0032c294-df19-4e16-901c-8ae3cd20d972-kube-api-access-6t6g8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.379398 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.379367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.479967 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.479915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t6g8\" (UniqueName: \"kubernetes.io/projected/0032c294-df19-4e16-901c-8ae3cd20d972-kube-api-access-6t6g8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.480172 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.479979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.480172 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.480037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.480172 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.480077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.480172 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.480114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.480172 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.480137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0032c294-df19-4e16-901c-8ae3cd20d972-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.480592 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.480566 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.480649 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.480585 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.480649 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.480613 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.482370 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.482347 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0032c294-df19-4e16-901c-8ae3cd20d972-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.482648 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.482630 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0032c294-df19-4e16-901c-8ae3cd20d972-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.488635 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.488612 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t6g8\" (UniqueName: \"kubernetes.io/projected/0032c294-df19-4e16-901c-8ae3cd20d972-kube-api-access-6t6g8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k869w\" (UID: \"0032c294-df19-4e16-901c-8ae3cd20d972\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.647455 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.647352 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:32.787922 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:32.787894 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w"] Jul 26 18:08:32.790411 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:08:32.790374 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0032c294_df19_4e16_901c_8ae3cd20d972.slice/crio-245c69d0b0f0289ac1e870595393d6c3054aa90f8a165451d488c4cfcf6060d1 WatchSource:0}: Error finding container 245c69d0b0f0289ac1e870595393d6c3054aa90f8a165451d488c4cfcf6060d1: Status 404 returned error can't find the container with id 245c69d0b0f0289ac1e870595393d6c3054aa90f8a165451d488c4cfcf6060d1 Jul 26 18:08:33.473411 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:33.473369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" event={"ID":"0032c294-df19-4e16-901c-8ae3cd20d972","Type":"ContainerStarted","Data":"0e582b5f6b3cea9ec2d172532d2dd1b3eefa064e39b1d77b3a7aecd5a7106594"} Jul 26 18:08:33.473411 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:33.473417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" event={"ID":"0032c294-df19-4e16-901c-8ae3cd20d972","Type":"ContainerStarted","Data":"245c69d0b0f0289ac1e870595393d6c3054aa90f8a165451d488c4cfcf6060d1"} Jul 26 18:08:33.494565 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:33.494514 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" podStartSLOduration=1.312820158 podStartE2EDuration="1.49449798s" totalImagesPullingTime="181.677822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:08:33.491756436 +0000 UTC m=+692.195483614" watchObservedRunningTime="2026-07-26 18:08:33.49449798 +0000 UTC m=+692.198225149" Jul 26 18:08:42.648371 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:42.648299 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:42.648371 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:42.648379 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:42.660749 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:42.660717 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:08:43.542979 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:08:43.542945 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k869w" Jul 26 18:09:49.916844 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:09:49.916805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:10:04.036701 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:04.036662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:10:07.338249 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:07.338215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:10:21.583084 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.583044 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b59589b68-bntkj"] Jul 26 18:10:21.586747 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.586727 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b59589b68-bntkj" Jul 26 18:10:21.605944 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.605916 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b59589b68-bntkj"] Jul 26 18:10:21.637261 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.637226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb86282a-89cd-45ce-a76e-9bf0aabb55a5-tls-cert\") pod \"authorino-b59589b68-bntkj\" (UID: \"bb86282a-89cd-45ce-a76e-9bf0aabb55a5\") " pod="kuadrant-system/authorino-b59589b68-bntkj" Jul 26 18:10:21.637427 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.637343 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzrqn\" (UniqueName: \"kubernetes.io/projected/bb86282a-89cd-45ce-a76e-9bf0aabb55a5-kube-api-access-rzrqn\") pod \"authorino-b59589b68-bntkj\" (UID: \"bb86282a-89cd-45ce-a76e-9bf0aabb55a5\") " pod="kuadrant-system/authorino-b59589b68-bntkj" Jul 26 18:10:21.738103 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.738064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb86282a-89cd-45ce-a76e-9bf0aabb55a5-tls-cert\") pod \"authorino-b59589b68-bntkj\" (UID: \"bb86282a-89cd-45ce-a76e-9bf0aabb55a5\") " pod="kuadrant-system/authorino-b59589b68-bntkj" Jul 26 18:10:21.738254 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.738150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzrqn\" (UniqueName: \"kubernetes.io/projected/bb86282a-89cd-45ce-a76e-9bf0aabb55a5-kube-api-access-rzrqn\") pod \"authorino-b59589b68-bntkj\" (UID: \"bb86282a-89cd-45ce-a76e-9bf0aabb55a5\") " pod="kuadrant-system/authorino-b59589b68-bntkj" Jul 26 18:10:21.740640 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.740619 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb86282a-89cd-45ce-a76e-9bf0aabb55a5-tls-cert\") pod \"authorino-b59589b68-bntkj\" (UID: \"bb86282a-89cd-45ce-a76e-9bf0aabb55a5\") " pod="kuadrant-system/authorino-b59589b68-bntkj" Jul 26 18:10:21.746374 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.746346 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzrqn\" (UniqueName: \"kubernetes.io/projected/bb86282a-89cd-45ce-a76e-9bf0aabb55a5-kube-api-access-rzrqn\") pod \"authorino-b59589b68-bntkj\" (UID: \"bb86282a-89cd-45ce-a76e-9bf0aabb55a5\") " pod="kuadrant-system/authorino-b59589b68-bntkj" Jul 26 18:10:21.895687 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.895601 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b59589b68-bntkj" Jul 26 18:10:21.972825 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:21.972764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:10:22.040750 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:22.040723 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b59589b68-bntkj"] Jul 26 18:10:22.042966 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:10:22.042935 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb86282a_89cd_45ce_a76e_9bf0aabb55a5.slice/crio-48293e33a15b1682aa23c0a1a622611b918dfaf508f6a4d8885e3eb2b9976499 WatchSource:0}: Error finding container 48293e33a15b1682aa23c0a1a622611b918dfaf508f6a4d8885e3eb2b9976499: Status 404 returned error can't find the container with id 48293e33a15b1682aa23c0a1a622611b918dfaf508f6a4d8885e3eb2b9976499 Jul 26 18:10:22.065626 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:22.065596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:10:23.048777 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.048709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b59589b68-bntkj" event={"ID":"bb86282a-89cd-45ce-a76e-9bf0aabb55a5","Type":"ContainerStarted","Data":"faea83624c4f0600cb5b262b87cf662a72eec1b0f8477edc9e2fcdfc6ab8b714"} Jul 26 18:10:23.049246 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.048788 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b59589b68-bntkj" event={"ID":"bb86282a-89cd-45ce-a76e-9bf0aabb55a5","Type":"ContainerStarted","Data":"48293e33a15b1682aa23c0a1a622611b918dfaf508f6a4d8885e3eb2b9976499"} Jul 26 18:10:23.092636 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.092577 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b59589b68-bntkj" podStartSLOduration=1.6961394859999999 podStartE2EDuration="2.092555408s" totalImagesPullingTime="396.415922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:10:23.091230567 +0000 UTC m=+801.794957727" watchObservedRunningTime="2026-07-26 18:10:23.092555408 +0000 UTC m=+801.796282568" Jul 26 18:10:23.126540 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.126502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:10:23.142905 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.142871 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bdcfcf989-9bqnc"] Jul 26 18:10:23.143409 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.143377 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" podUID="7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b" containerName="authorino" containerID="cri-o://7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c" gracePeriod=30 Jul 26 18:10:23.242144 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.242109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:10:23.423474 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.423449 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:10:23.457065 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.457030 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2brh\" (UniqueName: \"kubernetes.io/projected/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-kube-api-access-f2brh\") pod \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\" (UID: \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\") " Jul 26 18:10:23.457257 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.457205 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-tls-cert\") pod \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\" (UID: \"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b\") " Jul 26 18:10:23.459276 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.459236 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-kube-api-access-f2brh" (OuterVolumeSpecName: "kube-api-access-f2brh") pod "7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b" (UID: "7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b"). InnerVolumeSpecName "kube-api-access-f2brh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:10:23.469556 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.469523 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b" (UID: "7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:10:23.558212 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.558176 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-tls-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:10:23.558212 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:23.558209 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2brh\" (UniqueName: \"kubernetes.io/projected/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b-kube-api-access-f2brh\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:10:24.057114 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.057078 2565 generic.go:356] "Generic (PLEG): container finished" podID="7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b" containerID="7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c" exitCode=0 Jul 26 18:10:24.057571 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.057123 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" Jul 26 18:10:24.057571 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.057167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" event={"ID":"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b","Type":"ContainerDied","Data":"7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c"} Jul 26 18:10:24.057571 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.057213 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bdcfcf989-9bqnc" event={"ID":"7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b","Type":"ContainerDied","Data":"8a89b6b0d63d6c77c31f18aa44130f1b303bf5012a91059ed1c14b59017a5af3"} Jul 26 18:10:24.057571 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.057237 2565 scope.go:117] "RemoveContainer" containerID="7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c" Jul 26 18:10:24.067525 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.067503 2565 scope.go:117] "RemoveContainer" containerID="7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c" Jul 26 18:10:24.067837 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:10:24.067809 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c\": container with ID starting with 7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c not found: ID does not exist" containerID="7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c" Jul 26 18:10:24.067890 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.067848 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c"} err="failed to get container status \"7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c\": rpc error: code = NotFound desc = could not find container \"7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c\": container with ID starting with 7583d707b3a70a61cbfb3460e5ee9ba495727e010e19b7fb5219ef88a781d23c not found: ID does not exist" Jul 26 18:10:24.073782 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.073754 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bdcfcf989-9bqnc"] Jul 26 18:10:24.080097 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:24.080071 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bdcfcf989-9bqnc"] Jul 26 18:10:25.850756 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:10:25.850713 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b" path="/var/lib/kubelet/pods/7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b/volumes" Jul 26 18:11:51.465341 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:11:51.465283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:12:01.792149 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:12:01.792073 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:12:01.793478 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:12:01.793456 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:12:01.799258 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:12:01.799235 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:12:01.800171 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:12:01.800151 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:12:26.974257 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:12:26.974215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:12:28.189225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:12:28.189190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:12:45.218164 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:12:45.218113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:03.619137 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:03.619099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:04.689817 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:04.689781 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:09.588130 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:09.588091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:09.710708 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:09.710675 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:09.801739 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:09.801706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:10.007836 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:10.007745 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:15.724935 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:15.724904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:15.801092 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:15.801058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:13:48.352239 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:13:48.352202 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:17:01.826487 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:17:01.826404 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:17:01.827880 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:17:01.827852 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:17:01.833459 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:17:01.833439 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:17:01.834779 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:17:01.834762 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:17:44.882749 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:17:44.882718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:17:47.958423 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:17:47.958390 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:17:48.058985 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:17:48.058953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:17:58.271531 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:17:58.271458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:20:56.835767 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:20:56.835685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:21:06.660554 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:21:06.660522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:21:45.033676 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:21:45.033639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:21:45.971584 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:21:45.971549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:22:01.858410 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:22:01.858377 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:22:01.861960 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:22:01.861937 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:22:01.865229 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:22:01.865208 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:22:01.868760 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:22:01.868739 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:22:02.459303 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:22:02.459265 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:24:55.420203 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:24:55.420169 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:18.178495 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:18.178455 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:21.125925 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:21.125882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:21.223957 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:21.223918 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:21.575518 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:21.575474 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:27.449802 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:27.449716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:27.552725 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:27.552689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:27.671148 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:27.671110 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:28.013678 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:28.013641 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:28.605446 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:28.605410 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:30.639764 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:30.639728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:30.724917 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:30.724884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:30.817358 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:30.817327 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:31.432611 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:31.432572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:31.527807 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:31.527772 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:25:31.639251 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:25:31.639216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:06.584655 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:06.584615 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:07.936462 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:07.936427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:11.225432 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:11.225398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:11.387550 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:11.387515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:11.616866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:11.616834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:11.872015 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:11.871924 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:11.971162 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:11.971126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:12.070631 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:12.070599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:12.392690 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:12.392658 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:12.561038 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:12.561008 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:15.001147 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:15.001101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:15.113127 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:15.113095 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:15.297417 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:15.297299 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:15.738035 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:15.738007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:15.839164 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:15.839129 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:36.065202 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:36.065142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:50.425231 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:50.425182 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:50.494070 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:50.494035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:50.555751 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:50.555720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:55.045043 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:55.044963 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:55.208082 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:55.208040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:55.472610 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:55.472574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:55.662904 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:55.662868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:55.979895 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:55.979862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:56.298527 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:56.298425 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:58.143722 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:58.143685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:58.248013 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:58.244477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:58.355275 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:58.355237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:58.778484 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:58.778448 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:58.876912 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:58.876862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:26:58.945959 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:26:58.945913 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:01.890480 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:01.890450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:27:01.895404 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:01.895375 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:27:01.897516 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:01.897495 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:27:01.902006 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:01.901989 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:27:19.516075 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:19.516045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:19.571188 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:19.571152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:34.297425 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:34.297374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:34.370099 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:34.370067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:34.432421 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:34.432377 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:38.944259 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:38.944219 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:40.161862 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:40.161823 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:40.391386 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:40.391353 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:40.562729 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:40.562701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:40.870634 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:40.870549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:41.292054 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:41.291960 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:43.383002 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:43.382942 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:43.477502 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:43.477465 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:43.662943 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:43.662844 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:43.829342 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:43.829295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:44.180502 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:44.180453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:27:44.273921 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:27:44.273880 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:18.663022 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:18.662958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:18.732533 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:18.732501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:18.790565 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:18.790514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:23.301144 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:23.301100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:23.472168 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:23.472131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:23.726982 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:23.726882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:24.162335 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:24.162280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:24.263368 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:24.263339 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:24.359082 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:24.359016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:25.737595 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:25.737552 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:31.433300 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:31.433255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:31.504306 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:31.504276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:31.584124 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:31.584088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:31.730550 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:31.730456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:32.138778 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:32.138742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:28:58.115873 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:28:58.115833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:04.243094 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:04.243053 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:04.353127 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:04.353088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:04.474093 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:04.474058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:20.336219 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:20.336179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:26.149281 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:26.149249 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:26.269080 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:26.269047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:26.357536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:26.357503 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:29.979232 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:29.979198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:36.891100 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:36.891062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:37.705835 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:37.705796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:44.146122 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:44.146078 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:44.265615 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:44.265570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:44.360178 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:44.360144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:44.457110 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:44.457014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:45.293641 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:45.293592 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:45.427624 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:45.427442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:47.007911 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:47.007880 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:52.871301 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:52.871253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:52.971391 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:52.971355 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:53.562610 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:53.562574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:59.737704 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:59.737663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:29:59.837591 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:29:59.837550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:00.012108 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:00.012018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:00.395735 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:00.395701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:00.494187 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:00.494150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:03.785746 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:03.785707 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:03.890654 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:03.890617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:04.017631 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:04.017597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:04.244977 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:04.244933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:04.702069 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:04.702031 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:04.845071 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:04.845017 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:08.172453 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:08.172420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:08.787077 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:08.787039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:08.886616 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:08.886578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:09.203743 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:09.203709 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:14.999519 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:14.999489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:15.059287 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:15.059249 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:25.500878 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:25.500845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:25.605871 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:25.605839 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:25.703551 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:25.703519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:30.429417 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:30.429379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:30.782667 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:30.782587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:36.745090 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:36.745053 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:36.845010 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:36.844971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:37.018935 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:37.018854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:37.241650 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:37.241607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:37.372611 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:37.372577 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:37.476112 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:37.476081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:37.581230 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:37.581194 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:43.629643 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:43.629610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:43.735167 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:43.735131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:43.849883 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:43.849844 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:44.009421 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:44.009303 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:49.997271 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:49.997232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:50.098391 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:50.098357 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:56.775526 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:56.775486 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:57.145452 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:57.145415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:57.562271 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:57.562237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:30:59.939895 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:30:59.939852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:00.045825 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:00.045793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:00.136770 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:00.136734 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:00.513156 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:00.513124 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:00.723181 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:00.723148 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:00.816631 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:00.816600 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:04.416731 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:04.416694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:19.682472 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:19.682428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:52.603446 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:52.603357 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:31:52.662827 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:31:52.662797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:32:01.922653 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:01.922618 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:32:01.928485 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:01.928453 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:32:01.929666 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:01.929643 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:32:01.936694 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:01.936665 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:32:14.857593 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:14.857554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:32:14.928939 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:14.928898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:32:15.000365 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:15.000299 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:32:19.422240 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:19.422196 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:32:22.512301 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:22.512255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:32:27.592963 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:27.592925 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:32:31.211489 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:32:31.211451 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:03.742258 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:03.742162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:04.763479 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:04.763440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:10.742142 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:10.742100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:16.565138 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:16.565099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:16.625510 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:16.625478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:16.838428 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:16.838298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:17.064580 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:17.064542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:18.117791 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:18.117757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:18.219116 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:18.219079 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:19.055540 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:19.055500 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:19.150642 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:19.150611 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:20.565039 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:20.565004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:26.251047 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:26.251004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:26.308206 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:26.308161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:26.903639 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:26.903586 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:33.505177 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:33.505137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:33.607762 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:33.607719 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:33.707769 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:33.707732 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:41.912157 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:41.912115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:44.186571 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:44.186540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:33:44.515481 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:33:44.515388 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:05.460903 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:05.460865 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:11.842995 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:11.842955 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:11.940966 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:11.940924 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:12.263169 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:12.263081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:12.549008 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:12.548919 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:13.192065 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:13.192028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:15.957384 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:15.957346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:16.054944 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:16.054904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:16.163751 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:16.163718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:16.656326 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:16.656293 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:16.740877 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:16.740839 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:20.418664 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:20.418625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:20.774635 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:20.774550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:21.039034 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:21.038932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:21.351887 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:21.351847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:23.981592 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:23.981550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:24.066768 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:24.066733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:24.146144 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:24.146103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:24.380878 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:24.380841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:24.751238 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:24.751152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:24.854728 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:24.854690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:28.465360 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:28.465298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:31.118671 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:31.118642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:47.828356 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.828298 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94"] Jul 26 18:34:47.828855 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.828747 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b" containerName="authorino" Jul 26 18:34:47.828855 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.828758 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b" containerName="authorino" Jul 26 18:34:47.828855 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.828824 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b6ac751-dc7d-4e8c-a29b-3cfaa238bc2b" containerName="authorino" Jul 26 18:34:47.832247 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.832223 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:47.834929 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.834898 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7d6ab3\"/\"openshift-service-ca.crt\"" Jul 26 18:34:47.835076 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.834898 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7d6ab3\"/\"kube-root-ca.crt\"" Jul 26 18:34:47.835076 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.834899 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7d6ab3\"/\"test-model-7d6ab3-kserve-self-signed-certs\"" Jul 26 18:34:47.835076 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.834913 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7d6ab3\"/\"default-dockercfg-6kj2z\"" Jul 26 18:34:47.840083 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.839647 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94"] Jul 26 18:34:47.933155 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.933115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-model-cache\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:47.933387 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.933235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjxc2\" (UniqueName: \"kubernetes.io/projected/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-kube-api-access-xjxc2\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:47.933387 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.933281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tls-certs\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:47.933387 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.933299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-home\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:47.933387 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.933359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-dshm\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:47.933619 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.933402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tmp-dir\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:47.935712 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:47.935676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:34:48.034068 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjxc2\" (UniqueName: \"kubernetes.io/projected/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-kube-api-access-xjxc2\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.034068 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tls-certs\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.034374 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-home\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.034374 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-dshm\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.034374 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tmp-dir\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.034374 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-model-cache\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.034722 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034698 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tmp-dir\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.034792 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034738 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-home\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.034838 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.034813 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-model-cache\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.036782 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.036758 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-dshm\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.036999 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.036978 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tls-certs\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.041459 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.041434 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjxc2\" (UniqueName: \"kubernetes.io/projected/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-kube-api-access-xjxc2\") pod \"test-model-7d6ab3-kserve-b8554bf87-86v94\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.142992 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.142851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:48.291967 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.291940 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94"] Jul 26 18:34:48.294064 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:34:48.294033 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cf10f78_3fb8_4c49_ae55_a5dd2333b608.slice/crio-af014ac24637599ce010fd226ac4873180c64eb9e730976116279b759ce0f3f4 WatchSource:0}: Error finding container af014ac24637599ce010fd226ac4873180c64eb9e730976116279b759ce0f3f4: Status 404 returned error can't find the container with id af014ac24637599ce010fd226ac4873180c64eb9e730976116279b759ce0f3f4 Jul 26 18:34:48.505425 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.505293 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" event={"ID":"9cf10f78-3fb8-4c49-ae55-a5dd2333b608","Type":"ContainerStarted","Data":"d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15"} Jul 26 18:34:48.505425 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.505360 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" event={"ID":"9cf10f78-3fb8-4c49-ae55-a5dd2333b608","Type":"ContainerStarted","Data":"af014ac24637599ce010fd226ac4873180c64eb9e730976116279b759ce0f3f4"} Jul 26 18:34:48.523521 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:48.523446 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" podStartSLOduration=1.523428579 podStartE2EDuration="1.523428579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:34:48.521490946 +0000 UTC m=+2267.225218104" watchObservedRunningTime="2026-07-26 18:34:48.523428579 +0000 UTC m=+2267.227155735" Jul 26 18:34:58.143368 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:58.143302 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:58.143368 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:58.143375 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:58.155754 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:58.155725 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:34:58.566519 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:34:58.566491 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:35:22.626878 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:22.626840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:22.726713 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:22.726683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:27.354198 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:27.354154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:28.220184 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:28.220139 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94"] Jul 26 18:35:28.228922 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:28.228889 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:39.053248 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:39.053215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:39.128030 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:39.127983 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:39.185829 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:39.185793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:43.241577 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.241525 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" podUID="9cf10f78-3fb8-4c49-ae55-a5dd2333b608" containerName="main" containerID="cri-o://d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15" gracePeriod=45 Jul 26 18:35:43.444709 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.444671 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:43.492064 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.491994 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:35:43.562362 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562332 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tls-certs\") pod \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " Jul 26 18:35:43.562554 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562383 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-home\") pod \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " Jul 26 18:35:43.562554 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562428 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-dshm\") pod \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " Jul 26 18:35:43.562554 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562471 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tmp-dir\") pod \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " Jul 26 18:35:43.562554 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562505 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjxc2\" (UniqueName: \"kubernetes.io/projected/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-kube-api-access-xjxc2\") pod \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " Jul 26 18:35:43.562554 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562530 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-model-cache\") pod \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\" (UID: \"9cf10f78-3fb8-4c49-ae55-a5dd2333b608\") " Jul 26 18:35:43.562811 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562687 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-home" (OuterVolumeSpecName: "home") pod "9cf10f78-3fb8-4c49-ae55-a5dd2333b608" (UID: "9cf10f78-3fb8-4c49-ae55-a5dd2333b608"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:35:43.562873 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562820 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-model-cache" (OuterVolumeSpecName: "model-cache") pod "9cf10f78-3fb8-4c49-ae55-a5dd2333b608" (UID: "9cf10f78-3fb8-4c49-ae55-a5dd2333b608"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:35:43.562873 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562827 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-home\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:35:43.562963 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.562773 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9cf10f78-3fb8-4c49-ae55-a5dd2333b608" (UID: "9cf10f78-3fb8-4c49-ae55-a5dd2333b608"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:35:43.564690 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.564666 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9cf10f78-3fb8-4c49-ae55-a5dd2333b608" (UID: "9cf10f78-3fb8-4c49-ae55-a5dd2333b608"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:35:43.564690 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.564673 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-dshm" (OuterVolumeSpecName: "dshm") pod "9cf10f78-3fb8-4c49-ae55-a5dd2333b608" (UID: "9cf10f78-3fb8-4c49-ae55-a5dd2333b608"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:35:43.564996 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.564972 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-kube-api-access-xjxc2" (OuterVolumeSpecName: "kube-api-access-xjxc2") pod "9cf10f78-3fb8-4c49-ae55-a5dd2333b608" (UID: "9cf10f78-3fb8-4c49-ae55-a5dd2333b608"). InnerVolumeSpecName "kube-api-access-xjxc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:35:43.663349 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.663284 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-model-cache\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:35:43.663349 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.663339 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tls-certs\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:35:43.663349 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.663348 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-dshm\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:35:43.663349 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.663356 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-tmp-dir\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:35:43.663607 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.663364 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjxc2\" (UniqueName: \"kubernetes.io/projected/9cf10f78-3fb8-4c49-ae55-a5dd2333b608-kube-api-access-xjxc2\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:35:43.799886 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.799794 2565 generic.go:356] "Generic (PLEG): container finished" podID="9cf10f78-3fb8-4c49-ae55-a5dd2333b608" containerID="d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15" exitCode=0 Jul 26 18:35:43.799886 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.799840 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" Jul 26 18:35:43.800083 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.799883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" event={"ID":"9cf10f78-3fb8-4c49-ae55-a5dd2333b608","Type":"ContainerDied","Data":"d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15"} Jul 26 18:35:43.800083 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.799930 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94" event={"ID":"9cf10f78-3fb8-4c49-ae55-a5dd2333b608","Type":"ContainerDied","Data":"af014ac24637599ce010fd226ac4873180c64eb9e730976116279b759ce0f3f4"} Jul 26 18:35:43.800083 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.799947 2565 scope.go:117] "RemoveContainer" containerID="d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15" Jul 26 18:35:43.809412 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.809393 2565 scope.go:117] "RemoveContainer" containerID="d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15" Jul 26 18:35:43.809679 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:35:43.809661 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15\": container with ID starting with d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15 not found: ID does not exist" containerID="d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15" Jul 26 18:35:43.809734 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.809687 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15"} err="failed to get container status \"d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15\": rpc error: code = NotFound desc = could not find container \"d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15\": container with ID starting with d029592afcb4113ee238360a3ef2bdcd2ff5d8666380edcde7ca1b0ad023fb15 not found: ID does not exist" Jul 26 18:35:43.811670 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.811648 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:43.822296 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.822271 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94"] Jul 26 18:35:43.826097 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.826073 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-7d6ab3/test-model-7d6ab3-kserve-b8554bf87-86v94"] Jul 26 18:35:43.850371 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:43.850299 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf10f78-3fb8-4c49-ae55-a5dd2333b608" path="/var/lib/kubelet/pods/9cf10f78-3fb8-4c49-ae55-a5dd2333b608/volumes" Jul 26 18:35:49.647100 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:49.647062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:49.752784 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:49.752742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:49.926367 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:49.926239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:35:50.136302 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:35:50.136262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:00.717612 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:00.717526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:00.792517 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:00.792479 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:00.854868 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:00.854831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:05.323789 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:05.323753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:05.701947 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:05.701853 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:11.656815 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:11.656769 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:11.757032 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:11.756996 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:11.905753 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:11.905712 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:12.119843 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:12.119803 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:12.454249 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:12.454161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:12.750768 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:12.750669 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:12.970692 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:12.970660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:15.659088 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:15.659047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:15.747715 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:15.747680 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:15.962008 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:15.961927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:16.179406 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:16.179370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:16.444176 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:16.444142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:16.539660 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:16.539623 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:20.105446 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:20.105413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:20.532225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:20.532137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:20.833442 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:20.833400 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:22.051271 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:22.051239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:23.659094 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:23.659059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:23.753074 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:23.753041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:23.962283 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:23.962187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:24.409071 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:24.409034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:24.571194 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:24.571156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:24.666961 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:24.666868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:26.107838 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:26.107804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:28.152253 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:28.152217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:52.487833 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:52.487787 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:52.549772 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:52.549727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:52.611908 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:52.611811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:56.139303 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:56.139266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:36:56.513838 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:36:56.513730 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:01.956217 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:01.956189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:37:01.963504 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:01.963482 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:37:01.965690 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:01.965669 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:37:01.972004 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:01.971985 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:37:03.562709 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:03.562673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:03.756807 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:03.756771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:03.924268 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:03.924180 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:04.061946 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:04.061904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:19.831667 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:19.831638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:19.932534 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:19.932504 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:20.032838 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:20.032803 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:24.322714 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:24.322638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:24.750694 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:24.750613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:30.706100 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:30.706064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:30.815786 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:30.815757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:31.030970 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:31.030874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:31.239509 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:31.239474 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:31.557150 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:31.557118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:31.858576 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:31.858497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:32.036441 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:32.036409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:35.087046 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:35.087005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:35.184635 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:35.184604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:35.253249 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:35.253216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:35.896777 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:35.896744 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:35.994225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:35.994195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:36.079430 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:36.079394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:39.574362 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:39.574296 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:39.885941 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:39.885846 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:40.195057 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:40.194978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:40.355452 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:40.355407 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:43.138090 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:43.138060 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:43.251288 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:43.251253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:43.358898 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:43.358867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:43.697704 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:43.697672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:43.971381 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:43.971280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:44.165006 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:44.164973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:47.621306 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:47.621271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:37:56.066266 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:37:56.066228 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:38:17.563057 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:38:17.563021 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:40:15.971514 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:40:15.971485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:40:16.059852 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:40:16.059828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:40:23.527887 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:40:23.527857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:40:23.628702 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:40:23.628663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:40:46.205375 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:40:46.205289 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:40:46.305592 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:40:46.305570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:41:19.753805 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:41:19.753755 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:41:35.004497 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:41:35.004465 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:42:01.988388 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:42:01.988289 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:42:01.995123 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:42:01.995097 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:42:01.998847 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:42:01.998827 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:42:02.005952 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:42:02.005935 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:42:18.559832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:42:18.559791 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:42:48.974229 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:42:48.974195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:42:49.928402 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:42:49.928370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:43:09.741630 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:43:09.741593 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:43:28.132944 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:43:28.132911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:44:31.081641 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:44:31.081605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:44:31.934203 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:44:31.934169 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:45:02.145087 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:45:02.145002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:45:33.950188 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:45:33.950156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:46:37.305123 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:37.305089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:46:38.300957 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:38.300921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:46:39.025111 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.025074 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-140086194503728"] Jul 26 18:46:39.025575 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.025556 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf10f78-3fb8-4c49-ae55-a5dd2333b608" containerName="main" Jul 26 18:46:39.025626 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.025577 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf10f78-3fb8-4c49-ae55-a5dd2333b608" containerName="main" Jul 26 18:46:39.025660 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.025652 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf10f78-3fb8-4c49-ae55-a5dd2333b608" containerName="main" Jul 26 18:46:39.028716 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.028691 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194503728" Jul 26 18:46:39.030884 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.030859 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7h9h5\"" Jul 26 18:46:39.035200 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.035169 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086194503728"] Jul 26 18:46:39.127499 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.127460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6wvs\" (UniqueName: \"kubernetes.io/projected/d0d21298-6016-49f3-a773-3db6ac3c15eb-kube-api-access-z6wvs\") pod \"test-curl-7381-140086194503728\" (UID: \"d0d21298-6016-49f3-a773-3db6ac3c15eb\") " pod="opendatahub/test-curl-7381-140086194503728" Jul 26 18:46:39.228880 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.228837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6wvs\" (UniqueName: \"kubernetes.io/projected/d0d21298-6016-49f3-a773-3db6ac3c15eb-kube-api-access-z6wvs\") pod \"test-curl-7381-140086194503728\" (UID: \"d0d21298-6016-49f3-a773-3db6ac3c15eb\") " pod="opendatahub/test-curl-7381-140086194503728" Jul 26 18:46:39.237741 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.237702 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6wvs\" (UniqueName: \"kubernetes.io/projected/d0d21298-6016-49f3-a773-3db6ac3c15eb-kube-api-access-z6wvs\") pod \"test-curl-7381-140086194503728\" (UID: \"d0d21298-6016-49f3-a773-3db6ac3c15eb\") " pod="opendatahub/test-curl-7381-140086194503728" Jul 26 18:46:39.340690 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.340646 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194503728" Jul 26 18:46:39.482368 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.481823 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086194503728"] Jul 26 18:46:39.487532 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:39.487506 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 26 18:46:40.085760 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:40.085718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086194503728" event={"ID":"d0d21298-6016-49f3-a773-3db6ac3c15eb","Type":"ContainerStarted","Data":"87f44bed4c347e08a40c97910ae5539ae4581cb21d588b7ad784e2a7600bb70c"} Jul 26 18:46:41.092292 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:41.092249 2565 generic.go:356] "Generic (PLEG): container finished" podID="d0d21298-6016-49f3-a773-3db6ac3c15eb" containerID="4fcc73c4cfc5fdb1559f6f7be401f6a127993f457d35fa249ea4f5bd8fda4d1d" exitCode=0 Jul 26 18:46:41.092728 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:41.092351 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086194503728" event={"ID":"d0d21298-6016-49f3-a773-3db6ac3c15eb","Type":"ContainerDied","Data":"4fcc73c4cfc5fdb1559f6f7be401f6a127993f457d35fa249ea4f5bd8fda4d1d"} Jul 26 18:46:42.233866 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.233836 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194503728" Jul 26 18:46:42.253259 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.253233 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-140086194503728_d0d21298-6016-49f3-a773-3db6ac3c15eb/test-curl-7381-140086194503728/0.log" Jul 26 18:46:42.277633 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.277560 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-140086194503728"] Jul 26 18:46:42.279881 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.279853 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-140086194503728"] Jul 26 18:46:42.362547 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.362448 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6wvs\" (UniqueName: \"kubernetes.io/projected/d0d21298-6016-49f3-a773-3db6ac3c15eb-kube-api-access-z6wvs\") pod \"d0d21298-6016-49f3-a773-3db6ac3c15eb\" (UID: \"d0d21298-6016-49f3-a773-3db6ac3c15eb\") " Jul 26 18:46:42.364650 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.364618 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d21298-6016-49f3-a773-3db6ac3c15eb-kube-api-access-z6wvs" (OuterVolumeSpecName: "kube-api-access-z6wvs") pod "d0d21298-6016-49f3-a773-3db6ac3c15eb" (UID: "d0d21298-6016-49f3-a773-3db6ac3c15eb"). InnerVolumeSpecName "kube-api-access-z6wvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:46:42.402845 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.402812 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-140086194507312"] Jul 26 18:46:42.403260 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.403245 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d21298-6016-49f3-a773-3db6ac3c15eb" containerName="test-curl-7381-140086194503728" Jul 26 18:46:42.403308 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.403262 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d21298-6016-49f3-a773-3db6ac3c15eb" containerName="test-curl-7381-140086194503728" Jul 26 18:46:42.403375 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.403363 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d21298-6016-49f3-a773-3db6ac3c15eb" containerName="test-curl-7381-140086194503728" Jul 26 18:46:42.406490 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.406471 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194507312" Jul 26 18:46:42.412542 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.412513 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086194507312"] Jul 26 18:46:42.463686 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.463642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdfsp\" (UniqueName: \"kubernetes.io/projected/75a82582-41d7-46c7-a576-d562ab60a8ce-kube-api-access-fdfsp\") pod \"test-curl-7381-140086194507312\" (UID: \"75a82582-41d7-46c7-a576-d562ab60a8ce\") " pod="opendatahub/test-curl-7381-140086194507312" Jul 26 18:46:42.463874 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.463815 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6wvs\" (UniqueName: \"kubernetes.io/projected/d0d21298-6016-49f3-a773-3db6ac3c15eb-kube-api-access-z6wvs\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:46:42.565383 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.565301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdfsp\" (UniqueName: \"kubernetes.io/projected/75a82582-41d7-46c7-a576-d562ab60a8ce-kube-api-access-fdfsp\") pod \"test-curl-7381-140086194507312\" (UID: \"75a82582-41d7-46c7-a576-d562ab60a8ce\") " pod="opendatahub/test-curl-7381-140086194507312" Jul 26 18:46:42.573064 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.573038 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdfsp\" (UniqueName: \"kubernetes.io/projected/75a82582-41d7-46c7-a576-d562ab60a8ce-kube-api-access-fdfsp\") pod \"test-curl-7381-140086194507312\" (UID: \"75a82582-41d7-46c7-a576-d562ab60a8ce\") " pod="opendatahub/test-curl-7381-140086194507312" Jul 26 18:46:42.717250 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.717160 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194507312" Jul 26 18:46:42.855287 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:42.855246 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086194507312"] Jul 26 18:46:42.858269 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:46:42.858239 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75a82582_41d7_46c7_a576_d562ab60a8ce.slice/crio-e670e7d21ce88ad194b94bd571db24d3f51ec274eed53db45d1bee3dc4bdf764 WatchSource:0}: Error finding container e670e7d21ce88ad194b94bd571db24d3f51ec274eed53db45d1bee3dc4bdf764: Status 404 returned error can't find the container with id e670e7d21ce88ad194b94bd571db24d3f51ec274eed53db45d1bee3dc4bdf764 Jul 26 18:46:43.104287 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:43.104259 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87f44bed4c347e08a40c97910ae5539ae4581cb21d588b7ad784e2a7600bb70c" Jul 26 18:46:43.104287 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:43.104260 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194503728" Jul 26 18:46:43.105579 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:43.105554 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086194507312" event={"ID":"75a82582-41d7-46c7-a576-d562ab60a8ce","Type":"ContainerStarted","Data":"e670e7d21ce88ad194b94bd571db24d3f51ec274eed53db45d1bee3dc4bdf764"} Jul 26 18:46:43.115514 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:46:43.115479 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7381-140086194503728\" is forbidden: User \"system:node:ip-10-0-132-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-146.ec2.internal' and this object" podUID="d0d21298-6016-49f3-a773-3db6ac3c15eb" pod="opendatahub/test-curl-7381-140086194503728" Jul 26 18:46:43.850988 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:43.850951 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d21298-6016-49f3-a773-3db6ac3c15eb" path="/var/lib/kubelet/pods/d0d21298-6016-49f3-a773-3db6ac3c15eb/volumes" Jul 26 18:46:44.113080 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:44.112991 2565 generic.go:356] "Generic (PLEG): container finished" podID="75a82582-41d7-46c7-a576-d562ab60a8ce" containerID="57f40e3afbdab518f53f702c116bb145624d95f3e7a9b8fd43f4d53fbb817a81" exitCode=0 Jul 26 18:46:44.113080 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:44.113035 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086194507312" event={"ID":"75a82582-41d7-46c7-a576-d562ab60a8ce","Type":"ContainerDied","Data":"57f40e3afbdab518f53f702c116bb145624d95f3e7a9b8fd43f4d53fbb817a81"} Jul 26 18:46:45.254405 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.254368 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194507312" Jul 26 18:46:45.276271 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.276236 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-140086194507312_75a82582-41d7-46c7-a576-d562ab60a8ce/test-curl-7381-140086194507312/0.log" Jul 26 18:46:45.299813 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.299766 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-140086194507312"] Jul 26 18:46:45.303432 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.303405 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-140086194507312"] Jul 26 18:46:45.391212 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.391106 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdfsp\" (UniqueName: \"kubernetes.io/projected/75a82582-41d7-46c7-a576-d562ab60a8ce-kube-api-access-fdfsp\") pod \"75a82582-41d7-46c7-a576-d562ab60a8ce\" (UID: \"75a82582-41d7-46c7-a576-d562ab60a8ce\") " Jul 26 18:46:45.395708 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.395653 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75a82582-41d7-46c7-a576-d562ab60a8ce-kube-api-access-fdfsp" (OuterVolumeSpecName: "kube-api-access-fdfsp") pod "75a82582-41d7-46c7-a576-d562ab60a8ce" (UID: "75a82582-41d7-46c7-a576-d562ab60a8ce"). InnerVolumeSpecName "kube-api-access-fdfsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:46:45.467546 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.467503 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:45.468775 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.468747 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75a82582-41d7-46c7-a576-d562ab60a8ce" containerName="test-curl-7381-140086194507312" Jul 26 18:46:45.468926 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.468914 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75a82582-41d7-46c7-a576-d562ab60a8ce" containerName="test-curl-7381-140086194507312" Jul 26 18:46:45.469278 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.469264 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="75a82582-41d7-46c7-a576-d562ab60a8ce" containerName="test-curl-7381-140086194507312" Jul 26 18:46:45.475135 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.475106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:45.479785 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.479747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:45.492865 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.492835 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdfsp\" (UniqueName: \"kubernetes.io/projected/75a82582-41d7-46c7-a576-d562ab60a8ce-kube-api-access-fdfsp\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:46:45.594364 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.594303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtf2f\" (UniqueName: \"kubernetes.io/projected/2df804ae-3e5b-4516-8c00-a82eafe66b0f-kube-api-access-dtf2f\") pod \"test-curl-7381-140086191540096\" (UID: \"2df804ae-3e5b-4516-8c00-a82eafe66b0f\") " pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:45.695192 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.695081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtf2f\" (UniqueName: \"kubernetes.io/projected/2df804ae-3e5b-4516-8c00-a82eafe66b0f-kube-api-access-dtf2f\") pod \"test-curl-7381-140086191540096\" (UID: \"2df804ae-3e5b-4516-8c00-a82eafe66b0f\") " pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:45.703377 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.703340 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtf2f\" (UniqueName: \"kubernetes.io/projected/2df804ae-3e5b-4516-8c00-a82eafe66b0f-kube-api-access-dtf2f\") pod \"test-curl-7381-140086191540096\" (UID: \"2df804ae-3e5b-4516-8c00-a82eafe66b0f\") " pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:45.790468 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.790425 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:45.854884 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.854852 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75a82582-41d7-46c7-a576-d562ab60a8ce" path="/var/lib/kubelet/pods/75a82582-41d7-46c7-a576-d562ab60a8ce/volumes" Jul 26 18:46:45.928437 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:45.928404 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:45.930630 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:46:45.930600 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2df804ae_3e5b_4516_8c00_a82eafe66b0f.slice/crio-210da5205d69757e577751100a3319c49140c19afe5124a49361b5eabd7454ff WatchSource:0}: Error finding container 210da5205d69757e577751100a3319c49140c19afe5124a49361b5eabd7454ff: Status 404 returned error can't find the container with id 210da5205d69757e577751100a3319c49140c19afe5124a49361b5eabd7454ff Jul 26 18:46:46.129151 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:46.129116 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086191540096" event={"ID":"2df804ae-3e5b-4516-8c00-a82eafe66b0f","Type":"ContainerStarted","Data":"210da5205d69757e577751100a3319c49140c19afe5124a49361b5eabd7454ff"} Jul 26 18:46:46.130229 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:46.130206 2565 scope.go:117] "RemoveContainer" containerID="57f40e3afbdab518f53f702c116bb145624d95f3e7a9b8fd43f4d53fbb817a81" Jul 26 18:46:46.130364 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:46.130211 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194507312" Jul 26 18:46:47.136685 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:47.136649 2565 generic.go:356] "Generic (PLEG): container finished" podID="2df804ae-3e5b-4516-8c00-a82eafe66b0f" containerID="c63176ce7d5847165a9d53e524eaf98bd48a6f3d380b97acfcd3831e849bde47" exitCode=0 Jul 26 18:46:47.137090 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:47.136731 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086191540096" event={"ID":"2df804ae-3e5b-4516-8c00-a82eafe66b0f","Type":"ContainerDied","Data":"c63176ce7d5847165a9d53e524eaf98bd48a6f3d380b97acfcd3831e849bde47"} Jul 26 18:46:48.281062 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.281029 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:48.301937 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.301904 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-140086191540096_2df804ae-3e5b-4516-8c00-a82eafe66b0f/test-curl-7381-140086191540096/0.log" Jul 26 18:46:48.327343 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.327277 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:48.332960 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.332928 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:48.422146 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.422036 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtf2f\" (UniqueName: \"kubernetes.io/projected/2df804ae-3e5b-4516-8c00-a82eafe66b0f-kube-api-access-dtf2f\") pod \"2df804ae-3e5b-4516-8c00-a82eafe66b0f\" (UID: \"2df804ae-3e5b-4516-8c00-a82eafe66b0f\") " Jul 26 18:46:48.424191 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.424162 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df804ae-3e5b-4516-8c00-a82eafe66b0f-kube-api-access-dtf2f" (OuterVolumeSpecName: "kube-api-access-dtf2f") pod "2df804ae-3e5b-4516-8c00-a82eafe66b0f" (UID: "2df804ae-3e5b-4516-8c00-a82eafe66b0f"). InnerVolumeSpecName "kube-api-access-dtf2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:46:48.445328 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.445276 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:48.445729 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.445715 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df804ae-3e5b-4516-8c00-a82eafe66b0f" containerName="test-curl-7381-140086191540096" Jul 26 18:46:48.445772 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.445733 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df804ae-3e5b-4516-8c00-a82eafe66b0f" containerName="test-curl-7381-140086191540096" Jul 26 18:46:48.445806 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.445801 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df804ae-3e5b-4516-8c00-a82eafe66b0f" containerName="test-curl-7381-140086191540096" Jul 26 18:46:48.448897 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.448876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:48.455225 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.455169 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:48.523298 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.523259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgx5\" (UniqueName: \"kubernetes.io/projected/2e2fc87c-c183-4125-a4df-f2040367109e-kube-api-access-8sgx5\") pod \"test-curl-7381-140086191540096\" (UID: \"2e2fc87c-c183-4125-a4df-f2040367109e\") " pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:48.523481 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.523427 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtf2f\" (UniqueName: \"kubernetes.io/projected/2df804ae-3e5b-4516-8c00-a82eafe66b0f-kube-api-access-dtf2f\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:46:48.624278 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.624230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgx5\" (UniqueName: \"kubernetes.io/projected/2e2fc87c-c183-4125-a4df-f2040367109e-kube-api-access-8sgx5\") pod \"test-curl-7381-140086191540096\" (UID: \"2e2fc87c-c183-4125-a4df-f2040367109e\") " pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:48.631613 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.631584 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgx5\" (UniqueName: \"kubernetes.io/projected/2e2fc87c-c183-4125-a4df-f2040367109e-kube-api-access-8sgx5\") pod \"test-curl-7381-140086191540096\" (UID: \"2e2fc87c-c183-4125-a4df-f2040367109e\") " pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:48.759670 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.759582 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:48.900352 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:48.900299 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:48.903589 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:46:48.903565 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e2fc87c_c183_4125_a4df_f2040367109e.slice/crio-976d981a97fe4b1f4e64b3598ea53cd370fbdc9f0efe9c9e309ca2c5377b06b7 WatchSource:0}: Error finding container 976d981a97fe4b1f4e64b3598ea53cd370fbdc9f0efe9c9e309ca2c5377b06b7: Status 404 returned error can't find the container with id 976d981a97fe4b1f4e64b3598ea53cd370fbdc9f0efe9c9e309ca2c5377b06b7 Jul 26 18:46:49.150326 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:49.150269 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086191540096" event={"ID":"2e2fc87c-c183-4125-a4df-f2040367109e","Type":"ContainerStarted","Data":"976d981a97fe4b1f4e64b3598ea53cd370fbdc9f0efe9c9e309ca2c5377b06b7"} Jul 26 18:46:49.151458 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:49.151435 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="210da5205d69757e577751100a3319c49140c19afe5124a49361b5eabd7454ff" Jul 26 18:46:49.151580 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:49.151467 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:49.162694 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:49.162656 2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7381-140086191540096" oldPodUID="2df804ae-3e5b-4516-8c00-a82eafe66b0f" podUID="2e2fc87c-c183-4125-a4df-f2040367109e" Jul 26 18:46:49.851629 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:49.851593 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2df804ae-3e5b-4516-8c00-a82eafe66b0f" path="/var/lib/kubelet/pods/2df804ae-3e5b-4516-8c00-a82eafe66b0f/volumes" Jul 26 18:46:50.158208 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:50.158122 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2fc87c-c183-4125-a4df-f2040367109e" containerID="8152e711996e60cd4f7836f4ada1439cd5848bebcfc17c31ab1e2a48fa08c3a6" exitCode=0 Jul 26 18:46:50.158208 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:50.158200 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086191540096" event={"ID":"2e2fc87c-c183-4125-a4df-f2040367109e","Type":"ContainerDied","Data":"8152e711996e60cd4f7836f4ada1439cd5848bebcfc17c31ab1e2a48fa08c3a6"} Jul 26 18:46:51.301884 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.301856 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:51.320037 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.320006 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-140086191540096_2e2fc87c-c183-4125-a4df-f2040367109e/test-curl-7381-140086191540096/0.log" Jul 26 18:46:51.340782 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.340748 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:51.344343 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.344298 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-140086191540096"] Jul 26 18:46:51.451890 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.451791 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sgx5\" (UniqueName: \"kubernetes.io/projected/2e2fc87c-c183-4125-a4df-f2040367109e-kube-api-access-8sgx5\") pod \"2e2fc87c-c183-4125-a4df-f2040367109e\" (UID: \"2e2fc87c-c183-4125-a4df-f2040367109e\") " Jul 26 18:46:51.454036 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.454003 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2fc87c-c183-4125-a4df-f2040367109e-kube-api-access-8sgx5" (OuterVolumeSpecName: "kube-api-access-8sgx5") pod "2e2fc87c-c183-4125-a4df-f2040367109e" (UID: "2e2fc87c-c183-4125-a4df-f2040367109e"). InnerVolumeSpecName "kube-api-access-8sgx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:46:51.468094 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.468064 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:51.468563 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.468549 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2fc87c-c183-4125-a4df-f2040367109e" containerName="test-curl-7381-140086191540096" Jul 26 18:46:51.468632 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.468566 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2fc87c-c183-4125-a4df-f2040367109e" containerName="test-curl-7381-140086191540096" Jul 26 18:46:51.468632 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.468629 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2fc87c-c183-4125-a4df-f2040367109e" containerName="test-curl-7381-140086191540096" Jul 26 18:46:51.471781 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.471762 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:51.478208 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.478181 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:51.552946 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.552903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s98w8\" (UniqueName: \"kubernetes.io/projected/07246405-a575-4b37-81b1-fd272c616a75-kube-api-access-s98w8\") pod \"test-curl-7381-140086194447968\" (UID: \"07246405-a575-4b37-81b1-fd272c616a75\") " pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:51.553127 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.553026 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sgx5\" (UniqueName: \"kubernetes.io/projected/2e2fc87c-c183-4125-a4df-f2040367109e-kube-api-access-8sgx5\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:46:51.653690 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.653646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s98w8\" (UniqueName: \"kubernetes.io/projected/07246405-a575-4b37-81b1-fd272c616a75-kube-api-access-s98w8\") pod \"test-curl-7381-140086194447968\" (UID: \"07246405-a575-4b37-81b1-fd272c616a75\") " pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:51.661071 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.661031 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s98w8\" (UniqueName: \"kubernetes.io/projected/07246405-a575-4b37-81b1-fd272c616a75-kube-api-access-s98w8\") pod \"test-curl-7381-140086194447968\" (UID: \"07246405-a575-4b37-81b1-fd272c616a75\") " pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:51.781915 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.781804 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:51.852073 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.852041 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2fc87c-c183-4125-a4df-f2040367109e" path="/var/lib/kubelet/pods/2e2fc87c-c183-4125-a4df-f2040367109e/volumes" Jul 26 18:46:51.922568 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:51.922541 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:51.924770 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:46:51.924744 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07246405_a575_4b37_81b1_fd272c616a75.slice/crio-01ae2d553b03c791f09f6a7f7114579402ec742ccd003c631615fe9c56dc55c2 WatchSource:0}: Error finding container 01ae2d553b03c791f09f6a7f7114579402ec742ccd003c631615fe9c56dc55c2: Status 404 returned error can't find the container with id 01ae2d553b03c791f09f6a7f7114579402ec742ccd003c631615fe9c56dc55c2 Jul 26 18:46:52.170817 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:52.170772 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086194447968" event={"ID":"07246405-a575-4b37-81b1-fd272c616a75","Type":"ContainerStarted","Data":"01ae2d553b03c791f09f6a7f7114579402ec742ccd003c631615fe9c56dc55c2"} Jul 26 18:46:52.172145 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:52.172121 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086191540096" Jul 26 18:46:52.172145 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:52.172137 2565 scope.go:117] "RemoveContainer" containerID="8152e711996e60cd4f7836f4ada1439cd5848bebcfc17c31ab1e2a48fa08c3a6" Jul 26 18:46:53.179223 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:53.179189 2565 generic.go:356] "Generic (PLEG): container finished" podID="07246405-a575-4b37-81b1-fd272c616a75" containerID="72a4029f33870ad18af1385f8b512ba258683e73d452c0249c3510e88f17cf5e" exitCode=0 Jul 26 18:46:53.179688 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:53.179239 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086194447968" event={"ID":"07246405-a575-4b37-81b1-fd272c616a75","Type":"ContainerDied","Data":"72a4029f33870ad18af1385f8b512ba258683e73d452c0249c3510e88f17cf5e"} Jul 26 18:46:54.327820 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.327782 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:54.346897 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.346867 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-140086194447968_07246405-a575-4b37-81b1-fd272c616a75/test-curl-7381-140086194447968/0.log" Jul 26 18:46:54.372563 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.372523 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:54.375605 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.375569 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:54.479784 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.479676 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s98w8\" (UniqueName: \"kubernetes.io/projected/07246405-a575-4b37-81b1-fd272c616a75-kube-api-access-s98w8\") pod \"07246405-a575-4b37-81b1-fd272c616a75\" (UID: \"07246405-a575-4b37-81b1-fd272c616a75\") " Jul 26 18:46:54.481870 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.481836 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07246405-a575-4b37-81b1-fd272c616a75-kube-api-access-s98w8" (OuterVolumeSpecName: "kube-api-access-s98w8") pod "07246405-a575-4b37-81b1-fd272c616a75" (UID: "07246405-a575-4b37-81b1-fd272c616a75"). InnerVolumeSpecName "kube-api-access-s98w8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:46:54.495516 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.495478 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:54.495975 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.495955 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07246405-a575-4b37-81b1-fd272c616a75" containerName="test-curl-7381-140086194447968" Jul 26 18:46:54.496092 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.495976 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="07246405-a575-4b37-81b1-fd272c616a75" containerName="test-curl-7381-140086194447968" Jul 26 18:46:54.496153 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.496116 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="07246405-a575-4b37-81b1-fd272c616a75" containerName="test-curl-7381-140086194447968" Jul 26 18:46:54.499136 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.499109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:54.508693 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.508663 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:54.581452 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.581412 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s98w8\" (UniqueName: \"kubernetes.io/projected/07246405-a575-4b37-81b1-fd272c616a75-kube-api-access-s98w8\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:46:54.682650 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.682604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trmj5\" (UniqueName: \"kubernetes.io/projected/932da6e3-b8f0-4af4-9c6e-ddb58842ccc2-kube-api-access-trmj5\") pod \"test-curl-7381-140086194447968\" (UID: \"932da6e3-b8f0-4af4-9c6e-ddb58842ccc2\") " pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:54.784264 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.784144 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trmj5\" (UniqueName: \"kubernetes.io/projected/932da6e3-b8f0-4af4-9c6e-ddb58842ccc2-kube-api-access-trmj5\") pod \"test-curl-7381-140086194447968\" (UID: \"932da6e3-b8f0-4af4-9c6e-ddb58842ccc2\") " pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:54.792976 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.792943 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trmj5\" (UniqueName: \"kubernetes.io/projected/932da6e3-b8f0-4af4-9c6e-ddb58842ccc2-kube-api-access-trmj5\") pod \"test-curl-7381-140086194447968\" (UID: \"932da6e3-b8f0-4af4-9c6e-ddb58842ccc2\") " pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:54.809823 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.809786 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:54.952655 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:54.952624 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:54.956483 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:46:54.956444 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod932da6e3_b8f0_4af4_9c6e_ddb58842ccc2.slice/crio-f4dff07c1d44e65cde4a545b75964014f596918db6b6d7d981d77bd64ba4464b WatchSource:0}: Error finding container f4dff07c1d44e65cde4a545b75964014f596918db6b6d7d981d77bd64ba4464b: Status 404 returned error can't find the container with id f4dff07c1d44e65cde4a545b75964014f596918db6b6d7d981d77bd64ba4464b Jul 26 18:46:55.191967 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:55.191934 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:55.192166 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:55.191943 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01ae2d553b03c791f09f6a7f7114579402ec742ccd003c631615fe9c56dc55c2" Jul 26 18:46:55.201465 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:55.201422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086194447968" event={"ID":"932da6e3-b8f0-4af4-9c6e-ddb58842ccc2","Type":"ContainerStarted","Data":"f4dff07c1d44e65cde4a545b75964014f596918db6b6d7d981d77bd64ba4464b"} Jul 26 18:46:55.207206 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:55.207165 2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7381-140086194447968" oldPodUID="07246405-a575-4b37-81b1-fd272c616a75" podUID="932da6e3-b8f0-4af4-9c6e-ddb58842ccc2" Jul 26 18:46:55.852492 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:55.852454 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07246405-a575-4b37-81b1-fd272c616a75" path="/var/lib/kubelet/pods/07246405-a575-4b37-81b1-fd272c616a75/volumes" Jul 26 18:46:56.208938 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:56.208835 2565 generic.go:356] "Generic (PLEG): container finished" podID="932da6e3-b8f0-4af4-9c6e-ddb58842ccc2" containerID="3e236538ee3645c4ce51436585ca7c75e301ad02c59cf33d8925e75474f50b39" exitCode=0 Jul 26 18:46:56.208938 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:56.208879 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-140086194447968" event={"ID":"932da6e3-b8f0-4af4-9c6e-ddb58842ccc2","Type":"ContainerDied","Data":"3e236538ee3645c4ce51436585ca7c75e301ad02c59cf33d8925e75474f50b39"} Jul 26 18:46:57.348456 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.348426 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:57.368970 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.368921 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-140086194447968_932da6e3-b8f0-4af4-9c6e-ddb58842ccc2/test-curl-7381-140086194447968/0.log" Jul 26 18:46:57.391252 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.391211 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:57.395367 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.395331 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-140086194447968"] Jul 26 18:46:57.512501 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.512404 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trmj5\" (UniqueName: \"kubernetes.io/projected/932da6e3-b8f0-4af4-9c6e-ddb58842ccc2-kube-api-access-trmj5\") pod \"932da6e3-b8f0-4af4-9c6e-ddb58842ccc2\" (UID: \"932da6e3-b8f0-4af4-9c6e-ddb58842ccc2\") " Jul 26 18:46:57.514522 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.514495 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/932da6e3-b8f0-4af4-9c6e-ddb58842ccc2-kube-api-access-trmj5" (OuterVolumeSpecName: "kube-api-access-trmj5") pod "932da6e3-b8f0-4af4-9c6e-ddb58842ccc2" (UID: "932da6e3-b8f0-4af4-9c6e-ddb58842ccc2"). InnerVolumeSpecName "kube-api-access-trmj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:46:57.614201 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.614156 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trmj5\" (UniqueName: \"kubernetes.io/projected/932da6e3-b8f0-4af4-9c6e-ddb58842ccc2-kube-api-access-trmj5\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:46:57.851257 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.851221 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="932da6e3-b8f0-4af4-9c6e-ddb58842ccc2" path="/var/lib/kubelet/pods/932da6e3-b8f0-4af4-9c6e-ddb58842ccc2/volumes" Jul 26 18:46:57.883718 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:57.883685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:46:58.222020 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.221937 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-140086194447968" Jul 26 18:46:58.222020 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.221986 2565 scope.go:117] "RemoveContainer" containerID="3e236538ee3645c4ce51436585ca7c75e301ad02c59cf33d8925e75474f50b39" Jul 26 18:46:58.355593 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.355562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:46:58.395514 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.395475 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf"] Jul 26 18:46:58.395899 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.395885 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="932da6e3-b8f0-4af4-9c6e-ddb58842ccc2" containerName="test-curl-7381-140086194447968" Jul 26 18:46:58.395956 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.395901 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="932da6e3-b8f0-4af4-9c6e-ddb58842ccc2" containerName="test-curl-7381-140086194447968" Jul 26 18:46:58.396015 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.396004 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="932da6e3-b8f0-4af4-9c6e-ddb58842ccc2" containerName="test-curl-7381-140086194447968" Jul 26 18:46:58.400539 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.400515 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.405255 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.405228 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-33964c-openshift-default-dockercfg-hls5f\"" Jul 26 18:46:58.405951 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.405932 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 26 18:46:58.420216 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.420175 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf"] Jul 26 18:46:58.520240 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.520149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:46:58.523685 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.523664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-credential-socket\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.523757 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.523703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-certs\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.523800 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.523764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-socket\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.523841 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.523797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-envoy\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.523841 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.523814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-token\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.523841 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.523835 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istiod-ca-cert\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.523956 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.523891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5twr\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-kube-api-access-c5twr\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.524037 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.524014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-podinfo\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.524094 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.524066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-data\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625396 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-socket\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625607 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625421 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-envoy\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625607 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-token\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625607 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istiod-ca-cert\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625607 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5twr\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-kube-api-access-c5twr\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625634 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-podinfo\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-data\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-credential-socket\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625785 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-socket\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.625832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.625825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-certs\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.626119 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.626095 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-data\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.626179 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.626115 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-credential-socket\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.626220 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.626182 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-certs\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.626220 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.626203 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istiod-ca-cert\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.627718 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.627698 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-envoy\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.628000 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.627982 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-podinfo\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.633072 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.633046 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-token\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.633181 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.633169 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5twr\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-kube-api-access-c5twr\") pod \"e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.711389 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.711349 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:46:58.862864 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:58.862832 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf"] Jul 26 18:46:58.864900 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:46:58.864863 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ab9696_733a_47ec_b1d4_9490b34bfb42.slice/crio-bcda76ea2786db6be9c067adfa4ed0659458e7a3eded1b0bb3f701e6eb99e4b8 WatchSource:0}: Error finding container bcda76ea2786db6be9c067adfa4ed0659458e7a3eded1b0bb3f701e6eb99e4b8: Status 404 returned error can't find the container with id bcda76ea2786db6be9c067adfa4ed0659458e7a3eded1b0bb3f701e6eb99e4b8 Jul 26 18:46:59.229894 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:46:59.229791 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" event={"ID":"c7ab9696-733a-47ec-b1d4-9490b34bfb42","Type":"ContainerStarted","Data":"bcda76ea2786db6be9c067adfa4ed0659458e7a3eded1b0bb3f701e6eb99e4b8"} Jul 26 18:47:01.556389 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:01.556348 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 26 18:47:01.556676 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:01.556426 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 26 18:47:01.556676 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:01.556453 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 26 18:47:02.023611 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:02.023534 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:47:02.030529 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:02.030501 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:47:02.035261 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:02.035236 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:47:02.042515 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:02.042484 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:47:02.251868 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:02.251816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" event={"ID":"c7ab9696-733a-47ec-b1d4-9490b34bfb42","Type":"ContainerStarted","Data":"53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41"} Jul 26 18:47:02.272642 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:02.272579 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" podStartSLOduration=1.5835897540000001 podStartE2EDuration="4.272561109s" totalImagesPullingTime="2.688971355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:47:02.271068428 +0000 UTC m=+3000.974795585" watchObservedRunningTime="2026-07-26 18:47:02.272561109 +0000 UTC m=+3000.976288266" Jul 26 18:47:02.712013 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:02.711959 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:47:02.717008 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:02.716974 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:47:03.257780 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:03.257745 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:47:03.258882 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:03.258856 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:47:04.162182 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:04.162144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:04.259155 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:04.259121 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:04.416981 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:04.416900 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:04.902456 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:04.902421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:05.050213 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:05.050178 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:05.150147 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:05.150118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:08.654029 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:08.653991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:16.349835 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:16.349749 2565 generic.go:356] "Generic (PLEG): container finished" podID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerID="53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41" exitCode=0 Jul 26 18:47:16.350305 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:16.349826 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" event={"ID":"c7ab9696-733a-47ec-b1d4-9490b34bfb42","Type":"ContainerDied","Data":"53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41"} Jul 26 18:47:16.350305 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:16.350267 2565 scope.go:117] "RemoveContainer" containerID="53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41" Jul 26 18:47:16.351461 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:16.351425 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 26 18:47:16.351577 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:16.351515 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 26 18:47:16.351577 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:16.351561 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 26 18:47:17.359088 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:17.359049 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" event={"ID":"c7ab9696-733a-47ec-b1d4-9490b34bfb42","Type":"ContainerStarted","Data":"79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349"} Jul 26 18:47:17.716582 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:17.716477 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:47:17.717589 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:17.717559 2565 patch_prober.go:28] interesting pod/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 26 18:47:17.717750 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:17.717619 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 26 18:47:18.258633 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:18.258593 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:47:18.712634 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:18.712592 2565 patch_prober.go:28] interesting pod/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 26 18:47:18.713242 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:18.713211 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 26 18:47:19.574261 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:19.574223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:19.712137 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:19.712098 2565 patch_prober.go:28] interesting pod/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 26 18:47:19.712454 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:19.712425 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 26 18:47:19.868754 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:19.868662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:20.198360 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:20.198236 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:20.711949 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:20.711907 2565 patch_prober.go:28] interesting pod/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 26 18:47:20.712262 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:20.712233 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 26 18:47:21.715680 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:21.715642 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:47:21.716677 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:21.716654 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:47:23.102525 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.102491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:23.185789 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.185754 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf"] Jul 26 18:47:23.190040 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.190011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.192834 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.192801 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 26 18:47:23.193327 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.193294 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-f6bce0-serving-cert\"" Jul 26 18:47:23.193438 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.193306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-96p2z\"" Jul 26 18:47:23.193438 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.193304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 26 18:47:23.200471 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.200426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf"] Jul 26 18:47:23.209581 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.209550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:23.281779 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.281743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-785tw\" (UniqueName: \"kubernetes.io/projected/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-kube-api-access-785tw\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.281779 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.281784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.282022 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.281925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.283615 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.283589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:23.383185 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.383093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.383185 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.383149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-785tw\" (UniqueName: \"kubernetes.io/projected/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-kube-api-access-785tw\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.383435 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.383276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.383967 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.383946 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.385694 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.385670 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.390292 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.390264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:23.392216 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.392191 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-785tw\" (UniqueName: \"kubernetes.io/projected/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-kube-api-access-785tw\") pod \"maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.503038 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.502996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:23.654277 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.654246 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf"] Jul 26 18:47:23.656435 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:47:23.656405 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf7b0a0_4676_4a90_aa10_e2a73c08f86c.slice/crio-b2e25d82428403ee4bf1aa70b5fc8aee3c378d6891f31ed38f1184e8211683d9 WatchSource:0}: Error finding container b2e25d82428403ee4bf1aa70b5fc8aee3c378d6891f31ed38f1184e8211683d9: Status 404 returned error can't find the container with id b2e25d82428403ee4bf1aa70b5fc8aee3c378d6891f31ed38f1184e8211683d9 Jul 26 18:47:23.810765 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.810730 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:23.913779 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:23.913697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:24.399991 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:24.399946 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" event={"ID":"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c","Type":"ContainerStarted","Data":"b2e25d82428403ee4bf1aa70b5fc8aee3c378d6891f31ed38f1184e8211683d9"} Jul 26 18:47:26.413452 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:26.413415 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" event={"ID":"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c","Type":"ContainerStarted","Data":"c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd"} Jul 26 18:47:26.413968 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:26.413528 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:26.429276 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:26.429219 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" podStartSLOduration=1.36653449 podStartE2EDuration="3.429203543s" totalImagesPullingTime="2.062669053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:47:26.428156661 +0000 UTC m=+3025.131883821" watchObservedRunningTime="2026-07-26 18:47:26.429203543 +0000 UTC m=+3025.132930701" Jul 26 18:47:27.563528 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:27.563478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:47:32.424415 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:32.424376 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:47:59.958243 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:47:59.958156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:12.002814 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:12.002773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:40.145508 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:40.145464 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:40.442790 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:40.442690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:40.978139 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:40.978084 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:43.519435 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.519396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:43.620181 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.620147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:43.724124 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.724078 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65"] Jul 26 18:48:43.727737 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.727715 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.729789 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.729767 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-786276-serving-cert\"" Jul 26 18:48:43.735602 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.735195 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65"] Jul 26 18:48:43.750386 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.750340 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:43.886900 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.886862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/803d00c2-519d-4f46-a544-74c2cd98b8b6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.886900 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.886907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/803d00c2-519d-4f46-a544-74c2cd98b8b6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.887156 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.887009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22q5l\" (UniqueName: \"kubernetes.io/projected/803d00c2-519d-4f46-a544-74c2cd98b8b6-kube-api-access-22q5l\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.942696 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.942661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:43.988595 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.988558 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/803d00c2-519d-4f46-a544-74c2cd98b8b6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.988844 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.988604 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/803d00c2-519d-4f46-a544-74c2cd98b8b6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.988844 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.988770 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22q5l\" (UniqueName: \"kubernetes.io/projected/803d00c2-519d-4f46-a544-74c2cd98b8b6-kube-api-access-22q5l\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.989518 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.989497 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/803d00c2-519d-4f46-a544-74c2cd98b8b6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.991139 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.991118 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/803d00c2-519d-4f46-a544-74c2cd98b8b6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:43.996773 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:43.996741 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22q5l\" (UniqueName: \"kubernetes.io/projected/803d00c2-519d-4f46-a544-74c2cd98b8b6-kube-api-access-22q5l\") pod \"maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:44.040606 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:44.040566 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:44.185352 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:44.182808 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65"] Jul 26 18:48:44.213477 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:44.213440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:44.309500 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:44.309465 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:44.840061 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:44.839951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" event={"ID":"803d00c2-519d-4f46-a544-74c2cd98b8b6","Type":"ContainerStarted","Data":"101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52"} Jul 26 18:48:44.840061 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:44.840025 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:48:44.840061 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:44.840048 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" event={"ID":"803d00c2-519d-4f46-a544-74c2cd98b8b6","Type":"ContainerStarted","Data":"c054320efe4465e14132f757b3e106be8effa3f998fc8aee18e94018f7625637"} Jul 26 18:48:44.855751 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:44.855694 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" podStartSLOduration=1.473446007 podStartE2EDuration="1.855676843s" totalImagesPullingTime="382.230836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:48:44.854758492 +0000 UTC m=+3103.558485651" watchObservedRunningTime="2026-07-26 18:48:44.855676843 +0000 UTC m=+3103.559404001" Jul 26 18:48:47.990704 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:47.990667 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:48:50.851260 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:48:50.851226 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:49:09.292803 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.292764 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65"] Jul 26 18:49:09.293264 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.293015 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" podUID="803d00c2-519d-4f46-a544-74c2cd98b8b6" containerName="maas-api" containerID="cri-o://101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52" gracePeriod=30 Jul 26 18:49:09.325284 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.325253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:09.402152 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.402113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:09.465047 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.465002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:09.556017 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.555992 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:49:09.636669 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.636638 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/803d00c2-519d-4f46-a544-74c2cd98b8b6-maas-api-tls\") pod \"803d00c2-519d-4f46-a544-74c2cd98b8b6\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " Jul 26 18:49:09.636841 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.636704 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22q5l\" (UniqueName: \"kubernetes.io/projected/803d00c2-519d-4f46-a544-74c2cd98b8b6-kube-api-access-22q5l\") pod \"803d00c2-519d-4f46-a544-74c2cd98b8b6\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " Jul 26 18:49:09.636903 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.636857 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/803d00c2-519d-4f46-a544-74c2cd98b8b6-openshift-service-ca\") pod \"803d00c2-519d-4f46-a544-74c2cd98b8b6\" (UID: \"803d00c2-519d-4f46-a544-74c2cd98b8b6\") " Jul 26 18:49:09.637190 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.637160 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803d00c2-519d-4f46-a544-74c2cd98b8b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "803d00c2-519d-4f46-a544-74c2cd98b8b6" (UID: "803d00c2-519d-4f46-a544-74c2cd98b8b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:49:09.639003 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.638975 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/803d00c2-519d-4f46-a544-74c2cd98b8b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "803d00c2-519d-4f46-a544-74c2cd98b8b6" (UID: "803d00c2-519d-4f46-a544-74c2cd98b8b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:49:09.639093 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.639018 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803d00c2-519d-4f46-a544-74c2cd98b8b6-kube-api-access-22q5l" (OuterVolumeSpecName: "kube-api-access-22q5l") pod "803d00c2-519d-4f46-a544-74c2cd98b8b6" (UID: "803d00c2-519d-4f46-a544-74c2cd98b8b6"). InnerVolumeSpecName "kube-api-access-22q5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:49:09.738147 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.738101 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/803d00c2-519d-4f46-a544-74c2cd98b8b6-openshift-service-ca\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:49:09.738147 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.738139 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/803d00c2-519d-4f46-a544-74c2cd98b8b6-maas-api-tls\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:49:09.738147 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.738151 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22q5l\" (UniqueName: \"kubernetes.io/projected/803d00c2-519d-4f46-a544-74c2cd98b8b6-kube-api-access-22q5l\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:49:09.981121 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.981082 2565 generic.go:356] "Generic (PLEG): container finished" podID="803d00c2-519d-4f46-a544-74c2cd98b8b6" containerID="101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52" exitCode=0 Jul 26 18:49:09.981297 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.981141 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" Jul 26 18:49:09.981297 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.981168 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" event={"ID":"803d00c2-519d-4f46-a544-74c2cd98b8b6","Type":"ContainerDied","Data":"101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52"} Jul 26 18:49:09.981297 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.981226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65" event={"ID":"803d00c2-519d-4f46-a544-74c2cd98b8b6","Type":"ContainerDied","Data":"c054320efe4465e14132f757b3e106be8effa3f998fc8aee18e94018f7625637"} Jul 26 18:49:09.981297 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.981252 2565 scope.go:117] "RemoveContainer" containerID="101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52" Jul 26 18:49:09.990634 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.990611 2565 scope.go:117] "RemoveContainer" containerID="101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52" Jul 26 18:49:09.990920 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:49:09.990896 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52\": container with ID starting with 101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52 not found: ID does not exist" containerID="101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52" Jul 26 18:49:09.991022 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.990927 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52"} err="failed to get container status \"101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52\": rpc error: code = NotFound desc = could not find container \"101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52\": container with ID starting with 101997b9a60b3f49206d81ef555585f0517b8f06c62e97b909df1fb9e9513b52 not found: ID does not exist" Jul 26 18:49:09.995985 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:09.995958 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65"] Jul 26 18:49:10.001851 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:10.001825 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-786276-667959848b-z6p65"] Jul 26 18:49:11.851980 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:11.851946 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803d00c2-519d-4f46-a544-74c2cd98b8b6" path="/var/lib/kubelet/pods/803d00c2-519d-4f46-a544-74c2cd98b8b6/volumes" Jul 26 18:49:13.964308 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:13.964273 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:14.356260 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:14.356225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:20.132482 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:20.132436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:20.186992 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:20.186943 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:20.380160 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:20.380126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:20.609141 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:20.609105 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:39.383153 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:39.383113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:39.452929 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:39.452874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:39.553059 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:39.553022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:44.021966 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:44.021930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:44.392006 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:44.391965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:48.107193 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.107153 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxqxk"] Jul 26 18:49:48.107622 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.107607 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803d00c2-519d-4f46-a544-74c2cd98b8b6" containerName="maas-api" Jul 26 18:49:48.107622 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.107623 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="803d00c2-519d-4f46-a544-74c2cd98b8b6" containerName="maas-api" Jul 26 18:49:48.107697 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.107688 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="803d00c2-519d-4f46-a544-74c2cd98b8b6" containerName="maas-api" Jul 26 18:49:48.110825 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.110810 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:48.113304 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.113281 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mr68s\"" Jul 26 18:49:48.119997 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.119969 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxqxk"] Jul 26 18:49:48.215367 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.215306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwnsg\" (UniqueName: \"kubernetes.io/projected/a8afe79c-4a16-44b1-ae24-9b0a93440b9e-kube-api-access-vwnsg\") pod \"kuadrant-operator-catalog-zxqxk\" (UID: \"a8afe79c-4a16-44b1-ae24-9b0a93440b9e\") " pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:48.316231 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.316185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnsg\" (UniqueName: \"kubernetes.io/projected/a8afe79c-4a16-44b1-ae24-9b0a93440b9e-kube-api-access-vwnsg\") pod \"kuadrant-operator-catalog-zxqxk\" (UID: \"a8afe79c-4a16-44b1-ae24-9b0a93440b9e\") " pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:48.324945 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.324916 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwnsg\" (UniqueName: \"kubernetes.io/projected/a8afe79c-4a16-44b1-ae24-9b0a93440b9e-kube-api-access-vwnsg\") pod \"kuadrant-operator-catalog-zxqxk\" (UID: \"a8afe79c-4a16-44b1-ae24-9b0a93440b9e\") " pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:48.421280 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.421178 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:48.557409 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:48.557382 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxqxk"] Jul 26 18:49:48.559553 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:49:48.559527 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8afe79c_4a16_44b1_ae24_9b0a93440b9e.slice/crio-9772f8055397fcd90576d21579cd7b59a33ef59232af69d758c1e6877893dcb9 WatchSource:0}: Error finding container 9772f8055397fcd90576d21579cd7b59a33ef59232af69d758c1e6877893dcb9: Status 404 returned error can't find the container with id 9772f8055397fcd90576d21579cd7b59a33ef59232af69d758c1e6877893dcb9 Jul 26 18:49:49.197367 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:49.197306 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" event={"ID":"a8afe79c-4a16-44b1-ae24-9b0a93440b9e","Type":"ContainerStarted","Data":"9772f8055397fcd90576d21579cd7b59a33ef59232af69d758c1e6877893dcb9"} Jul 26 18:49:49.471796 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:49.471733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:49:51.211089 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:51.211053 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" event={"ID":"a8afe79c-4a16-44b1-ae24-9b0a93440b9e","Type":"ContainerStarted","Data":"ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717"} Jul 26 18:49:51.227562 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:51.227514 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" podStartSLOduration=1.123772622 podStartE2EDuration="3.22749806s" totalImagesPullingTime="2.103725438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:49:51.224629012 +0000 UTC m=+3169.928356169" watchObservedRunningTime="2026-07-26 18:49:51.22749806 +0000 UTC m=+3169.931225218" Jul 26 18:49:58.422408 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:58.422364 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:58.422932 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:58.422428 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:58.444760 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:58.444722 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:59.276629 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:59.276598 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:49:59.314306 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:49:59.314261 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxqxk"] Jul 26 18:50:01.264619 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:01.264578 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" podUID="a8afe79c-4a16-44b1-ae24-9b0a93440b9e" containerName="registry-server" containerID="cri-o://ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717" gracePeriod=2 Jul 26 18:50:01.523084 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:01.523015 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:50:01.658165 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:01.658119 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwnsg\" (UniqueName: \"kubernetes.io/projected/a8afe79c-4a16-44b1-ae24-9b0a93440b9e-kube-api-access-vwnsg\") pod \"a8afe79c-4a16-44b1-ae24-9b0a93440b9e\" (UID: \"a8afe79c-4a16-44b1-ae24-9b0a93440b9e\") " Jul 26 18:50:01.660179 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:01.660155 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8afe79c-4a16-44b1-ae24-9b0a93440b9e-kube-api-access-vwnsg" (OuterVolumeSpecName: "kube-api-access-vwnsg") pod "a8afe79c-4a16-44b1-ae24-9b0a93440b9e" (UID: "a8afe79c-4a16-44b1-ae24-9b0a93440b9e"). InnerVolumeSpecName "kube-api-access-vwnsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:50:01.759454 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:01.759410 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwnsg\" (UniqueName: \"kubernetes.io/projected/a8afe79c-4a16-44b1-ae24-9b0a93440b9e-kube-api-access-vwnsg\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:02.271592 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.271550 2565 generic.go:356] "Generic (PLEG): container finished" podID="a8afe79c-4a16-44b1-ae24-9b0a93440b9e" containerID="ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717" exitCode=0 Jul 26 18:50:02.272096 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.271599 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" Jul 26 18:50:02.272096 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.271637 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" event={"ID":"a8afe79c-4a16-44b1-ae24-9b0a93440b9e","Type":"ContainerDied","Data":"ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717"} Jul 26 18:50:02.272096 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.271693 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxqxk" event={"ID":"a8afe79c-4a16-44b1-ae24-9b0a93440b9e","Type":"ContainerDied","Data":"9772f8055397fcd90576d21579cd7b59a33ef59232af69d758c1e6877893dcb9"} Jul 26 18:50:02.272096 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.271713 2565 scope.go:117] "RemoveContainer" containerID="ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717" Jul 26 18:50:02.281519 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.281495 2565 scope.go:117] "RemoveContainer" containerID="ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717" Jul 26 18:50:02.281811 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:50:02.281793 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717\": container with ID starting with ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717 not found: ID does not exist" containerID="ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717" Jul 26 18:50:02.281869 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.281819 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717"} err="failed to get container status \"ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717\": rpc error: code = NotFound desc = could not find container \"ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717\": container with ID starting with ff6cb868c11f02d58dd68f0ece325e665bbc2b018986698e535ba07aeb65f717 not found: ID does not exist" Jul 26 18:50:02.292986 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.292951 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxqxk"] Jul 26 18:50:02.296368 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:02.296339 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxqxk"] Jul 26 18:50:03.850714 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:03.850679 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8afe79c-4a16-44b1-ae24-9b0a93440b9e" path="/var/lib/kubelet/pods/a8afe79c-4a16-44b1-ae24-9b0a93440b9e/volumes" Jul 26 18:50:15.195914 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:15.195878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:26.372429 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:26.372396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:26.781876 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:26.781782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:32.340375 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:32.340343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:32.404023 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:32.403980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:32.587377 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:32.587337 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf"] Jul 26 18:50:32.587578 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:32.587556 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" containerID="cri-o://79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349" gracePeriod=30 Jul 26 18:50:32.610732 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:32.610642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:32.840860 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:32.840822 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:36.718684 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:36.718650 2565 patch_prober.go:28] interesting pod/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 26 18:50:36.719170 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:36.718710 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 26 18:50:37.852377 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:37.852284 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:50:38.023497 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023456 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istiod-ca-cert\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.023719 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023533 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-token\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.023719 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023592 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-envoy\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.023719 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023623 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-credential-socket\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.023719 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023641 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-data\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.023719 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023674 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-podinfo\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.023719 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023691 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-certs\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.024046 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023728 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5twr\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-kube-api-access-c5twr\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.024046 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023747 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-socket\") pod \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\" (UID: \"c7ab9696-733a-47ec-b1d4-9490b34bfb42\") " Jul 26 18:50:38.024046 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023892 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:50:38.024046 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.023948 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:50:38.024254 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.024119 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:50:38.024254 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.024132 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:50:38.024431 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.024392 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-credential-socket\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.024597 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.024582 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-certs\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.024669 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.024649 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-workload-socket\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.024730 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.024670 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istiod-ca-cert\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.024794 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.024736 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:50:38.026213 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.026185 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:50:38.026352 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.026292 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-kube-api-access-c5twr" (OuterVolumeSpecName: "kube-api-access-c5twr") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "kube-api-access-c5twr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:50:38.026413 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.026390 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 26 18:50:38.026456 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.026444 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7ab9696-733a-47ec-b1d4-9490b34bfb42" (UID: "c7ab9696-733a-47ec-b1d4-9490b34bfb42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 26 18:50:38.125562 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.125469 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-token\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.125562 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.125503 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-envoy\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.125562 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.125511 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-data\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.125562 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.125520 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7ab9696-733a-47ec-b1d4-9490b34bfb42-istio-podinfo\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.125562 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.125529 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5twr\" (UniqueName: \"kubernetes.io/projected/c7ab9696-733a-47ec-b1d4-9490b34bfb42-kube-api-access-c5twr\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:38.465392 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.465275 2565 generic.go:356] "Generic (PLEG): container finished" podID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerID="79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349" exitCode=0 Jul 26 18:50:38.465392 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.465347 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" Jul 26 18:50:38.465392 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.465362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" event={"ID":"c7ab9696-733a-47ec-b1d4-9490b34bfb42","Type":"ContainerDied","Data":"79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349"} Jul 26 18:50:38.465636 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.465422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf" event={"ID":"c7ab9696-733a-47ec-b1d4-9490b34bfb42","Type":"ContainerDied","Data":"bcda76ea2786db6be9c067adfa4ed0659458e7a3eded1b0bb3f701e6eb99e4b8"} Jul 26 18:50:38.465636 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.465444 2565 scope.go:117] "RemoveContainer" containerID="79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349" Jul 26 18:50:38.476096 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.476073 2565 scope.go:117] "RemoveContainer" containerID="53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41" Jul 26 18:50:38.490832 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.490807 2565 scope.go:117] "RemoveContainer" containerID="79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349" Jul 26 18:50:38.491195 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:50:38.491171 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349\": container with ID starting with 79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349 not found: ID does not exist" containerID="79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349" Jul 26 18:50:38.491270 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.491202 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349"} err="failed to get container status \"79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349\": rpc error: code = NotFound desc = could not find container \"79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349\": container with ID starting with 79b671857da7ba07bff134586e4ba3ecf9eb8e7d96e4dad352223d7efdc0e349 not found: ID does not exist" Jul 26 18:50:38.491270 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.491221 2565 scope.go:117] "RemoveContainer" containerID="53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41" Jul 26 18:50:38.491496 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:50:38.491476 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41\": container with ID starting with 53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41 not found: ID does not exist" containerID="53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41" Jul 26 18:50:38.491555 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.491502 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41"} err="failed to get container status \"53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41\": rpc error: code = NotFound desc = could not find container \"53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41\": container with ID starting with 53c99dc81ee93aa3dd10482c4845a368923c8bbf0b5ccf3896cb8646f3f25c41 not found: ID does not exist" Jul 26 18:50:38.492014 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.491989 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf"] Jul 26 18:50:38.494959 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:38.494924 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-33964c-openshift-default-5c9c898f4-bshbf"] Jul 26 18:50:39.850331 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:39.850289 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" path="/var/lib/kubelet/pods/c7ab9696-733a-47ec-b1d4-9490b34bfb42/volumes" Jul 26 18:50:43.424620 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.424577 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf"] Jul 26 18:50:43.425045 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.424861 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" podUID="dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" containerName="maas-api" containerID="cri-o://c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd" gracePeriod=30 Jul 26 18:50:43.480262 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.480231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:43.601506 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.601469 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:43.686118 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.686042 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:50:43.703909 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.703875 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:43.780782 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.780746 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-maas-api-tls\") pod \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " Jul 26 18:50:43.780997 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.780805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-785tw\" (UniqueName: \"kubernetes.io/projected/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-kube-api-access-785tw\") pod \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " Jul 26 18:50:43.780997 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.780874 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-openshift-service-ca\") pod \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\" (UID: \"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c\") " Jul 26 18:50:43.781229 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.781198 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" (UID: "dbf7b0a0-4676-4a90-aa10-e2a73c08f86c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 26 18:50:43.782981 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.782950 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-kube-api-access-785tw" (OuterVolumeSpecName: "kube-api-access-785tw") pod "dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" (UID: "dbf7b0a0-4676-4a90-aa10-e2a73c08f86c"). InnerVolumeSpecName "kube-api-access-785tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 26 18:50:43.783094 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.782991 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" (UID: "dbf7b0a0-4676-4a90-aa10-e2a73c08f86c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 26 18:50:43.881748 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.881709 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-openshift-service-ca\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:43.881748 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.881743 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-maas-api-tls\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:43.881748 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:43.881755 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-785tw\" (UniqueName: \"kubernetes.io/projected/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c-kube-api-access-785tw\") on node \"ip-10-0-132-146.ec2.internal\" DevicePath \"\"" Jul 26 18:50:44.501919 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.501884 2565 generic.go:356] "Generic (PLEG): container finished" podID="dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" containerID="c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd" exitCode=0 Jul 26 18:50:44.502365 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.501951 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" Jul 26 18:50:44.502365 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.501976 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" event={"ID":"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c","Type":"ContainerDied","Data":"c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd"} Jul 26 18:50:44.502365 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.502073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf" event={"ID":"dbf7b0a0-4676-4a90-aa10-e2a73c08f86c","Type":"ContainerDied","Data":"b2e25d82428403ee4bf1aa70b5fc8aee3c378d6891f31ed38f1184e8211683d9"} Jul 26 18:50:44.502365 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.502103 2565 scope.go:117] "RemoveContainer" containerID="c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd" Jul 26 18:50:44.512013 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.511987 2565 scope.go:117] "RemoveContainer" containerID="c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd" Jul 26 18:50:44.512377 ip-10-0-132-146 kubenswrapper[2565]: E0726 18:50:44.512355 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd\": container with ID starting with c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd not found: ID does not exist" containerID="c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd" Jul 26 18:50:44.512436 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.512389 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd"} err="failed to get container status \"c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd\": rpc error: code = NotFound desc = could not find container \"c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd\": container with ID starting with c5d9e485ee745236d05a42262d546d7749199885f9155fa9575b2b69b516d5dd not found: ID does not exist" Jul 26 18:50:44.518408 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.518376 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf"] Jul 26 18:50:44.520556 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:44.520530 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6bce0-85858f85b4-8zscf"] Jul 26 18:50:45.851692 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:45.851653 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" path="/var/lib/kubelet/pods/dbf7b0a0-4676-4a90-aa10-e2a73c08f86c/volumes" Jul 26 18:50:48.023933 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:48.023899 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:48.408010 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:48.407947 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:53.920551 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:53.920518 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:54.023338 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:54.023289 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:54.225252 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:54.225157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:54.325754 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:54.325668 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:54.477187 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:54.477073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:50:54.704340 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:50:54.704282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:05.298151 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:05.298097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:05.369812 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:05.369777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:05.427840 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:05.427806 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:09.929293 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:09.929253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:10.307308 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:10.307281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:16.349458 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:16.349405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:16.449988 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:16.449951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:16.605960 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:16.605872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:16.837950 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:16.837915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:25.991083 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:25.991050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:26.088047 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:26.088016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:27.384536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:27.384505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:27.461998 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:27.461961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:27.517712 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:27.517680 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:32.018253 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:32.018214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:32.389389 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:32.389355 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:38.368277 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:38.368241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:39.233266 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:39.233232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b59589b68-bntkj_bb86282a-89cd-45ce-a76e-9bf0aabb55a5/authorino/0.log" Jul 26 18:51:39.496757 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:39.496671 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:44.659084 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:44.659052 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sxvxg_f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe/server/0.log" Jul 26 18:51:44.769707 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:44.769674 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-d5x5v_ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18/manager/0.log" Jul 26 18:51:44.876105 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:44.876070 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cc94bb6c-5gzng_72301901-b909-43fb-94de-4b78522c1699/copy-manifests/0.log" Jul 26 18:51:44.882346 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:44.882305 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cc94bb6c-5gzng_72301901-b909-43fb-94de-4b78522c1699/manager/0.log" Jul 26 18:51:47.105370 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:47.105332 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b59589b68-bntkj_bb86282a-89cd-45ce-a76e-9bf0aabb55a5/authorino/0.log" Jul 26 18:51:47.435102 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:47.435023 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mbgh6_99a3f27a-436e-46e3-ae45-b0fd8b01a34a/kuadrant-console-plugin/0.log" Jul 26 18:51:48.546577 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:48.546546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-679f49c568-j7cq2_2d16840f-e5b6-423c-9c76-a927dd6dbd02/kube-auth-proxy/0.log" Jul 26 18:51:48.998865 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:48.998838 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f857c88c9-62tnm_c83ddb99-6686-41e6-85c7-33e298be9ecd/router/0.log" Jul 26 18:51:49.319662 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:49.319631 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pvvnq_88ac0942-58eb-4693-ad9b-9222edfc007f/main/0.log" Jul 26 18:51:49.424633 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:49.424602 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-98c4t_053b03bf-1e35-4ee1-89eb-8dbab08ccd9d/main/0.log" Jul 26 18:51:49.858467 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:49.858436 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-k869w_0032c294-df19-4e16-901c-8ae3cd20d972/main/0.log" Jul 26 18:51:54.885056 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885013 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lz7b2/must-gather-9rz95"] Jul 26 18:51:54.885455 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885436 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" containerName="maas-api" Jul 26 18:51:54.885455 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885448 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" containerName="maas-api" Jul 26 18:51:54.885536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885466 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" Jul 26 18:51:54.885536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885472 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" Jul 26 18:51:54.885536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885488 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" Jul 26 18:51:54.885536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885494 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" Jul 26 18:51:54.885536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885505 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8afe79c-4a16-44b1-ae24-9b0a93440b9e" containerName="registry-server" Jul 26 18:51:54.885536 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885510 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8afe79c-4a16-44b1-ae24-9b0a93440b9e" containerName="registry-server" Jul 26 18:51:54.885725 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885566 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" Jul 26 18:51:54.885725 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885574 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8afe79c-4a16-44b1-ae24-9b0a93440b9e" containerName="registry-server" Jul 26 18:51:54.885725 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885580 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ab9696-733a-47ec-b1d4-9490b34bfb42" containerName="istio-proxy" Jul 26 18:51:54.885725 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.885588 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbf7b0a0-4676-4a90-aa10-e2a73c08f86c" containerName="maas-api" Jul 26 18:51:54.888798 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.888781 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7b2/must-gather-9rz95" Jul 26 18:51:54.890957 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.890937 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lz7b2\"/\"default-dockercfg-chqtw\"" Jul 26 18:51:54.891081 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.890993 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lz7b2\"/\"openshift-service-ca.crt\"" Jul 26 18:51:54.891081 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.891005 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lz7b2\"/\"kube-root-ca.crt\"" Jul 26 18:51:54.896936 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.896912 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7b2/must-gather-9rz95"] Jul 26 18:51:54.897227 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.897204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:54.956628 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.956593 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" limit=1024 Jul 26 18:51:54.974867 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.974831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhmr2\" (UniqueName: \"kubernetes.io/projected/d5b8112f-1072-41a5-b1a0-a81c6134f090-kube-api-access-lhmr2\") pod \"must-gather-9rz95\" (UID: \"d5b8112f-1072-41a5-b1a0-a81c6134f090\") " pod="openshift-must-gather-lz7b2/must-gather-9rz95" Jul 26 18:51:54.974958 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:54.974883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d5b8112f-1072-41a5-b1a0-a81c6134f090-must-gather-output\") pod \"must-gather-9rz95\" (UID: \"d5b8112f-1072-41a5-b1a0-a81c6134f090\") " pod="openshift-must-gather-lz7b2/must-gather-9rz95" Jul 26 18:51:55.075706 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:55.075664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmr2\" (UniqueName: \"kubernetes.io/projected/d5b8112f-1072-41a5-b1a0-a81c6134f090-kube-api-access-lhmr2\") pod \"must-gather-9rz95\" (UID: \"d5b8112f-1072-41a5-b1a0-a81c6134f090\") " pod="openshift-must-gather-lz7b2/must-gather-9rz95" Jul 26 18:51:55.075909 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:55.075717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d5b8112f-1072-41a5-b1a0-a81c6134f090-must-gather-output\") pod \"must-gather-9rz95\" (UID: \"d5b8112f-1072-41a5-b1a0-a81c6134f090\") " pod="openshift-must-gather-lz7b2/must-gather-9rz95" Jul 26 18:51:55.076061 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:55.076045 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d5b8112f-1072-41a5-b1a0-a81c6134f090-must-gather-output\") pod \"must-gather-9rz95\" (UID: \"d5b8112f-1072-41a5-b1a0-a81c6134f090\") " pod="openshift-must-gather-lz7b2/must-gather-9rz95" Jul 26 18:51:55.090632 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:55.090603 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhmr2\" (UniqueName: \"kubernetes.io/projected/d5b8112f-1072-41a5-b1a0-a81c6134f090-kube-api-access-lhmr2\") pod \"must-gather-9rz95\" (UID: \"d5b8112f-1072-41a5-b1a0-a81c6134f090\") " pod="openshift-must-gather-lz7b2/must-gather-9rz95" Jul 26 18:51:55.200042 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:55.199944 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7b2/must-gather-9rz95" Jul 26 18:51:55.339187 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:55.339156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7b2/must-gather-9rz95"] Jul 26 18:51:55.341258 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:51:55.341227 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5b8112f_1072_41a5_b1a0_a81c6134f090.slice/crio-8f6899b4b1cc2b0647f2a90e70e86dfb5e56f469d34dd93b4220bd0c47142169 WatchSource:0}: Error finding container 8f6899b4b1cc2b0647f2a90e70e86dfb5e56f469d34dd93b4220bd0c47142169: Status 404 returned error can't find the container with id 8f6899b4b1cc2b0647f2a90e70e86dfb5e56f469d34dd93b4220bd0c47142169 Jul 26 18:51:55.343012 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:55.342995 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 26 18:51:55.879823 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:55.879789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7b2/must-gather-9rz95" event={"ID":"d5b8112f-1072-41a5-b1a0-a81c6134f090","Type":"ContainerStarted","Data":"8f6899b4b1cc2b0647f2a90e70e86dfb5e56f469d34dd93b4220bd0c47142169"} Jul 26 18:51:56.888233 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:56.888194 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7b2/must-gather-9rz95" event={"ID":"d5b8112f-1072-41a5-b1a0-a81c6134f090","Type":"ContainerStarted","Data":"79641987a37a00de4385c14da726947dde6f1002de9b9be916b34b6812f4429e"} Jul 26 18:51:56.888705 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:56.888247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7b2/must-gather-9rz95" event={"ID":"d5b8112f-1072-41a5-b1a0-a81c6134f090","Type":"ContainerStarted","Data":"c80f77b71cb140efc85022de873b3236212dfe2a94aaa8a2e71367c245a2daf2"} Jul 26 18:51:57.837909 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:57.837877 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9fwzm_72aecfd4-b021-4785-b203-12a59b056341/global-pull-secret-syncer/0.log" Jul 26 18:51:57.892530 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:57.892494 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4tsn4_3410ab75-f3e5-4f19-9d4e-a3d256b2528f/konnectivity-agent/0.log" Jul 26 18:51:57.981295 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:51:57.981262 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-146.ec2.internal_2d355a552e2e9bb7fc5a4bd746d646b8/haproxy/0.log" Jul 26 18:52:02.120335 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:02.119833 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:52:02.139001 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:02.138969 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:52:02.145115 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:02.145033 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:52:02.162211 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:02.162182 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnltj_06548e45-656c-46dd-9e46-f5433e0cfd27/ovn-acl-logging/0.log" Jul 26 18:52:03.350334 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:03.349629 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b59589b68-bntkj_bb86282a-89cd-45ce-a76e-9bf0aabb55a5/authorino/0.log" Jul 26 18:52:03.460997 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:03.460956 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mbgh6_99a3f27a-436e-46e3-ae45-b0fd8b01a34a/kuadrant-console-plugin/0.log" Jul 26 18:52:05.442616 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.442531 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e70b788-46c3-4b7b-829e-3404f0becf8d/alertmanager/0.log" Jul 26 18:52:05.466606 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.466579 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e70b788-46c3-4b7b-829e-3404f0becf8d/config-reloader/0.log" Jul 26 18:52:05.495575 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.495545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e70b788-46c3-4b7b-829e-3404f0becf8d/kube-rbac-proxy-web/0.log" Jul 26 18:52:05.520656 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.520613 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e70b788-46c3-4b7b-829e-3404f0becf8d/kube-rbac-proxy/0.log" Jul 26 18:52:05.555043 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.555012 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e70b788-46c3-4b7b-829e-3404f0becf8d/kube-rbac-proxy-metric/0.log" Jul 26 18:52:05.579793 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.579757 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e70b788-46c3-4b7b-829e-3404f0becf8d/prom-label-proxy/0.log" Jul 26 18:52:05.603074 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.603041 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e70b788-46c3-4b7b-829e-3404f0becf8d/init-config-reloader/0.log" Jul 26 18:52:05.651189 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.651149 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-pb2wt_121c3677-1b02-4b04-b32d-214d58e2bbcc/cluster-monitoring-operator/0.log" Jul 26 18:52:05.752948 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.752848 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-556b86c4f9-5cflt_ba80182c-b644-42e7-8215-dba94c05cb9d/metrics-server/0.log" Jul 26 18:52:05.780061 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.780031 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-9fcwl_e27ec3ec-a80d-4413-8f0b-7644b621fdd6/monitoring-plugin/0.log" Jul 26 18:52:05.980203 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:05.980174 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcwvb_fdd8e7e3-6b47-46bb-ae1f-555765c9336d/node-exporter/0.log" Jul 26 18:52:06.006481 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.006383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcwvb_fdd8e7e3-6b47-46bb-ae1f-555765c9336d/kube-rbac-proxy/0.log" Jul 26 18:52:06.036781 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.036744 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcwvb_fdd8e7e3-6b47-46bb-ae1f-555765c9336d/init-textfile/0.log" Jul 26 18:52:06.075015 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.074981 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9n85m_fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36/kube-rbac-proxy-main/0.log" Jul 26 18:52:06.098962 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.098922 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9n85m_fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36/kube-rbac-proxy-self/0.log" Jul 26 18:52:06.134334 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.133961 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9n85m_fbbb5b02-b7d9-4cc5-abdb-a1c9d2791b36/openshift-state-metrics/0.log" Jul 26 18:52:06.428811 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.428786 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c4bd7fbdb-btcf5_f74080fb-356a-44ed-bd8d-38bee3fa4c07/telemeter-client/0.log" Jul 26 18:52:06.457727 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.457693 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c4bd7fbdb-btcf5_f74080fb-356a-44ed-bd8d-38bee3fa4c07/reload/0.log" Jul 26 18:52:06.484143 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.484075 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c4bd7fbdb-btcf5_f74080fb-356a-44ed-bd8d-38bee3fa4c07/kube-rbac-proxy/0.log" Jul 26 18:52:06.515920 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.515884 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/thanos-query/0.log" Jul 26 18:52:06.538604 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.538573 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/kube-rbac-proxy-web/0.log" Jul 26 18:52:06.562230 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.562193 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/kube-rbac-proxy/0.log" Jul 26 18:52:06.585779 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.585741 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/prom-label-proxy/0.log" Jul 26 18:52:06.615155 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.615120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/kube-rbac-proxy-rules/0.log" Jul 26 18:52:06.638138 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:06.638110 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97d7c8db5-nz2ct_b3df0c6a-871c-439f-9558-3cd7ec7cc05b/kube-rbac-proxy-metrics/0.log" Jul 26 18:52:07.792379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:07.792301 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-kjvrd_0ad9951d-4903-4f6d-a3f6-37facf6c7bca/networking-console-plugin/0.log" Jul 26 18:52:08.245815 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.245742 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lz7b2/must-gather-9rz95" podStartSLOduration=13.399216957 podStartE2EDuration="14.245717314s" totalImagesPullingTime="846.500357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:51:56.903176062 +0000 UTC m=+3295.606903220" watchObservedRunningTime="2026-07-26 18:52:08.245717314 +0000 UTC m=+3306.949444472" Jul 26 18:52:08.246038 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.245918 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk"] Jul 26 18:52:08.252274 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.252241 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.258367 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.258306 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk"] Jul 26 18:52:08.337197 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.337158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-proc\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.337197 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.337205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-876t4\" (UniqueName: \"kubernetes.io/projected/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-kube-api-access-876t4\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.337494 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.337261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-lib-modules\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.337494 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.337289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-sys\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.337494 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.337371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-podres\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.438819 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.438779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-lib-modules\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.439028 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.438833 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-sys\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.439028 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.438918 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-podres\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.439028 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.438944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-proc\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.439028 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.438959 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-sys\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.439028 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.438977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876t4\" (UniqueName: \"kubernetes.io/projected/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-kube-api-access-876t4\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.439028 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.438979 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-lib-modules\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.439454 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.439152 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-podres\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.439454 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.439179 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-proc\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.454432 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.454386 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-876t4\" (UniqueName: \"kubernetes.io/projected/cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb-kube-api-access-876t4\") pod \"perf-node-gather-daemonset-sf8zk\" (UID: \"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.490485 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.490447 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/2.log" Jul 26 18:52:08.496445 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.496303 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4nzlj_f9809214-22c8-4990-a8f4-770a1d3a989f/console-operator/3.log" Jul 26 18:52:08.567274 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.567222 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:08.770291 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.769635 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk"] Jul 26 18:52:08.775912 ip-10-0-132-146 kubenswrapper[2565]: W0726 18:52:08.775880 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcccf6c85_b5f8_4d0d_85d2_70cd6b94adcb.slice/crio-f6d1fdf3068933ac6214050cea63c75ba2b6c9c64c8bcb011eaafb476f2d1f8e WatchSource:0}: Error finding container f6d1fdf3068933ac6214050cea63c75ba2b6c9c64c8bcb011eaafb476f2d1f8e: Status 404 returned error can't find the container with id f6d1fdf3068933ac6214050cea63c75ba2b6c9c64c8bcb011eaafb476f2d1f8e Jul 26 18:52:08.992261 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.992215 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" event={"ID":"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb","Type":"ContainerStarted","Data":"9fa9b69593efebb59394cc33a6ca502cddf37a4b454bb49ee580abb8a8615723"} Jul 26 18:52:08.992764 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.992287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" event={"ID":"cccf6c85-b5f8-4d0d-85d2-70cd6b94adcb","Type":"ContainerStarted","Data":"f6d1fdf3068933ac6214050cea63c75ba2b6c9c64c8bcb011eaafb476f2d1f8e"} Jul 26 18:52:08.992764 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:08.992363 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:09.007192 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:09.007121 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" podStartSLOduration=1.007097347 podStartE2EDuration="1.007097347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 18:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:52:09.006533643 +0000 UTC m=+3307.710260803" watchObservedRunningTime="2026-07-26 18:52:09.007097347 +0000 UTC m=+3307.710824506" Jul 26 18:52:09.111217 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:09.111181 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66f465cd6b-8vjmg_965033dc-ee96-4d41-9744-1394bd7f2317/console/0.log" Jul 26 18:52:09.150945 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:09.150910 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-ggt62_d18545ef-1ed3-4b33-bc0d-5f7eeeb9effd/download-server/0.log" Jul 26 18:52:09.772302 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:09.772263 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-m4p9b_042bc1d4-f728-4fc0-a339-2e11ef9aafc8/volume-data-source-validator/0.log" Jul 26 18:52:10.871803 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:10.871773 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l5qjb_e4af50be-8015-404c-88fa-aada2c84ac2d/dns/0.log" Jul 26 18:52:10.895216 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:10.895180 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l5qjb_e4af50be-8015-404c-88fa-aada2c84ac2d/kube-rbac-proxy/0.log" Jul 26 18:52:11.002546 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:11.002518 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hggld_f216a66e-0611-4d7e-b7ab-6bf977bbfd6c/dns-node-resolver/0.log" Jul 26 18:52:11.576706 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:11.576671 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lzgg_a74e93c1-e880-4b9d-abdc-ec56742fbf45/node-ca/0.log" Jul 26 18:52:12.784366 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:12.784284 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-679f49c568-j7cq2_2d16840f-e5b6-423c-9c76-a927dd6dbd02/kube-auth-proxy/0.log" Jul 26 18:52:12.933375 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:12.933342 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f857c88c9-62tnm_c83ddb99-6686-41e6-85c7-33e298be9ecd/router/0.log" Jul 26 18:52:13.790472 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:13.790441 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nk55l_7f7b1fdf-f32a-4f3e-b0ed-292ca16e86ba/serve-healthcheck-canary/0.log" Jul 26 18:52:14.271853 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:14.271822 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-mnrvx_d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8/insights-operator/0.log" Jul 26 18:52:14.274379 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:14.274349 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-mnrvx_d73f1bb8-ea92-47d1-ba5d-c5bdaf2789c8/insights-operator/1.log" Jul 26 18:52:14.295306 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:14.295276 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79l7x_70672d52-fcf2-4127-8521-9da6ff5b2066/kube-rbac-proxy/0.log" Jul 26 18:52:14.317810 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:14.317776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79l7x_70672d52-fcf2-4127-8521-9da6ff5b2066/exporter/0.log" Jul 26 18:52:14.339933 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:14.339904 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79l7x_70672d52-fcf2-4127-8521-9da6ff5b2066/extractor/0.log" Jul 26 18:52:15.011006 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:15.010975 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-sf8zk" Jul 26 18:52:17.037595 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:17.037556 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sxvxg_f3cf2d67-d9b4-4d47-a5bc-26234df7b1fe/server/0.log" Jul 26 18:52:17.132454 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:17.132338 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-d5x5v_ad836a39-a7e5-4bb4-b1c6-88e0a54b2a18/manager/0.log" Jul 26 18:52:17.160214 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:17.160185 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cc94bb6c-5gzng_72301901-b909-43fb-94de-4b78522c1699/manager/0.log" Jul 26 18:52:17.187176 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:17.187149 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cc94bb6c-5gzng_72301901-b909-43fb-94de-4b78522c1699/copy-manifests/0.log" Jul 26 18:52:18.742491 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:18.742392 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b54d88cb5-ctm4g_5082057d-4b1b-49d8-8ae7-1c3a47f50ae2/manager/0.log" Jul 26 18:52:19.057100 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:19.057065 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-679f49c568-j7cq2_2d16840f-e5b6-423c-9c76-a927dd6dbd02/kube-auth-proxy/0.log" Jul 26 18:52:19.165603 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:19.165568 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f857c88c9-62tnm_c83ddb99-6686-41e6-85c7-33e298be9ecd/router/0.log" Jul 26 18:52:20.780759 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:20.780679 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-679f49c568-j7cq2_2d16840f-e5b6-423c-9c76-a927dd6dbd02/kube-auth-proxy/0.log" Jul 26 18:52:20.895737 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:20.895708 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f857c88c9-62tnm_c83ddb99-6686-41e6-85c7-33e298be9ecd/router/0.log" Jul 26 18:52:24.280926 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:24.280843 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-4v229_b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7/kube-storage-version-migrator-operator/1.log" Jul 26 18:52:24.281851 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:24.281826 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-4v229_b08b35c0-05aa-4fd4-a0aa-f76ea3c3e9f7/kube-storage-version-migrator-operator/0.log" Jul 26 18:52:25.276145 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:25.276116 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cprtz_5e57a9e8-4895-42a4-a68d-6345eb478fa5/kube-multus-additional-cni-plugins/0.log" Jul 26 18:52:25.300724 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:25.300699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cprtz_5e57a9e8-4895-42a4-a68d-6345eb478fa5/egress-router-binary-copy/0.log" Jul 26 18:52:25.323919 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:25.323892 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cprtz_5e57a9e8-4895-42a4-a68d-6345eb478fa5/cni-plugins/0.log" Jul 26 18:52:25.345277 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:25.345250 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cprtz_5e57a9e8-4895-42a4-a68d-6345eb478fa5/bond-cni-plugin/0.log" Jul 26 18:52:25.366523 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:25.366496 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cprtz_5e57a9e8-4895-42a4-a68d-6345eb478fa5/routeoverride-cni/0.log" Jul 26 18:52:25.388714 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:25.388688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cprtz_5e57a9e8-4895-42a4-a68d-6345eb478fa5/whereabouts-cni-bincopy/0.log" Jul 26 18:52:25.413411 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:25.413382 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cprtz_5e57a9e8-4895-42a4-a68d-6345eb478fa5/whereabouts-cni/0.log" Jul 26 18:52:25.810844 ip-10-0-132-146 kubenswrapper[2565]: I0726 18:52:25.810803 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pmdlc_fe8643d5-c142-43a1-8f9c-0169e832ef5a/kube-multus/0.log"