Jul 14 10:00:28.474444 ip-10-0-132-174 systemd[1]: Starting Kubernetes Kubelet... Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.785625 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789479 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789491 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789494 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789498 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789501 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789503 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789507 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:28.904493 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789510 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:28.855141 ip-10-0-132-174 systemd[1]: Started Kubernetes Kubelet. Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789515 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789518 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789520 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789523 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789526 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789528 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789531 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789533 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789536 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789539 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789541 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789550 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789552 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789555 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789558 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789561 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789564 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789567 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789569 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:28.905498 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789572 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789575 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789578 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789581 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789585 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789589 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789592 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789594 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789598 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789600 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789603 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789606 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789610 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789613 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789616 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789620 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789622 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789625 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789628 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:28.906328 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789630 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789633 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789635 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789638 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789641 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789644 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789646 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789649 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789652 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789655 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789660 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789663 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789665 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789668 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789670 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789673 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789676 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789678 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789680 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:28.907364 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789683 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789685 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789689 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789691 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789695 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789697 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789700 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789703 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789705 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789709 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789712 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789715 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789718 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789720 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789723 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789726 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789728 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789730 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789733 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789736 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:28.908342 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789739 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789741 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789744 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789747 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789749 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789752 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789755 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789757 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789760 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789763 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789765 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789768 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789770 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.789773 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790495 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790504 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790507 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790510 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790514 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:28.909513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790517 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790520 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790523 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790526 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790530 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790533 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790535 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790539 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790541 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790544 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790547 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790550 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790553 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790555 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790558 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790561 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790563 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790566 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790569 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:28.910501 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790572 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790575 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790577 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790580 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790583 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790585 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790588 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790590 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790593 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790596 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790599 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790601 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790604 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790607 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790610 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790612 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790615 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790617 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790621 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790624 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:28.911608 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790626 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790628 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790631 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790633 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790636 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790638 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790641 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790643 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790645 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790648 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790650 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790653 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790656 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790658 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790661 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790663 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790666 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790669 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790671 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790674 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:28.912616 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790676 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790679 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790683 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790687 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790691 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790693 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790696 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790699 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790701 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790704 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790709 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790712 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790714 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790717 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790719 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790722 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790724 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790727 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790730 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:28.913688 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790734 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790737 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790740 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790742 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790745 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790748 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790750 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790753 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790756 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790759 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790761 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790764 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790766 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790769 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790771 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.790774 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791118 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791123 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791126 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:28.914448 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791130 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791134 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791137 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791139 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791143 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791146 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791149 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791152 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791154 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791157 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791160 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791177 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791180 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791183 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791186 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791188 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791191 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791194 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791196 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:28.915291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791199 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791201 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791204 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791207 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791209 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791214 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791217 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791220 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791222 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791225 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791228 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791230 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791232 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791235 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791237 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791240 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791243 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791247 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791249 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791252 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:28.916347 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791255 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791257 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791260 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791264 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791267 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791270 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791273 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791275 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791277 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791280 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791282 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791285 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791288 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791290 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791293 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791295 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791298 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791302 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791304 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791307 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:28.917844 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791309 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791312 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791314 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791317 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791319 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791322 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791324 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791327 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791329 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791333 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791335 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791339 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791343 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791346 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791348 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791351 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791353 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791356 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791358 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791360 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:28.918411 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791363 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791365 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791368 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791370 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791373 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791375 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791377 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791381 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791383 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791387 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791390 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791393 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791395 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791398 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791400 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791403 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.791405 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791474 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791480 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791487 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791491 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 10:00:28.919017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791497 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791500 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791504 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791508 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791512 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791515 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791519 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791522 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791525 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791528 2565 flags.go:64] FLAG: --cgroup-root="" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791531 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791534 2565 flags.go:64] FLAG: --client-ca-file="" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791536 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791539 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791544 2565 flags.go:64] FLAG: --cluster-domain="" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791547 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791550 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791553 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791556 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791560 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791564 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791567 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791570 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791573 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 14 10:00:28.919635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791577 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791580 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791583 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791586 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791589 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791592 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791595 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791598 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791602 2565 flags.go:64] FLAG: --enable-server="true" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791605 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791609 2565 flags.go:64] FLAG: --event-burst="100" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791612 2565 flags.go:64] FLAG: --event-qps="50" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791615 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791618 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791621 2565 flags.go:64] FLAG: --eviction-hard="" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791625 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791628 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791631 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791634 2565 flags.go:64] FLAG: --eviction-soft="" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791637 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791639 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791642 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791645 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791648 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791651 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 10:00:28.920301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791654 2565 flags.go:64] FLAG: --feature-gates="" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791657 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791660 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791664 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791667 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791670 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791673 2565 flags.go:64] FLAG: --help="false" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791676 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-132-174.ec2.internal" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791679 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791682 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791685 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791688 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791691 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791694 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791697 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791702 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791704 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791707 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791710 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791713 2565 flags.go:64] FLAG: --kube-reserved="" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791716 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791719 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791722 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791725 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 10:00:28.921106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791728 2565 flags.go:64] FLAG: --lock-file="" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791731 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791734 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791737 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791742 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791745 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791747 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791750 2565 flags.go:64] FLAG: --logging-format="text" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791753 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791756 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791759 2565 flags.go:64] FLAG: --manifest-url="" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791763 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791767 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791770 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791773 2565 flags.go:64] FLAG: --max-pods="110" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791776 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791779 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791782 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791785 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791788 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791790 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791793 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791800 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791804 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791807 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 10:00:28.921810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791810 2565 flags.go:64] FLAG: --pod-cidr="" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791813 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791818 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791821 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791824 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791827 2565 flags.go:64] FLAG: --port="10250" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791830 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791833 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b2d1a68b2f2eb29" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791836 2565 flags.go:64] FLAG: --qos-reserved="" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791839 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791841 2565 flags.go:64] FLAG: --register-node="true" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791844 2565 flags.go:64] FLAG: --register-with-taints="" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791848 2565 flags.go:64] FLAG: --registry-burst="10" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791851 2565 flags.go:64] FLAG: --registry-qps="5" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791853 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791856 2565 flags.go:64] FLAG: --reserved-memory="" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791860 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791863 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791866 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791870 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791873 2565 flags.go:64] FLAG: --runonce="false" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791875 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791878 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791882 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791884 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 10:00:28.922906 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791887 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791890 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791893 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791896 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791899 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791903 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791906 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791909 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791912 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791915 2565 flags.go:64] FLAG: --system-cgroups="" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791918 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791923 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791926 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791929 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791933 2565 flags.go:64] FLAG: --tls-min-version="" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791936 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791939 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791942 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791944 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791947 2565 flags.go:64] FLAG: --v="2" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791951 2565 flags.go:64] FLAG: --version="false" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791955 2565 flags.go:64] FLAG: --vmodule="" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791958 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.791961 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792069 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:29.077799 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792073 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792077 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792080 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792083 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792086 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792089 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792092 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792095 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792098 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792100 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792103 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792106 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792110 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792114 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792118 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792121 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792123 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792126 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792129 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:29.101344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792132 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792134 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792137 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792140 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792142 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792145 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792147 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792150 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792152 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792155 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792157 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792176 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792179 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792181 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792187 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792190 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792194 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792198 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792201 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792204 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:29.101955 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792206 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792209 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792211 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792214 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792217 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792221 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792223 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792226 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792228 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792231 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792234 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792236 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792239 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792242 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792244 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792247 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792250 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792253 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792255 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792258 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792260 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:29.102519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792263 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792265 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792268 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792271 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792273 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792277 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792279 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792282 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792284 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792287 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792289 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792292 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792294 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792297 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792299 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792302 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792306 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792309 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792311 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792314 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:29.103134 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792316 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792319 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792321 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792324 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792326 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792329 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792331 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792334 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792337 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792339 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792341 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792344 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792347 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792349 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792351 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792354 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792357 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:29.103703 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.792363 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.792368 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.802282 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.802296 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.802319 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.802325 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802380 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802385 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802389 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802392 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802395 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802398 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802401 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802404 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802406 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:29.104225 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802409 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802411 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802414 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802416 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802419 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802422 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802424 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802427 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802430 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802433 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802435 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802438 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802442 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802445 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802448 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802450 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802454 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802457 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802460 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802463 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:29.104652 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802465 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802468 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802470 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802474 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802478 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802481 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802484 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802487 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802489 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802492 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802495 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802498 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802501 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802503 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802506 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802508 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802511 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802514 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802516 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802520 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:29.105244 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802525 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802528 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802530 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802533 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802535 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802538 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802540 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802543 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802546 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802549 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802551 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802554 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802556 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802559 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802561 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802564 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802566 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802569 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802572 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:29.105777 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802574 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802579 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802582 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802585 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802588 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802590 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802593 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802596 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802598 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802601 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802603 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802607 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802611 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802615 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802617 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802620 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802622 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802625 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:29.106340 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802628 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802630 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802633 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802635 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802638 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802640 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802643 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802646 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802648 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802651 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802653 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802656 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802658 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.802663 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802772 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:29.106828 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802777 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802781 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802784 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802787 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802789 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802792 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802794 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802797 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802799 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802802 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802804 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802808 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802813 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802816 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802818 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802821 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802823 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802826 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802829 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802831 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:29.107291 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802834 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802836 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802839 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802841 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802844 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802846 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802849 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802852 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802856 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802859 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802862 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802864 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802867 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802870 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802873 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802875 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802878 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802880 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802882 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:29.107878 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802885 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802887 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802890 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802892 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802894 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802900 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802903 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802906 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802908 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802911 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802913 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802916 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802918 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802921 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802923 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802926 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802928 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802931 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802934 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802936 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:29.108509 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802938 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802941 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802943 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802946 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802948 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802951 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802954 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802956 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802958 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802961 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802963 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802966 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802970 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802973 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802976 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802979 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802981 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802987 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802991 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802994 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:29.109560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.802997 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803000 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803003 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803006 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803009 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803012 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803014 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803017 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803019 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803022 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803024 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803027 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803029 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803031 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803034 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803037 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803040 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803043 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:29.110184 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:28.803045 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.803050 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.803142 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.805774 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.807189 2565 server.go:1019] "Starting client certificate rotation" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.807280 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.807323 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.809273 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.813072 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.824741 2565 log.go:25] "Validated CRI v1 runtime API" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.826583 2565 log.go:25] "Validated CRI v1 image API" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.827290 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 10:00:29.110777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.829977 2565 fs.go:135] Filesystem UUIDs: map[79f18e85-b867-49fb-85ab-09c97709e3e0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9c56bd0b-ef85-443c-9437-dbf1af1d657c:/dev/nvme0n1p3] Jul 14 10:00:29.111199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.829992 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 10:00:30.428586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.834531 2565 manager.go:216] Machine: {Timestamp:2026-07-14 10:00:28.833438498 +0000 UTC m=+0.259225466 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099120 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d3c137ff5d882840d75706b69a6b9 SystemUUID:ec2d3c13-7ff5-d882-840d-75706b69a6b9 BootID:28ef36bb-b594-48bd-942f-b589c2e337e3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a2:38:b6:84:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a2:38:b6:84:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:06:f9:64:1f:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 10:00:30.428586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.834634 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 10:00:30.428586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.834705 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 10:00:30.428586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.834910 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 10:00:30.428586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.836724 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 10:00:30.428586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.836744 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 10:00:30.428586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.837293 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.837302 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.837311 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.837324 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.838020 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.841597 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.841706 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.841731 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.841739 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.841758 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.841766 2565 kubelet.go:398] "Adding apiserver pod source" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.841774 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.842677 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.842726 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.844975 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.849861 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.849911 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850574 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850588 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850593 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850600 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850612 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850621 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850632 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850638 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850644 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850650 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850663 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.850669 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.851222 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.851229 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.852741 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.852789 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.852833 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-174.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.854373 2565 server.go:1268] "Started kubelet" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.854447 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.854484 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.854546 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.855738 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 10:00:30.429412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.856137 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.859073 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.861676 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-77r98" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.861849 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.862260 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.862813 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.862822 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.864544 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.864595 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.864600 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.865025 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.865570 2565 factory.go:55] Registering systemd factory Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.865581 2565 factory.go:223] Registration of the systemd container factory successfully Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.865746 2565 factory.go:153] Registering CRI-O factory Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.865757 2565 factory.go:223] Registration of the crio container factory successfully Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.865799 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.865822 2565 factory.go:103] Registering Raw factory Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.865834 2565 manager.go:1196] Started watching for new ooms in manager Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.866359 2565 manager.go:349] Starting recovery of all containers Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.867779 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.867897 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.867741 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-174.ec2.internal.18c21facaae8ab94 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-174.ec2.internal,UID:ip-10-0-132-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-174.ec2.internal,},FirstTimestamp:2026-07-14 10:00:28.854348692 +0000 UTC m=+0.280135660,LastTimestamp:2026-07-14 10:00:28.854348692 +0000 UTC m=+0.280135660,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-174.ec2.internal,}" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.869916 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-77r98" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.884439 2565 manager.go:354] Recovery completed Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.888415 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.890118 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.890143 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.890156 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.891109 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.891118 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.891120 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.891132 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 14 10:00:30.432435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.891745 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.891770 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.891779 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.892288 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-174.ec2.internal.18c21facad0ab2c1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-174.ec2.internal,UID:ip-10-0-132-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-174.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-174.ec2.internal,},FirstTimestamp:2026-07-14 10:00:28.890133185 +0000 UTC m=+0.315920152,LastTimestamp:2026-07-14 10:00:28.890133185 +0000 UTC m=+0.315920152,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-174.ec2.internal,}" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.893118 2565 policy_none.go:49] "None policy: Start" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.893131 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.893158 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.895078 2565 policy_none.go:47] "Start" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.929637 2565 manager.go:337] "Starting Device Plugin manager" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.929780 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.929795 2565 server.go:87] "Starting device plugin registration server" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.929972 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.929982 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.930090 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.930190 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:28.930199 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.930610 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:28.930657 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.013713 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.015128 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.015176 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.015194 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:29.015229 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.016978 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.030712 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.032002 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.032028 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.032037 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.032057 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.038769 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:29.038785 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-174.ec2.internal\": node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:29.053105 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.116304 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal"] Jul 14 10:00:30.433439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.116363 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.117574 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.117601 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.117611 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.119736 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.119848 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.119877 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.120369 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.120386 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.120398 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.120411 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.120432 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.120442 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.122450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.122470 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.123769 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.123789 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:29.123798 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.297691 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-174.ec2.internal\" not found" node="ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.298265 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.302234 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-174.ec2.internal\" not found" node="ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.311948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/152fe7020801273832f641be20083d11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal\" (UID: \"152fe7020801273832f641be20083d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.311968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/152fe7020801273832f641be20083d11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal\" (UID: \"152fe7020801273832f641be20083d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.311993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92b85bf11686fc7c45eaff1c12525158-config\") pod \"kube-apiserver-proxy-ip-10-0-132-174.ec2.internal\" (UID: \"92b85bf11686fc7c45eaff1c12525158\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.398773 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.435106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.413098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/152fe7020801273832f641be20083d11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal\" (UID: \"152fe7020801273832f641be20083d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.413119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/152fe7020801273832f641be20083d11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal\" (UID: \"152fe7020801273832f641be20083d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.413135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92b85bf11686fc7c45eaff1c12525158-config\") pod \"kube-apiserver-proxy-ip-10-0-132-174.ec2.internal\" (UID: \"92b85bf11686fc7c45eaff1c12525158\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.413161 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92b85bf11686fc7c45eaff1c12525158-config\") pod \"kube-apiserver-proxy-ip-10-0-132-174.ec2.internal\" (UID: \"92b85bf11686fc7c45eaff1c12525158\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.413186 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/152fe7020801273832f641be20083d11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal\" (UID: \"152fe7020801273832f641be20083d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.435820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.413194 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/152fe7020801273832f641be20083d11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal\" (UID: \"152fe7020801273832f641be20083d11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.575238 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.499505 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.705036 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.600059 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.705036 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.600078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.705036 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.605120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" Jul 14 10:00:30.705036 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.700933 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.865334 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.801426 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.982183 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:30.901964 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:30.982183 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.950545 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:30.982183 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.951503 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 10:00:30.982183 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:30.951600 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 10:00:31.098211 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:31.002896 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:31.098211 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.019938 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 09:55:30 +0000 UTC" deadline="2028-02-12 13:20:47.362947079 +0000 UTC" Jul 14 10:00:31.098211 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.019978 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13875h20m16.342973633s" Jul 14 10:00:31.103944 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:31.103193 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:31.213875 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.131962 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:31.213875 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:31.204233 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:31.336022 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:31.304685 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-174.ec2.internal\" not found" Jul 14 10:00:31.466367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.386432 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:31.466367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.410363 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" Jul 14 10:00:31.466367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.420256 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 10:00:31.466367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.421254 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" Jul 14 10:00:31.466367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.426810 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 10:00:31.987670 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.987646 2565 apiserver.go:52] "Watching apiserver" Jul 14 10:00:31.995477 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.995459 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 10:00:31.995840 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.995819 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf","openshift-cluster-node-tuning-operator/tuned-szvlr","openshift-dns/node-resolver-59prv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal","openshift-multus/multus-additional-cni-plugins-8p96k","openshift-multus/multus-zrq9s","openshift-multus/network-metrics-daemon-srlpr","kube-system/global-pull-secret-syncer-xpr87","kube-system/konnectivity-agent-52qm2","openshift-image-registry/node-ca-84gh2","openshift-network-diagnostics/network-check-target-wzhrp","openshift-network-operator/iptables-alerter-68btj","openshift-ovn-kubernetes/ovnkube-node-tvrkr"] Jul 14 10:00:31.998402 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:31.998386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.000379 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.000364 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.000915 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.000899 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 10:00:32.001091 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.001077 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 10:00:32.001149 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.001131 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 10:00:32.001305 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.001294 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 10:00:32.001415 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.001396 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f76jh\"" Jul 14 10:00:32.002446 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.002427 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.002606 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.002589 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pbtjm\"" Jul 14 10:00:32.002759 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.002730 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 10:00:32.002874 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.002790 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 10:00:32.003178 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.003163 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 10:00:32.004520 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.004504 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.004603 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.004536 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:32.004872 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.004859 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qnj4b\"" Jul 14 10:00:32.004936 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.004917 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:32.006822 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.006804 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.006887 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.006824 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 10:00:32.006887 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.006848 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 10:00:32.006986 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.006968 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tzllq\"" Jul 14 10:00:32.006986 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.006980 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 10:00:32.009302 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.009282 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 10:00:32.009302 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.009297 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 10:00:32.009302 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.009304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 10:00:32.009859 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.009839 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.011365 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.010404 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 10:00:32.011365 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.010610 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 10:00:32.011365 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.010948 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 10:00:32.011365 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.011023 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n8bmq\"" Jul 14 10:00:32.012789 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.012769 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 10:00:32.012896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.012805 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lgk6s\"" Jul 14 10:00:32.012896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.012814 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 10:00:32.012896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.012831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.013031 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.012918 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:32.015095 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.015078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.017537 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.017517 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:32.017537 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.017532 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:32.017663 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.017604 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 10:00:32.017663 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.017532 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fv9tt\"" Jul 14 10:00:32.017892 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.017874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.020058 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020038 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:32.020150 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020075 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6scfq\"" Jul 14 10:00:32.020150 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-kubernetes\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.020150 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f7fe55-838d-4326-9739-d50cc4a3a5e4-tmp-dir\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.020150 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-kubelet\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.020347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysctl-conf\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.020347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eda10369-431b-4312-98e7-d6031fd0c935-etc-tuned\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.020347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-cni-bin\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.020347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-cni-bin\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.020347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-var-lib-kubelet\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovn-node-metrics-cert\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-hostroot\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020379 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86629999-84ab-47b1-9be3-b8f50ec4f85c-cni-binary-copy\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-sys\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-daemon-config\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020455 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020478 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h92gp\" (UniqueName: \"kubernetes.io/projected/66f7fe55-838d-4326-9739-d50cc4a3a5e4-kube-api-access-h92gp\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysconfig\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eda10369-431b-4312-98e7-d6031fd0c935-tmp\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020518 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 10:00:32.020590 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-var-lib-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-k8s-cni-cncf-io\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-conf-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbmvg\" (UniqueName: \"kubernetes.io/projected/503f535e-db88-4ef7-a6ec-c2979b447832-kube-api-access-bbmvg\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-systemd\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020767 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-host\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jlrd\" (UniqueName: \"kubernetes.io/projected/eda10369-431b-4312-98e7-d6031fd0c935-kube-api-access-9jlrd\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-slash\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-cni-netd\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/503f535e-db88-4ef7-a6ec-c2979b447832-serviceca\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-node-log\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-system-cni-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.020990 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-cnibin\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2n9\" (UniqueName: \"kubernetes.io/projected/a43b79a4-508a-4578-9e30-f71adbdd3bd1-kube-api-access-8b2n9\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-socket-dir-parent\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-kubelet\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021055 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-os-release\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021069 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-os-release\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-cni-multus\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-run-netns\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/503f535e-db88-4ef7-a6ec-c2979b447832-host\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-etc-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-env-overrides\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-netns\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.021563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjxhn\" (UniqueName: \"kubernetes.io/projected/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-kube-api-access-wjxhn\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysctl-d\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021266 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-run\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovnkube-config\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-system-cni-dir\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cnibin\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mdcj\" (UniqueName: \"kubernetes.io/projected/86629999-84ab-47b1-9be3-b8f50ec4f85c-kube-api-access-6mdcj\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-modprobe-d\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-lib-modules\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021411 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-systemd\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021435 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-multus-certs\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66f7fe55-838d-4326-9739-d50cc4a3a5e4-hosts-file\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.022081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-systemd-units\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-ovn\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-log-socket\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovnkube-script-lib\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-cni-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.021587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-etc-kubernetes\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.022230 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.022371 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.022487 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.022550 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-29xmc\"" Jul 14 10:00:32.022680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.022559 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 10:00:32.023069 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.022793 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 10:00:32.024783 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.024768 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:32.024894 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.024811 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:32.037048 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.037031 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-57l6f" Jul 14 10:00:32.047198 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.047182 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-57l6f" Jul 14 10:00:32.110333 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.110316 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 10:00:32.121801 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-kubelet\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.121907 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-os-release\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.121907 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-os-release\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.121907 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121850 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-kubelet\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.121907 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121867 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-cni-multus\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.121907 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121941 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121960 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-cni-multus\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.121974 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-os-release\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-run-netns\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122044 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-os-release\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122107 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-run-netns\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/503f535e-db88-4ef7-a6ec-c2979b447832-host\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-etc-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-env-overrides\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.122254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/821cb251-56b8-4ba3-a165-3d3f0e322784-host-slash\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-netns\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-registration-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122333 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjxhn\" (UniqueName: \"kubernetes.io/projected/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-kube-api-access-wjxhn\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbzm\" (UniqueName: \"kubernetes.io/projected/c22291bc-7211-41c1-a8ab-72d4590d2734-kube-api-access-7dbzm\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e31f1fe5-a4e5-431f-ab06-76962e254bc6-kubelet-config\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysctl-d\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-run\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovnkube-config\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-system-cni-dir\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122547 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cnibin\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.122896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mdcj\" (UniqueName: \"kubernetes.io/projected/86629999-84ab-47b1-9be3-b8f50ec4f85c-kube-api-access-6mdcj\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122613 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cnibin\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp9nv\" (UniqueName: \"kubernetes.io/projected/821cb251-56b8-4ba3-a165-3d3f0e322784-kube-api-access-lp9nv\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-modprobe-d\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-lib-modules\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/821cb251-56b8-4ba3-a165-3d3f0e322784-iptables-alerter-script\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-sys-fs\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-systemd\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122722 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-multus-certs\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66f7fe55-838d-4326-9739-d50cc4a3a5e4-hosts-file\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-systemd-units\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122819 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-ovn\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-log-socket\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.123582 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovnkube-script-lib\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-cni-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdbf1e40-9772-4b37-ad44-55d8fc58cc0a-konnectivity-ca\") pod \"konnectivity-agent-52qm2\" (UID: \"cdbf1e40-9772-4b37-ad44-55d8fc58cc0a\") " pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-etc-kubernetes\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122909 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysctl-d\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122926 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-socket-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122947 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-run\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-kubernetes\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123035 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-netns\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123043 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-env-overrides\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123057 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-etc-kubernetes\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123084 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123141 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-lib-modules\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123144 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-modprobe-d\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123170 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66f7fe55-838d-4326-9739-d50cc4a3a5e4-hosts-file\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.124331 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123184 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-systemd-units\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123190 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-ovn\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.122602 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-etc-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123144 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-systemd\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f7fe55-838d-4326-9739-d50cc4a3a5e4-tmp-dir\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123235 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-multus-certs\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123189 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/503f535e-db88-4ef7-a6ec-c2979b447832-host\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123257 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-cni-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123273 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-kubernetes\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123288 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-system-cni-dir\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-kubelet\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123349 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-kubelet\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123365 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-log-socket\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123395 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.124945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123404 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovnkube-config\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysctl-conf\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123542 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f7fe55-838d-4326-9739-d50cc4a3a5e4-tmp-dir\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123572 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eda10369-431b-4312-98e7-d6031fd0c935-etc-tuned\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-cni-bin\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-cni-bin\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-var-lib-kubelet\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123729 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovn-node-metrics-cert\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123762 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysctl-conf\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123770 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-hostroot\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123804 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-hostroot\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123793 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123849 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-var-lib-cni-bin\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123882 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovnkube-script-lib\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123887 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-cni-bin\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.126186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123924 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-var-lib-kubelet\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.123967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdbf1e40-9772-4b37-ad44-55d8fc58cc0a-agent-certs\") pod \"konnectivity-agent-52qm2\" (UID: \"cdbf1e40-9772-4b37-ad44-55d8fc58cc0a\") " pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86629999-84ab-47b1-9be3-b8f50ec4f85c-cni-binary-copy\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124063 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-sys\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-daemon-config\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-device-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhmqg\" (UniqueName: \"kubernetes.io/projected/8f79d152-cadc-4133-ae9c-a738cba5627e-kube-api-access-zhmqg\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h92gp\" (UniqueName: \"kubernetes.io/projected/66f7fe55-838d-4326-9739-d50cc4a3a5e4-kube-api-access-h92gp\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysconfig\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eda10369-431b-4312-98e7-d6031fd0c935-tmp\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-var-lib-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.126909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-k8s-cni-cncf-io\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-conf-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124398 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbmvg\" (UniqueName: \"kubernetes.io/projected/503f535e-db88-4ef7-a6ec-c2979b447832-kube-api-access-bbmvg\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-systemd\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124498 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86629999-84ab-47b1-9be3-b8f50ec4f85c-cni-binary-copy\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-host\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124512 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-conf-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jlrd\" (UniqueName: \"kubernetes.io/projected/eda10369-431b-4312-98e7-d6031fd0c935-kube-api-access-9jlrd\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-sysconfig\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-slash\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-cni-netd\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124876 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/503f535e-db88-4ef7-a6ec-c2979b447832-serviceca\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124971 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-node-log\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.124987 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-daemon-config\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.127580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-system-cni-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125026 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-cnibin\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125038 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-sys\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125077 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-run-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2n9\" (UniqueName: \"kubernetes.io/projected/a43b79a4-508a-4578-9e30-f71adbdd3bd1-kube-api-access-8b2n9\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-socket-dir-parent\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-etc-selinux\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e31f1fe5-a4e5-431f-ab06-76962e254bc6-dbus\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125260 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-node-log\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125289 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-var-lib-openvswitch\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125291 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-host-run-k8s-cni-cncf-io\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125311 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-system-cni-dir\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125326 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125337 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-slash\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125360 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-cnibin\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.128327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125476 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125527 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-host\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125578 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/86629999-84ab-47b1-9be3-b8f50ec4f85c-multus-socket-dir-parent\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125581 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eda10369-431b-4312-98e7-d6031fd0c935-etc-systemd\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.125981 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/503f535e-db88-4ef7-a6ec-c2979b447832-serviceca\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.126036 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a43b79a4-508a-4578-9e30-f71adbdd3bd1-host-cni-netd\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.126661 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.127384 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eda10369-431b-4312-98e7-d6031fd0c935-tmp\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.127443 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eda10369-431b-4312-98e7-d6031fd0c935-etc-tuned\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.129043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.127482 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a43b79a4-508a-4578-9e30-f71adbdd3bd1-ovn-node-metrics-cert\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.130076 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.130057 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjxhn\" (UniqueName: \"kubernetes.io/projected/2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2-kube-api-access-wjxhn\") pod \"multus-additional-cni-plugins-8p96k\" (UID: \"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2\") " pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.130828 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.130802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mdcj\" (UniqueName: \"kubernetes.io/projected/86629999-84ab-47b1-9be3-b8f50ec4f85c-kube-api-access-6mdcj\") pod \"multus-zrq9s\" (UID: \"86629999-84ab-47b1-9be3-b8f50ec4f85c\") " pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.132009 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.131979 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbmvg\" (UniqueName: \"kubernetes.io/projected/503f535e-db88-4ef7-a6ec-c2979b447832-kube-api-access-bbmvg\") pod \"node-ca-84gh2\" (UID: \"503f535e-db88-4ef7-a6ec-c2979b447832\") " pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.132432 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.132412 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jlrd\" (UniqueName: \"kubernetes.io/projected/eda10369-431b-4312-98e7-d6031fd0c935-kube-api-access-9jlrd\") pod \"tuned-szvlr\" (UID: \"eda10369-431b-4312-98e7-d6031fd0c935\") " pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.133730 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.133711 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2n9\" (UniqueName: \"kubernetes.io/projected/a43b79a4-508a-4578-9e30-f71adbdd3bd1-kube-api-access-8b2n9\") pod \"ovnkube-node-tvrkr\" (UID: \"a43b79a4-508a-4578-9e30-f71adbdd3bd1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.133801 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.133687 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h92gp\" (UniqueName: \"kubernetes.io/projected/66f7fe55-838d-4326-9739-d50cc4a3a5e4-kube-api-access-h92gp\") pod \"node-resolver-59prv\" (UID: \"66f7fe55-838d-4326-9739-d50cc4a3a5e4\") " pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.206389 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.206364 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b85bf11686fc7c45eaff1c12525158.slice/crio-56dfa7e2fd639a222cf4266e65ebd688070f56582691db5c1ba0e673ce147908 WatchSource:0}: Error finding container 56dfa7e2fd639a222cf4266e65ebd688070f56582691db5c1ba0e673ce147908: Status 404 returned error can't find the container with id 56dfa7e2fd639a222cf4266e65ebd688070f56582691db5c1ba0e673ce147908 Jul 14 10:00:32.206894 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.206877 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152fe7020801273832f641be20083d11.slice/crio-39f88967253371858485478c1ffd273e4e6e255c4162c126b1fe3810b3c6b9bb WatchSource:0}: Error finding container 39f88967253371858485478c1ffd273e4e6e255c4162c126b1fe3810b3c6b9bb: Status 404 returned error can't find the container with id 39f88967253371858485478c1ffd273e4e6e255c4162c126b1fe3810b3c6b9bb Jul 14 10:00:32.211110 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.211094 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:00:32.225927 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.225907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/821cb251-56b8-4ba3-a165-3d3f0e322784-host-slash\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.226017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.225935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-registration-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.225961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbzm\" (UniqueName: \"kubernetes.io/projected/c22291bc-7211-41c1-a8ab-72d4590d2734-kube-api-access-7dbzm\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:32.226017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.225978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:32.226017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.225994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e31f1fe5-a4e5-431f-ab06-76962e254bc6-kubelet-config\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.226173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226028 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/821cb251-56b8-4ba3-a165-3d3f0e322784-host-slash\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.226173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226034 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-registration-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp9nv\" (UniqueName: \"kubernetes.io/projected/821cb251-56b8-4ba3-a165-3d3f0e322784-kube-api-access-lp9nv\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.226173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e31f1fe5-a4e5-431f-ab06-76962e254bc6-kubelet-config\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.226173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/821cb251-56b8-4ba3-a165-3d3f0e322784-iptables-alerter-script\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.226173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-sys-fs\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdbf1e40-9772-4b37-ad44-55d8fc58cc0a-konnectivity-ca\") pod \"konnectivity-agent-52qm2\" (UID: \"cdbf1e40-9772-4b37-ad44-55d8fc58cc0a\") " pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:32.226173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-socket-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226211 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdbf1e40-9772-4b37-ad44-55d8fc58cc0a-agent-certs\") pod \"konnectivity-agent-52qm2\" (UID: \"cdbf1e40-9772-4b37-ad44-55d8fc58cc0a\") " pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226214 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-sys-fs\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-device-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhmqg\" (UniqueName: \"kubernetes.io/projected/8f79d152-cadc-4133-ae9c-a738cba5627e-kube-api-access-zhmqg\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-etc-selinux\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226329 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-device-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e31f1fe5-a4e5-431f-ab06-76962e254bc6-dbus\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226372 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226407 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-socket-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.226539 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.226525 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:32.227030 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226567 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f79d152-cadc-4133-ae9c-a738cba5627e-etc-selinux\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.227030 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226569 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e31f1fe5-a4e5-431f-ab06-76962e254bc6-dbus\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.227030 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.226627 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs podName:c22291bc-7211-41c1-a8ab-72d4590d2734 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:32.726607908 +0000 UTC m=+3.007816010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs") pod "network-metrics-daemon-srlpr" (UID: "c22291bc-7211-41c1-a8ab-72d4590d2734") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:32.227030 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226675 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/821cb251-56b8-4ba3-a165-3d3f0e322784-iptables-alerter-script\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.227030 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.226697 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdbf1e40-9772-4b37-ad44-55d8fc58cc0a-konnectivity-ca\") pod \"konnectivity-agent-52qm2\" (UID: \"cdbf1e40-9772-4b37-ad44-55d8fc58cc0a\") " pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:32.227030 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.226760 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:32.227030 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.226802 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret podName:e31f1fe5-a4e5-431f-ab06-76962e254bc6 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:32.726788156 +0000 UTC m=+3.007996259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret") pod "global-pull-secret-syncer-xpr87" (UID: "e31f1fe5-a4e5-431f-ab06-76962e254bc6") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:32.228539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.228524 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdbf1e40-9772-4b37-ad44-55d8fc58cc0a-agent-certs\") pod \"konnectivity-agent-52qm2\" (UID: \"cdbf1e40-9772-4b37-ad44-55d8fc58cc0a\") " pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:32.232404 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.232391 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:32.232476 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.232410 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:32.232476 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.232420 2565 projected.go:196] Error preparing data for projected volume kube-api-access-svlkn for pod openshift-network-diagnostics/network-check-target-wzhrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:32.232476 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.232468 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn podName:9bd128ba-13cb-451f-8e5d-5a0ebb967d0c nodeName:}" failed. No retries permitted until 2026-07-14 10:00:32.732457223 +0000 UTC m=+3.013665323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-svlkn" (UniqueName: "kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn") pod "network-check-target-wzhrp" (UID: "9bd128ba-13cb-451f-8e5d-5a0ebb967d0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:32.234342 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.234317 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp9nv\" (UniqueName: \"kubernetes.io/projected/821cb251-56b8-4ba3-a165-3d3f0e322784-kube-api-access-lp9nv\") pod \"iptables-alerter-68btj\" (UID: \"821cb251-56b8-4ba3-a165-3d3f0e322784\") " pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.234496 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.234482 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhmqg\" (UniqueName: \"kubernetes.io/projected/8f79d152-cadc-4133-ae9c-a738cba5627e-kube-api-access-zhmqg\") pod \"aws-ebs-csi-driver-node-f42jf\" (UID: \"8f79d152-cadc-4133-ae9c-a738cba5627e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.235028 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.235010 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbzm\" (UniqueName: \"kubernetes.io/projected/c22291bc-7211-41c1-a8ab-72d4590d2734-kube-api-access-7dbzm\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:32.286899 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.286876 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:32.328008 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.327979 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zrq9s" Jul 14 10:00:32.337541 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.337498 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86629999_84ab_47b1_9be3_b8f50ec4f85c.slice/crio-865bc607f75d193f41a114c99fe45f531cadd6c3c26d4ec986106485b3dce404 WatchSource:0}: Error finding container 865bc607f75d193f41a114c99fe45f531cadd6c3c26d4ec986106485b3dce404: Status 404 returned error can't find the container with id 865bc607f75d193f41a114c99fe45f531cadd6c3c26d4ec986106485b3dce404 Jul 14 10:00:32.343844 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.343827 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-84gh2" Jul 14 10:00:32.353344 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.353301 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503f535e_db88_4ef7_a6ec_c2979b447832.slice/crio-09b2e5ad6ae05c383ff8af654a1e644c4ba885f3c077b8c6301c1b5ff9e208fc WatchSource:0}: Error finding container 09b2e5ad6ae05c383ff8af654a1e644c4ba885f3c077b8c6301c1b5ff9e208fc: Status 404 returned error can't find the container with id 09b2e5ad6ae05c383ff8af654a1e644c4ba885f3c077b8c6301c1b5ff9e208fc Jul 14 10:00:32.367284 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.367266 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szvlr" Jul 14 10:00:32.374768 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.374724 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda10369_431b_4312_98e7_d6031fd0c935.slice/crio-48200b99c1348e794006bd538441697c699d42519ba604565548aa4365e20de7 WatchSource:0}: Error finding container 48200b99c1348e794006bd538441697c699d42519ba604565548aa4365e20de7: Status 404 returned error can't find the container with id 48200b99c1348e794006bd538441697c699d42519ba604565548aa4365e20de7 Jul 14 10:00:32.380694 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.380677 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59prv" Jul 14 10:00:32.388119 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.388094 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f7fe55_838d_4326_9739_d50cc4a3a5e4.slice/crio-729ce41eb8e9427af2077fde70795f5098bb5fb1c5ec7d8785c9751b15a05576 WatchSource:0}: Error finding container 729ce41eb8e9427af2077fde70795f5098bb5fb1c5ec7d8785c9751b15a05576: Status 404 returned error can't find the container with id 729ce41eb8e9427af2077fde70795f5098bb5fb1c5ec7d8785c9751b15a05576 Jul 14 10:00:32.399004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.398985 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:32.406235 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.406214 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43b79a4_508a_4578_9e30_f71adbdd3bd1.slice/crio-f126f7b67e42878f9491277a0e04dfb8635e6795ae3ecae62fde35744007d7f8 WatchSource:0}: Error finding container f126f7b67e42878f9491277a0e04dfb8635e6795ae3ecae62fde35744007d7f8: Status 404 returned error can't find the container with id f126f7b67e42878f9491277a0e04dfb8635e6795ae3ecae62fde35744007d7f8 Jul 14 10:00:32.419356 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.419338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8p96k" Jul 14 10:00:32.426554 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.426531 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2379ddfc_f4b1_4fd0_addf_5e9c8dc93df2.slice/crio-723fd58047440e52fc17656c26f3cf8cc554d8305ebed03b1ac98c3b98e2570d WatchSource:0}: Error finding container 723fd58047440e52fc17656c26f3cf8cc554d8305ebed03b1ac98c3b98e2570d: Status 404 returned error can't find the container with id 723fd58047440e52fc17656c26f3cf8cc554d8305ebed03b1ac98c3b98e2570d Jul 14 10:00:32.429395 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.429381 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-68btj" Jul 14 10:00:32.436816 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.436796 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821cb251_56b8_4ba3_a165_3d3f0e322784.slice/crio-4db8c02f324a295c5734971f6028fa084956c0e140718d5f7c62657e9dfc2256 WatchSource:0}: Error finding container 4db8c02f324a295c5734971f6028fa084956c0e140718d5f7c62657e9dfc2256: Status 404 returned error can't find the container with id 4db8c02f324a295c5734971f6028fa084956c0e140718d5f7c62657e9dfc2256 Jul 14 10:00:32.467966 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.467945 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" Jul 14 10:00:32.472831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.472815 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:32.475601 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.475579 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f79d152_cadc_4133_ae9c_a738cba5627e.slice/crio-656dafa37460d0c9c487f2bb7a12a660c2c0852db1e8da0332bc6fa394da2be7 WatchSource:0}: Error finding container 656dafa37460d0c9c487f2bb7a12a660c2c0852db1e8da0332bc6fa394da2be7: Status 404 returned error can't find the container with id 656dafa37460d0c9c487f2bb7a12a660c2c0852db1e8da0332bc6fa394da2be7 Jul 14 10:00:32.480404 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:00:32.480383 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbf1e40_9772_4b37_ad44_55d8fc58cc0a.slice/crio-9408db2065cfa3f246878c322c7f3e351fc93495b4fc18b20056cb429b615061 WatchSource:0}: Error finding container 9408db2065cfa3f246878c322c7f3e351fc93495b4fc18b20056cb429b615061: Status 404 returned error can't find the container with id 9408db2065cfa3f246878c322c7f3e351fc93495b4fc18b20056cb429b615061 Jul 14 10:00:32.730075 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.729999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:32.730075 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.730053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:32.730286 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.730149 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:32.730286 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.730202 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret podName:e31f1fe5-a4e5-431f-ab06-76962e254bc6 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:33.730189204 +0000 UTC m=+4.011397309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret") pod "global-pull-secret-syncer-xpr87" (UID: "e31f1fe5-a4e5-431f-ab06-76962e254bc6") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:32.730286 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.730149 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:32.730286 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.730268 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs podName:c22291bc-7211-41c1-a8ab-72d4590d2734 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:33.73025703 +0000 UTC m=+4.011465130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs") pod "network-metrics-daemon-srlpr" (UID: "c22291bc-7211-41c1-a8ab-72d4590d2734") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:32.830522 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:32.830486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:32.830679 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.830669 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:32.830766 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.830691 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:32.830766 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.830703 2565 projected.go:196] Error preparing data for projected volume kube-api-access-svlkn for pod openshift-network-diagnostics/network-check-target-wzhrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:32.830865 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:32.830782 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn podName:9bd128ba-13cb-451f-8e5d-5a0ebb967d0c nodeName:}" failed. No retries permitted until 2026-07-14 10:00:33.830762097 +0000 UTC m=+4.111970213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-svlkn" (UniqueName: "kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn") pod "network-check-target-wzhrp" (UID: "9bd128ba-13cb-451f-8e5d-5a0ebb967d0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:33.050859 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.050735 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 09:55:32 +0000 UTC" deadline="2028-01-03 02:22:08.042985567 +0000 UTC" Jul 14 10:00:33.050859 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.050811 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12904h21m34.992179719s" Jul 14 10:00:33.160758 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.160528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:33.160758 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.160654 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:33.191581 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.191425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" event={"ID":"8f79d152-cadc-4133-ae9c-a738cba5627e","Type":"ContainerStarted","Data":"656dafa37460d0c9c487f2bb7a12a660c2c0852db1e8da0332bc6fa394da2be7"} Jul 14 10:00:33.207031 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.206995 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p96k" event={"ID":"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2","Type":"ContainerStarted","Data":"723fd58047440e52fc17656c26f3cf8cc554d8305ebed03b1ac98c3b98e2570d"} Jul 14 10:00:33.215956 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.215924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"f126f7b67e42878f9491277a0e04dfb8635e6795ae3ecae62fde35744007d7f8"} Jul 14 10:00:33.234105 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.233738 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szvlr" event={"ID":"eda10369-431b-4312-98e7-d6031fd0c935","Type":"ContainerStarted","Data":"48200b99c1348e794006bd538441697c699d42519ba604565548aa4365e20de7"} Jul 14 10:00:33.240935 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.240904 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-52qm2" event={"ID":"cdbf1e40-9772-4b37-ad44-55d8fc58cc0a","Type":"ContainerStarted","Data":"9408db2065cfa3f246878c322c7f3e351fc93495b4fc18b20056cb429b615061"} Jul 14 10:00:33.247264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.247235 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-68btj" event={"ID":"821cb251-56b8-4ba3-a165-3d3f0e322784","Type":"ContainerStarted","Data":"4db8c02f324a295c5734971f6028fa084956c0e140718d5f7c62657e9dfc2256"} Jul 14 10:00:33.267340 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.267308 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59prv" event={"ID":"66f7fe55-838d-4326-9739-d50cc4a3a5e4","Type":"ContainerStarted","Data":"729ce41eb8e9427af2077fde70795f5098bb5fb1c5ec7d8785c9751b15a05576"} Jul 14 10:00:33.281730 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.281700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-84gh2" event={"ID":"503f535e-db88-4ef7-a6ec-c2979b447832","Type":"ContainerStarted","Data":"09b2e5ad6ae05c383ff8af654a1e644c4ba885f3c077b8c6301c1b5ff9e208fc"} Jul 14 10:00:33.289616 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.289510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zrq9s" event={"ID":"86629999-84ab-47b1-9be3-b8f50ec4f85c","Type":"ContainerStarted","Data":"865bc607f75d193f41a114c99fe45f531cadd6c3c26d4ec986106485b3dce404"} Jul 14 10:00:33.294396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.294305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" event={"ID":"92b85bf11686fc7c45eaff1c12525158","Type":"ContainerStarted","Data":"56dfa7e2fd639a222cf4266e65ebd688070f56582691db5c1ba0e673ce147908"} Jul 14 10:00:33.300833 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.300809 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" event={"ID":"152fe7020801273832f641be20083d11","Type":"ContainerStarted","Data":"39f88967253371858485478c1ffd273e4e6e255c4162c126b1fe3810b3c6b9bb"} Jul 14 10:00:33.738063 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.738027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:33.738231 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.738100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:33.738305 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.738231 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:33.738305 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.738292 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs podName:c22291bc-7211-41c1-a8ab-72d4590d2734 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:35.738272365 +0000 UTC m=+6.019480469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs") pod "network-metrics-daemon-srlpr" (UID: "c22291bc-7211-41c1-a8ab-72d4590d2734") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:33.738696 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.738645 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:33.738820 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.738717 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret podName:e31f1fe5-a4e5-431f-ab06-76962e254bc6 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:35.738699261 +0000 UTC m=+6.019907375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret") pod "global-pull-secret-syncer-xpr87" (UID: "e31f1fe5-a4e5-431f-ab06-76962e254bc6") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:33.839030 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:33.838994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:33.839203 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.839167 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:33.839203 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.839191 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:33.839203 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.839203 2565 projected.go:196] Error preparing data for projected volume kube-api-access-svlkn for pod openshift-network-diagnostics/network-check-target-wzhrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:33.839381 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:33.839259 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn podName:9bd128ba-13cb-451f-8e5d-5a0ebb967d0c nodeName:}" failed. No retries permitted until 2026-07-14 10:00:35.839240361 +0000 UTC m=+6.120448467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-svlkn" (UniqueName: "kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn") pod "network-check-target-wzhrp" (UID: "9bd128ba-13cb-451f-8e5d-5a0ebb967d0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:34.051333 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:34.051230 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 09:55:32 +0000 UTC" deadline="2028-03-15 20:49:15.232658354 +0000 UTC" Jul 14 10:00:34.051333 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:34.051266 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14650h48m41.181396281s" Jul 14 10:00:34.161036 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:34.161005 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:34.161463 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:34.161088 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:34.161463 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:34.161212 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:34.162545 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:34.162514 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:35.160552 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:35.160517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:35.160722 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.160657 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:35.755205 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:35.755167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:35.755662 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:35.755245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:35.755662 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.755369 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:35.755662 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.755428 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs podName:c22291bc-7211-41c1-a8ab-72d4590d2734 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:39.755408299 +0000 UTC m=+10.036616409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs") pod "network-metrics-daemon-srlpr" (UID: "c22291bc-7211-41c1-a8ab-72d4590d2734") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:35.755918 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.755813 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:35.755918 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.755865 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret podName:e31f1fe5-a4e5-431f-ab06-76962e254bc6 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:39.755849607 +0000 UTC m=+10.037057711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret") pod "global-pull-secret-syncer-xpr87" (UID: "e31f1fe5-a4e5-431f-ab06-76962e254bc6") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:35.855950 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:35.855915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:35.856132 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.856105 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:35.856132 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.856128 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:35.856258 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.856141 2565 projected.go:196] Error preparing data for projected volume kube-api-access-svlkn for pod openshift-network-diagnostics/network-check-target-wzhrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:35.856258 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:35.856194 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn podName:9bd128ba-13cb-451f-8e5d-5a0ebb967d0c nodeName:}" failed. No retries permitted until 2026-07-14 10:00:39.856175678 +0000 UTC m=+10.137383779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-svlkn" (UniqueName: "kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn") pod "network-check-target-wzhrp" (UID: "9bd128ba-13cb-451f-8e5d-5a0ebb967d0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:36.160894 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:36.160825 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:36.161053 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:36.160827 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:36.161053 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:36.160976 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:36.161053 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:36.161023 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:37.160349 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:37.160151 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:37.160349 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:37.160267 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:38.160511 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:38.160284 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:38.160511 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:38.160301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:38.160511 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:38.160436 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:38.161065 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:38.160529 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:39.160952 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:39.160904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:39.161427 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.161089 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:39.788152 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:39.787580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:39.788152 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:39.787652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:39.788152 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.787819 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:39.788152 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.787891 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs podName:c22291bc-7211-41c1-a8ab-72d4590d2734 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:47.787872792 +0000 UTC m=+18.069080898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs") pod "network-metrics-daemon-srlpr" (UID: "c22291bc-7211-41c1-a8ab-72d4590d2734") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:39.788152 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.788145 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:39.788543 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.788206 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret podName:e31f1fe5-a4e5-431f-ab06-76962e254bc6 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:47.788181355 +0000 UTC m=+18.069389468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret") pod "global-pull-secret-syncer-xpr87" (UID: "e31f1fe5-a4e5-431f-ab06-76962e254bc6") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:39.888446 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:39.888410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:39.888628 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.888605 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:39.888693 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.888631 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:39.888693 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.888644 2565 projected.go:196] Error preparing data for projected volume kube-api-access-svlkn for pod openshift-network-diagnostics/network-check-target-wzhrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:39.888826 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:39.888700 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn podName:9bd128ba-13cb-451f-8e5d-5a0ebb967d0c nodeName:}" failed. No retries permitted until 2026-07-14 10:00:47.888681597 +0000 UTC m=+18.169889698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-svlkn" (UniqueName: "kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn") pod "network-check-target-wzhrp" (UID: "9bd128ba-13cb-451f-8e5d-5a0ebb967d0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:40.162548 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:40.162473 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:40.162997 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:40.162609 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:40.162997 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:40.162983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:40.163134 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:40.163072 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:41.161033 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:41.160734 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:41.161033 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:41.160875 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:42.161008 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:42.160973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:42.161008 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:42.161003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:42.161650 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:42.161112 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:42.161650 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:42.161255 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:43.160417 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:43.160202 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:43.160593 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:43.160511 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:44.160846 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:44.160815 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:44.161205 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:44.160925 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:44.161205 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:44.160986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:44.161205 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:44.161093 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:45.160986 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:45.160953 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:45.161418 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:45.161075 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:46.160273 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:46.160240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:46.160273 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:46.160262 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:46.160490 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:46.160375 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:46.160541 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:46.160507 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:47.160376 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:47.160342 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:47.160865 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.160450 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:47.849977 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:47.849943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:47.850156 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:47.850002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:47.850156 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.850085 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:47.850156 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.850096 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:47.850156 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.850152 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs podName:c22291bc-7211-41c1-a8ab-72d4590d2734 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:03.850132806 +0000 UTC m=+34.131340911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs") pod "network-metrics-daemon-srlpr" (UID: "c22291bc-7211-41c1-a8ab-72d4590d2734") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:47.850337 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.850172 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret podName:e31f1fe5-a4e5-431f-ab06-76962e254bc6 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:03.850161931 +0000 UTC m=+34.131370031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret") pod "global-pull-secret-syncer-xpr87" (UID: "e31f1fe5-a4e5-431f-ab06-76962e254bc6") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:47.950500 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:47.950467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:47.950703 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.950665 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:47.950703 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.950684 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:47.950703 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.950696 2565 projected.go:196] Error preparing data for projected volume kube-api-access-svlkn for pod openshift-network-diagnostics/network-check-target-wzhrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:47.950886 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:47.950771 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn podName:9bd128ba-13cb-451f-8e5d-5a0ebb967d0c nodeName:}" failed. No retries permitted until 2026-07-14 10:01:03.950734351 +0000 UTC m=+34.231942467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-svlkn" (UniqueName: "kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn") pod "network-check-target-wzhrp" (UID: "9bd128ba-13cb-451f-8e5d-5a0ebb967d0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:48.163728 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:48.163694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:48.163728 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:48.163715 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:48.164213 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:48.163817 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:48.164213 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:48.163943 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:49.159947 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:49.159914 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:49.160126 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:49.160051 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:50.160956 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:50.160913 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:50.161412 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:50.161038 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:50.161412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:50.161125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:50.161412 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:50.161241 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:51.161022 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:51.160989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:51.161409 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:51.161108 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:52.160658 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:52.160626 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:52.160847 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:52.160763 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:52.160847 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:52.160792 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:52.160980 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:52.160894 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:53.160702 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.160502 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:53.161341 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:53.160802 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:53.344778 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.344729 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zrq9s" event={"ID":"86629999-84ab-47b1-9be3-b8f50ec4f85c","Type":"ContainerStarted","Data":"9824b6967bbeae1c4767e598a7d23d61e7e4111dcab258d90f534debcd677540"} Jul 14 10:00:53.346410 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.346384 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" event={"ID":"92b85bf11686fc7c45eaff1c12525158","Type":"ContainerStarted","Data":"bd34824e3413cc1b4ccff9b7331d4ab6511bc8b352a17e3662d7ccd3ef20fea7"} Jul 14 10:00:53.348686 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.348670 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:00:53.349036 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.349016 2565 generic.go:356] "Generic (PLEG): container finished" podID="a43b79a4-508a-4578-9e30-f71adbdd3bd1" containerID="12feb35426bbd10436796250171668c04d3b2634ca06519cd5b513b7d685f9e1" exitCode=1 Jul 14 10:00:53.349108 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.349079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"9b528ab240ad96f3994ea55d33785d2f73ec3f006b392cdb04da92e65c79741e"} Jul 14 10:00:53.349168 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.349129 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"4b86c3464493e93c5e3c3337e8f4fe24f46860730b52b620b78701bb397e4c26"} Jul 14 10:00:53.349168 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.349162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"fdc9b3214fbcb0404e4328eaf3c76c6ff65984d8e32a833f590ff22cd136729c"} Jul 14 10:00:53.349266 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.349190 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerDied","Data":"12feb35426bbd10436796250171668c04d3b2634ca06519cd5b513b7d685f9e1"} Jul 14 10:00:53.349266 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.349220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"62eff4ac0e44d4b38a9fc646f7cd8e01bdf9560d38647a9ff4e042820cb3df57"} Jul 14 10:00:53.351302 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.351285 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szvlr" event={"ID":"eda10369-431b-4312-98e7-d6031fd0c935","Type":"ContainerStarted","Data":"a5b485b95f40fbddfbcb34ddd5b8a9a1df42634f4e023a7d125aa878891411af"} Jul 14 10:00:53.363526 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.363490 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zrq9s" podStartSLOduration=3.111219116 podStartE2EDuration="23.363479492s" totalImagesPullingTime="20.252260376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:53.36324371 +0000 UTC m=+23.644451832" watchObservedRunningTime="2026-07-14 10:00:53.363479492 +0000 UTC m=+23.644687614" Jul 14 10:00:53.376526 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.376493 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-174.ec2.internal" podStartSLOduration=22.376481633 podStartE2EDuration="22.376481633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:53.376460437 +0000 UTC m=+23.657668563" watchObservedRunningTime="2026-07-14 10:00:53.376481633 +0000 UTC m=+23.657689748" Jul 14 10:00:53.393328 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:53.392905 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-szvlr" podStartSLOduration=3.224976385 podStartE2EDuration="23.39289058s" totalImagesPullingTime="20.167914195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:53.392780635 +0000 UTC m=+23.673988753" watchObservedRunningTime="2026-07-14 10:00:53.39289058 +0000 UTC m=+23.674098694" Jul 14 10:00:54.161124 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.160844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:54.161916 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.160844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:54.161916 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:54.161209 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:54.161916 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:54.161307 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:54.355561 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.355538 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:00:54.356003 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.355982 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"a3aa0f84edc8e897933cbed4121d4c3e97297b7c60b1c8c4a7a6178537a2fc6e"} Jul 14 10:00:54.357153 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.357128 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-52qm2" event={"ID":"cdbf1e40-9772-4b37-ad44-55d8fc58cc0a","Type":"ContainerStarted","Data":"73b743d809e4432640608395baf9c21316f8d5ebf3d6f4811c02039415f42b2d"} Jul 14 10:00:54.358491 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.358469 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-68btj" event={"ID":"821cb251-56b8-4ba3-a165-3d3f0e322784","Type":"ContainerStarted","Data":"c31148eb1cd66ae7e9b9adf3a46b4e30be644f69422738641d79e6479e843fa4"} Jul 14 10:00:54.359773 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.359734 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59prv" event={"ID":"66f7fe55-838d-4326-9739-d50cc4a3a5e4","Type":"ContainerStarted","Data":"f608a00e6d61d986a194a224be3bbdf0673c9bd77e445f8ed09d6d45b43719f9"} Jul 14 10:00:54.361035 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.361014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-84gh2" event={"ID":"503f535e-db88-4ef7-a6ec-c2979b447832","Type":"ContainerStarted","Data":"1f3124affeee4d3a56bd88ecaae342ffcaf6a91485e0dd2aae018277a78ea4e0"} Jul 14 10:00:54.362370 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.362351 2565 generic.go:356] "Generic (PLEG): container finished" podID="152fe7020801273832f641be20083d11" containerID="50cbdb32304fae48a144c539d664ecd11b6a5508babf83fb29e6f66a72b4dd5b" exitCode=0 Jul 14 10:00:54.362445 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.362411 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" event={"ID":"152fe7020801273832f641be20083d11","Type":"ContainerDied","Data":"50cbdb32304fae48a144c539d664ecd11b6a5508babf83fb29e6f66a72b4dd5b"} Jul 14 10:00:54.363831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.363812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" event={"ID":"8f79d152-cadc-4133-ae9c-a738cba5627e","Type":"ContainerStarted","Data":"2060bb1dc6b93857cfedf4a5c1922d334fc0c8fa8cc1ca46dde3287c415f7df4"} Jul 14 10:00:54.365175 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.365157 2565 generic.go:356] "Generic (PLEG): container finished" podID="2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2" containerID="e00c41490e0e2c798fbcff822c6dfd6f66eb55032e885c6122fcdce2d95a6a6c" exitCode=0 Jul 14 10:00:54.365255 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.365224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p96k" event={"ID":"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2","Type":"ContainerDied","Data":"e00c41490e0e2c798fbcff822c6dfd6f66eb55032e885c6122fcdce2d95a6a6c"} Jul 14 10:00:54.373529 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.373497 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-52qm2" podStartSLOduration=4.282533301 podStartE2EDuration="24.37348398s" totalImagesPullingTime="20.090950679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:54.372775473 +0000 UTC m=+24.653983586" watchObservedRunningTime="2026-07-14 10:00:54.37348398 +0000 UTC m=+24.654692101" Jul 14 10:00:54.403914 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.403873 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-84gh2" podStartSLOduration=4.207980867 podStartE2EDuration="24.403861212s" totalImagesPullingTime="20.195880345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:54.403417069 +0000 UTC m=+24.684625192" watchObservedRunningTime="2026-07-14 10:00:54.403861212 +0000 UTC m=+24.685069333" Jul 14 10:00:54.419611 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.419577 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-59prv" podStartSLOduration=4.236506749 podStartE2EDuration="24.419565501s" totalImagesPullingTime="20.183058752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:54.419547331 +0000 UTC m=+24.700755452" watchObservedRunningTime="2026-07-14 10:00:54.419565501 +0000 UTC m=+24.700773620" Jul 14 10:00:54.456391 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.456356 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-68btj" podStartSLOduration=4.316935663 podStartE2EDuration="24.456344317s" totalImagesPullingTime="20.139408654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:54.455822918 +0000 UTC m=+24.737031040" watchObservedRunningTime="2026-07-14 10:00:54.456344317 +0000 UTC m=+24.737552440" Jul 14 10:00:54.496426 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.496400 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:54.574966 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.574935 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:54.614315 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.614292 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 10:00:54.675913 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:54.675857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:55.086323 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:55.086172 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T10:00:54.614311282Z","UUID":"9bc0b30a-c26d-497a-bed4-b6fcbcc3ab79","Handler":null,"Name":"","Endpoint":""} Jul 14 10:00:55.087889 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:55.087867 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 10:00:55.088008 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:55.087922 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 10:00:55.160544 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:55.160519 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:55.160673 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:55.160650 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:55.369494 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:55.369416 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" event={"ID":"152fe7020801273832f641be20083d11","Type":"ContainerStarted","Data":"652085c6da4ad3660908fa80e8e8ed51853813422d8d4917f8637480198455a7"} Jul 14 10:00:55.371911 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:55.371883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" event={"ID":"8f79d152-cadc-4133-ae9c-a738cba5627e","Type":"ContainerStarted","Data":"b23d52c2b50c7f749aa690bfa7fa4863c4386d85a47b8888d1692f7f4845505c"} Jul 14 10:00:56.000093 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.000061 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:56.055036 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.052989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:56.125373 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.125348 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:56.126031 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.126012 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:56.141628 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.141583 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-174.ec2.internal" podStartSLOduration=25.141565097 podStartE2EDuration="25.141565097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:55.384639951 +0000 UTC m=+25.665848074" watchObservedRunningTime="2026-07-14 10:00:56.141565097 +0000 UTC m=+26.422773220" Jul 14 10:00:56.160959 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.160940 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:56.161066 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.160939 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:56.161126 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:56.161066 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:56.161188 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:56.161145 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:56.290191 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.290151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:56.341956 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.341923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:56.376768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.376720 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" event={"ID":"8f79d152-cadc-4133-ae9c-a738cba5627e","Type":"ContainerStarted","Data":"4137314bb7a35ae17b090aad7b241770d6f8859f3a354402aa72ae5e907e435d"} Jul 14 10:00:56.380233 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.380213 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:00:56.380711 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.380688 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"7d9257df62d8ca12d66b3d3510391113ff45129b60196c28fd8815722993e20d"} Jul 14 10:00:56.381219 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.381095 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:56.381565 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.381547 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-52qm2" Jul 14 10:00:56.395338 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.395276 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42jf" podStartSLOduration=4.040594565 podStartE2EDuration="26.395263524s" totalImagesPullingTime="22.354668959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:56.39471163 +0000 UTC m=+26.675919752" watchObservedRunningTime="2026-07-14 10:00:56.395263524 +0000 UTC m=+26.676471649" Jul 14 10:00:56.452627 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:56.452596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:57.160600 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:57.160564 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:57.160774 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:57.160682 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:58.160483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:58.160271 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:00:58.160933 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:58.160271 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:00:58.160933 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:58.160592 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:00:58.160933 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:58.160675 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:00:59.160672 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:59.160497 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:00:59.161387 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:00:59.160790 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:00:59.388333 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:59.388298 2565 generic.go:356] "Generic (PLEG): container finished" podID="2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2" containerID="55713ff6a8dbce8ada24779ff543700d74d8ced7bf04e2beac98ab3b9f64c058" exitCode=0 Jul 14 10:00:59.388511 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:59.388339 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p96k" event={"ID":"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2","Type":"ContainerDied","Data":"55713ff6a8dbce8ada24779ff543700d74d8ced7bf04e2beac98ab3b9f64c058"} Jul 14 10:00:59.394762 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:59.394728 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:00:59.395095 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:59.395073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"626fd13ccdad9ea11935985fd8936cf2d2ab73faee9fc046e821a76dcda700cb"} Jul 14 10:00:59.395384 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:59.395372 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:00:59.395488 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:59.395473 2565 scope.go:117] "RemoveContainer" containerID="12feb35426bbd10436796250171668c04d3b2634ca06519cd5b513b7d685f9e1" Jul 14 10:00:59.410625 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:00:59.410600 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:01:00.161393 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.161363 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:00.162093 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:00.161473 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:01:00.162093 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.161511 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:00.162093 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:00.161575 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:01:00.400604 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.400580 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:01:00.400937 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.400915 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" event={"ID":"a43b79a4-508a-4578-9e30-f71adbdd3bd1","Type":"ContainerStarted","Data":"91392d77618262d7fc71bceab108cf7177c7f779787ecfac1ae1a69f8b74ded6"} Jul 14 10:01:00.401170 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.401154 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:01:00.401329 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.401290 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:01:00.415787 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.415727 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:01:00.428903 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.428855 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" podStartSLOduration=10.230242479 podStartE2EDuration="30.428838566s" totalImagesPullingTime="20.198596087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:00.427418232 +0000 UTC m=+30.708626355" watchObservedRunningTime="2026-07-14 10:01:00.428838566 +0000 UTC m=+30.710046689" Jul 14 10:01:00.539890 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.539863 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wzhrp"] Jul 14 10:01:00.540045 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.540031 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:00.540198 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:00.540172 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:01:00.540601 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.540542 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-srlpr"] Jul 14 10:01:00.540695 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.540645 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:00.540780 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:00.540765 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:01:00.541172 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.541064 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xpr87"] Jul 14 10:01:00.541172 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:00.541152 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:01:00.541276 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:00.541238 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:01:01.405288 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:01.405252 2565 generic.go:356] "Generic (PLEG): container finished" podID="2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2" containerID="97806891ae84fbf4b2bad52852439b436be8a9b9bff7131b0844ff3c772d5a19" exitCode=0 Jul 14 10:01:01.405918 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:01.405342 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p96k" event={"ID":"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2","Type":"ContainerDied","Data":"97806891ae84fbf4b2bad52852439b436be8a9b9bff7131b0844ff3c772d5a19"} Jul 14 10:01:02.161548 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:02.160992 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:01:02.161548 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:02.161026 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:02.161548 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:02.160992 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:02.161548 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:02.161132 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:01:02.161548 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:02.161221 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:01:02.161548 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:02.161302 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:01:02.168061 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:02.168039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:02.268328 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:02.268290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:03.411581 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:03.411360 2565 generic.go:356] "Generic (PLEG): container finished" podID="2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2" containerID="6f64ba1bc068f3cdf8daa30520dd13424b204f71d89ceff8420fba514e2fd0ae" exitCode=0 Jul 14 10:01:03.411992 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:03.411439 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p96k" event={"ID":"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2","Type":"ContainerDied","Data":"6f64ba1bc068f3cdf8daa30520dd13424b204f71d89ceff8420fba514e2fd0ae"} Jul 14 10:01:03.867665 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:03.867573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:01:03.867665 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:03.867627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:03.867892 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:03.867708 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:01:03.867892 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:03.867725 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:01:03.867892 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:03.867778 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs podName:c22291bc-7211-41c1-a8ab-72d4590d2734 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:35.867763808 +0000 UTC m=+66.148971921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs") pod "network-metrics-daemon-srlpr" (UID: "c22291bc-7211-41c1-a8ab-72d4590d2734") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:01:03.867892 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:03.867792 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret podName:e31f1fe5-a4e5-431f-ab06-76962e254bc6 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:35.86778544 +0000 UTC m=+66.148993540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret") pod "global-pull-secret-syncer-xpr87" (UID: "e31f1fe5-a4e5-431f-ab06-76962e254bc6") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:01:03.968543 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:03.968497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:03.968738 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:03.968675 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:01:03.968738 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:03.968694 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:01:03.968738 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:03.968705 2565 projected.go:196] Error preparing data for projected volume kube-api-access-svlkn for pod openshift-network-diagnostics/network-check-target-wzhrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:01:03.968896 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:03.968775 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn podName:9bd128ba-13cb-451f-8e5d-5a0ebb967d0c nodeName:}" failed. No retries permitted until 2026-07-14 10:01:35.968755861 +0000 UTC m=+66.249963979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-svlkn" (UniqueName: "kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn") pod "network-check-target-wzhrp" (UID: "9bd128ba-13cb-451f-8e5d-5a0ebb967d0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:01:04.160313 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:04.160281 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:04.160487 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:04.160280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:01:04.160487 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:04.160411 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srlpr" podUID="c22291bc-7211-41c1-a8ab-72d4590d2734" Jul 14 10:01:04.160598 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:04.160493 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpr87" podUID="e31f1fe5-a4e5-431f-ab06-76962e254bc6" Jul 14 10:01:04.160598 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:04.160296 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:04.160598 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:04.160580 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzhrp" podUID="9bd128ba-13cb-451f-8e5d-5a0ebb967d0c" Jul 14 10:01:05.526553 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.526525 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-174.ec2.internal" event="NodeReady" Jul 14 10:01:05.527155 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.526738 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 10:01:05.527155 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.526778 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:05.570138 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.570099 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n7cjs"] Jul 14 10:01:05.574191 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.573105 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.574191 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.573795 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-885wv"] Jul 14 10:01:05.576232 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.575915 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-885wv" Jul 14 10:01:05.576232 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.576037 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d25fg\"" Jul 14 10:01:05.576232 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.576050 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 10:01:05.576232 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.576038 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 10:01:05.578120 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.578098 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 10:01:05.578701 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.578604 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 10:01:05.578895 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.578875 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 10:01:05.579068 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.579046 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-26p75\"" Jul 14 10:01:05.582089 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.582066 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n7cjs"] Jul 14 10:01:05.585071 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.585038 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-885wv"] Jul 14 10:01:05.594418 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.594396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:05.684197 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.684161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-config-volume\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.684197 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.684195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-tmp-dir\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.684441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.684283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn9zr\" (UniqueName: \"kubernetes.io/projected/b62573cb-3e3a-4a88-ae37-45e024be7eaa-kube-api-access-zn9zr\") pod \"ingress-canary-885wv\" (UID: \"b62573cb-3e3a-4a88-ae37-45e024be7eaa\") " pod="openshift-ingress-canary/ingress-canary-885wv" Jul 14 10:01:05.684441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.684357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2k7b\" (UniqueName: \"kubernetes.io/projected/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-kube-api-access-t2k7b\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.684441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.684384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b62573cb-3e3a-4a88-ae37-45e024be7eaa-cert\") pod \"ingress-canary-885wv\" (UID: \"b62573cb-3e3a-4a88-ae37-45e024be7eaa\") " pod="openshift-ingress-canary/ingress-canary-885wv" Jul 14 10:01:05.684441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.684434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.785242 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.785203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-config-volume\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.785412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.785255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-tmp-dir\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.785412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.785310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn9zr\" (UniqueName: \"kubernetes.io/projected/b62573cb-3e3a-4a88-ae37-45e024be7eaa-kube-api-access-zn9zr\") pod \"ingress-canary-885wv\" (UID: \"b62573cb-3e3a-4a88-ae37-45e024be7eaa\") " pod="openshift-ingress-canary/ingress-canary-885wv" Jul 14 10:01:05.785412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.785340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2k7b\" (UniqueName: \"kubernetes.io/projected/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-kube-api-access-t2k7b\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.785412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.785365 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b62573cb-3e3a-4a88-ae37-45e024be7eaa-cert\") pod \"ingress-canary-885wv\" (UID: \"b62573cb-3e3a-4a88-ae37-45e024be7eaa\") " pod="openshift-ingress-canary/ingress-canary-885wv" Jul 14 10:01:05.785412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.785409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.785674 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:05.785516 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:01:05.785674 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:05.785583 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls podName:1e1aaf0d-39c2-40de-aba0-cb8e92c789f2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:06.285564283 +0000 UTC m=+36.566772387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls") pod "dns-default-n7cjs" (UID: "1e1aaf0d-39c2-40de-aba0-cb8e92c789f2") : secret "dns-default-metrics-tls" not found Jul 14 10:01:05.785796 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.785774 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-tmp-dir\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.785831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.785797 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-config-volume\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.791418 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.791396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b62573cb-3e3a-4a88-ae37-45e024be7eaa-cert\") pod \"ingress-canary-885wv\" (UID: \"b62573cb-3e3a-4a88-ae37-45e024be7eaa\") " pod="openshift-ingress-canary/ingress-canary-885wv" Jul 14 10:01:05.793970 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.793947 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2k7b\" (UniqueName: \"kubernetes.io/projected/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-kube-api-access-t2k7b\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:05.794076 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.794039 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn9zr\" (UniqueName: \"kubernetes.io/projected/b62573cb-3e3a-4a88-ae37-45e024be7eaa-kube-api-access-zn9zr\") pod \"ingress-canary-885wv\" (UID: \"b62573cb-3e3a-4a88-ae37-45e024be7eaa\") " pod="openshift-ingress-canary/ingress-canary-885wv" Jul 14 10:01:05.894135 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:05.894106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-885wv" Jul 14 10:01:06.148260 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.148227 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:06.160337 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.160311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:06.160483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.160313 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:06.160483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.160434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:01:06.163128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.163109 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 10:01:06.163259 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.163196 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 10:01:06.163343 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.163328 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 10:01:06.163404 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.163334 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vm2xk\"" Jul 14 10:01:06.164440 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.164424 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 10:01:06.164527 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.164454 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pz2v6\"" Jul 14 10:01:06.223725 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.223701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:06.282253 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.282223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:06.289436 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.289408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:06.289586 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:06.289560 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:01:06.289652 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:06.289632 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls podName:1e1aaf0d-39c2-40de-aba0-cb8e92c789f2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:07.289611718 +0000 UTC m=+37.570819822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls") pod "dns-default-n7cjs" (UID: "1e1aaf0d-39c2-40de-aba0-cb8e92c789f2") : secret "dns-default-metrics-tls" not found Jul 14 10:01:06.372491 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.372459 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9"] Jul 14 10:01:06.374361 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.374324 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" Jul 14 10:01:06.376820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.376787 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6svmz\"" Jul 14 10:01:06.377041 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.377025 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 10:01:06.377116 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.377025 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 10:01:06.384410 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.384386 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9"] Jul 14 10:01:06.409626 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.409562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:06.478720 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.478689 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-49llj"] Jul 14 10:01:06.480847 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.480814 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.483371 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.483345 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 10:01:06.483371 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.483368 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 10:01:06.483543 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.483385 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 10:01:06.483543 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.483356 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 10:01:06.483543 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.483459 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-szrgf\"" Jul 14 10:01:06.491385 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.491221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvqt\" (UniqueName: \"kubernetes.io/projected/742df99c-85ca-4497-b782-c7ff51d7738a-kube-api-access-ffvqt\") pod \"migrator-7f59b54f6c-tbvr9\" (UID: \"742df99c-85ca-4497-b782-c7ff51d7738a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" Jul 14 10:01:06.491549 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.491514 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-49llj"] Jul 14 10:01:06.591764 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.591716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/179d3e74-4f58-420f-b67e-0066dc913005-data-volume\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.592396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.591778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8q6f\" (UniqueName: \"kubernetes.io/projected/179d3e74-4f58-420f-b67e-0066dc913005-kube-api-access-j8q6f\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.592396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.591804 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/179d3e74-4f58-420f-b67e-0066dc913005-crio-socket\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.592396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.591847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.592396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.592007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.592396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.592056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvqt\" (UniqueName: \"kubernetes.io/projected/742df99c-85ca-4497-b782-c7ff51d7738a-kube-api-access-ffvqt\") pod \"migrator-7f59b54f6c-tbvr9\" (UID: \"742df99c-85ca-4497-b782-c7ff51d7738a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" Jul 14 10:01:06.600839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.600810 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvqt\" (UniqueName: \"kubernetes.io/projected/742df99c-85ca-4497-b782-c7ff51d7738a-kube-api-access-ffvqt\") pod \"migrator-7f59b54f6c-tbvr9\" (UID: \"742df99c-85ca-4497-b782-c7ff51d7738a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" Jul 14 10:01:06.683888 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.683812 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" Jul 14 10:01:06.692877 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.692838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8q6f\" (UniqueName: \"kubernetes.io/projected/179d3e74-4f58-420f-b67e-0066dc913005-kube-api-access-j8q6f\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.692988 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.692880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/179d3e74-4f58-420f-b67e-0066dc913005-crio-socket\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.692988 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.692918 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.692988 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.692975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.693156 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.693037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/179d3e74-4f58-420f-b67e-0066dc913005-data-volume\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.693156 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:06.693104 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:06.693246 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.693177 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/179d3e74-4f58-420f-b67e-0066dc913005-crio-socket\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.693246 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:06.693191 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:07.193169714 +0000 UTC m=+37.474377850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : configmap "kube-rbac-proxy" not found Jul 14 10:01:06.693246 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:06.693232 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:06.693378 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:06.693307 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:07.193289977 +0000 UTC m=+37.474498091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:06.693378 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.693345 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/179d3e74-4f58-420f-b67e-0066dc913005-data-volume\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:06.704312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:06.704293 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8q6f\" (UniqueName: \"kubernetes.io/projected/179d3e74-4f58-420f-b67e-0066dc913005-kube-api-access-j8q6f\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:07.198146 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.198098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:07.198346 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.198172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:07.198346 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:07.198231 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:07.198346 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:07.198283 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:07.198346 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:07.198317 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:08.198295085 +0000 UTC m=+38.479503199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : configmap "kube-rbac-proxy" not found Jul 14 10:01:07.198346 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:07.198345 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:08.19833204 +0000 UTC m=+38.479540144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:07.298763 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.298709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:07.298939 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:07.298865 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:01:07.298939 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:07.298930 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls podName:1e1aaf0d-39c2-40de-aba0-cb8e92c789f2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:09.298912179 +0000 UTC m=+39.580120279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls") pod "dns-default-n7cjs" (UID: "1e1aaf0d-39c2-40de-aba0-cb8e92c789f2") : secret "dns-default-metrics-tls" not found Jul 14 10:01:07.481725 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.481558 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-885wv"] Jul 14 10:01:07.485123 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.485102 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9"] Jul 14 10:01:07.490692 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:07.490653 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62573cb_3e3a_4a88_ae37_45e024be7eaa.slice/crio-cd5dbafafaeafb9580cad3929704f2fff6d2ed63bad62ed53c8203853a727189 WatchSource:0}: Error finding container cd5dbafafaeafb9580cad3929704f2fff6d2ed63bad62ed53c8203853a727189: Status 404 returned error can't find the container with id cd5dbafafaeafb9580cad3929704f2fff6d2ed63bad62ed53c8203853a727189 Jul 14 10:01:07.491026 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:07.491007 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742df99c_85ca_4497_b782_c7ff51d7738a.slice/crio-37d017a2e84480ecc2d181e44a8adcbb74a2790d22b0093f77595da7406ddd30 WatchSource:0}: Error finding container 37d017a2e84480ecc2d181e44a8adcbb74a2790d22b0093f77595da7406ddd30: Status 404 returned error can't find the container with id 37d017a2e84480ecc2d181e44a8adcbb74a2790d22b0093f77595da7406ddd30 Jul 14 10:01:07.699284 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.699253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:07.753611 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.753523 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:07.900239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.900214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:07.966541 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:07.966508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:08.088770 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.088682 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-n2nhr"] Jul 14 10:01:08.091300 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.091285 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.093762 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.093727 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 10:01:08.094133 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.094115 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 10:01:08.094924 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.094903 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 10:01:08.095018 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.094950 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 10:01:08.095018 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.095009 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tmfn8\"" Jul 14 10:01:08.098979 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.098957 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-n2nhr"] Jul 14 10:01:08.128679 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.128634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:08.202204 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.202174 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:08.209458 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.209432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-signing-key\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.209645 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.209578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhkw6\" (UniqueName: \"kubernetes.io/projected/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-kube-api-access-mhkw6\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.209777 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.209731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:08.209843 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.209796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:08.209843 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.209825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-signing-cabundle\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.209946 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:08.209877 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:08.209946 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:08.209938 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:08.210037 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:08.209948 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:10.209929906 +0000 UTC m=+40.491138013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : configmap "kube-rbac-proxy" not found Jul 14 10:01:08.210037 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:08.209976 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:10.209965785 +0000 UTC m=+40.491173885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:08.310885 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.310850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-signing-key\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.311032 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.310893 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhkw6\" (UniqueName: \"kubernetes.io/projected/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-kube-api-access-mhkw6\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.311032 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.310995 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-signing-cabundle\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.311697 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.311661 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-signing-cabundle\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.314547 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.314519 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-signing-key\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.319472 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.319451 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhkw6\" (UniqueName: \"kubernetes.io/projected/d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b-kube-api-access-mhkw6\") pod \"service-ca-79f68b9f4f-n2nhr\" (UID: \"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b\") " pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.400301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.400260 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" Jul 14 10:01:08.433907 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.433848 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" event={"ID":"742df99c-85ca-4497-b782-c7ff51d7738a","Type":"ContainerStarted","Data":"37d017a2e84480ecc2d181e44a8adcbb74a2790d22b0093f77595da7406ddd30"} Jul 14 10:01:08.437193 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.437159 2565 generic.go:356] "Generic (PLEG): container finished" podID="2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2" containerID="afdc612a779b2defdf8d26396b0673ad488eea487c4b7b053ff96fb66e5590b7" exitCode=0 Jul 14 10:01:08.437294 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.437239 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p96k" event={"ID":"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2","Type":"ContainerDied","Data":"afdc612a779b2defdf8d26396b0673ad488eea487c4b7b053ff96fb66e5590b7"} Jul 14 10:01:08.438464 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.438440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-885wv" event={"ID":"b62573cb-3e3a-4a88-ae37-45e024be7eaa","Type":"ContainerStarted","Data":"cd5dbafafaeafb9580cad3929704f2fff6d2ed63bad62ed53c8203853a727189"} Jul 14 10:01:08.552184 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:08.552156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-n2nhr"] Jul 14 10:01:08.555675 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:08.555643 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2794a00_7a3a_43d8_b9cd_6c3bfbd1e49b.slice/crio-d10ae9485e312a968b683f96464764dfd81cb6df89c01582df0c02397d3cd07c WatchSource:0}: Error finding container d10ae9485e312a968b683f96464764dfd81cb6df89c01582df0c02397d3cd07c: Status 404 returned error can't find the container with id d10ae9485e312a968b683f96464764dfd81cb6df89c01582df0c02397d3cd07c Jul 14 10:01:09.119082 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:09.119049 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59prv_66f7fe55-838d-4326-9739-d50cc4a3a5e4/dns-node-resolver/0.log" Jul 14 10:01:09.319756 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:09.319717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:09.319928 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:09.319888 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:01:09.319988 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:09.319968 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls podName:1e1aaf0d-39c2-40de-aba0-cb8e92c789f2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:13.319943905 +0000 UTC m=+43.601152009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls") pod "dns-default-n7cjs" (UID: "1e1aaf0d-39c2-40de-aba0-cb8e92c789f2") : secret "dns-default-metrics-tls" not found Jul 14 10:01:09.444492 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:09.444291 2565 generic.go:356] "Generic (PLEG): container finished" podID="2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2" containerID="38c25113af5e3e3560b0861d7f98d8c7d52224efb61953affa377150a0e4fb8c" exitCode=0 Jul 14 10:01:09.444655 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:09.444343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p96k" event={"ID":"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2","Type":"ContainerDied","Data":"38c25113af5e3e3560b0861d7f98d8c7d52224efb61953affa377150a0e4fb8c"} Jul 14 10:01:09.445633 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:09.445614 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" event={"ID":"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b","Type":"ContainerStarted","Data":"d10ae9485e312a968b683f96464764dfd81cb6df89c01582df0c02397d3cd07c"} Jul 14 10:01:09.632391 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:09.632362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:10.227620 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:10.227585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:10.228073 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:10.227665 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:10.228073 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:10.227690 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:10.228073 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:10.227819 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:10.228073 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:10.227831 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:14.227730148 +0000 UTC m=+44.508938249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : configmap "kube-rbac-proxy" not found Jul 14 10:01:10.228073 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:10.227881 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:14.22786657 +0000 UTC m=+44.509074671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:10.245474 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:10.245442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:10.317441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:10.317422 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-84gh2_503f535e-db88-4ef7-a6ec-c2979b447832/node-ca/0.log" Jul 14 10:01:11.452313 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.452277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" event={"ID":"742df99c-85ca-4497-b782-c7ff51d7738a","Type":"ContainerStarted","Data":"58238d181ec7bf1a9249dc9bfc8897a533b9c36a5cf487046791ea20b802e1e9"} Jul 14 10:01:11.452769 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.452367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" event={"ID":"742df99c-85ca-4497-b782-c7ff51d7738a","Type":"ContainerStarted","Data":"5edde01f29d8f8090151a6ea5db9a62f7948635e8f00439ee4488faa8fb8c0fb"} Jul 14 10:01:11.455426 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.455399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p96k" event={"ID":"2379ddfc-f4b1-4fd0-addf-5e9c8dc93df2","Type":"ContainerStarted","Data":"7e39da98429129a18a07f04f65c09d4d3e2f72792ffc42a72bc83c4e2c39f649"} Jul 14 10:01:11.456804 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.456782 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-885wv" event={"ID":"b62573cb-3e3a-4a88-ae37-45e024be7eaa","Type":"ContainerStarted","Data":"5367648fc84ac35c5941299fead7f874f7f3aa4719b1935cec38ff27d59a7f2e"} Jul 14 10:01:11.468174 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.468129 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tbvr9" podStartSLOduration=2.591868583 podStartE2EDuration="5.468117275s" totalImagesPullingTime="2.876248692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:11.466567908 +0000 UTC m=+41.747776030" watchObservedRunningTime="2026-07-14 10:01:11.468117275 +0000 UTC m=+41.749325376" Jul 14 10:01:11.487680 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.487580 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8p96k" podStartSLOduration=10.986429802 podStartE2EDuration="41.487566449s" totalImagesPullingTime="30.501136647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:11.486023383 +0000 UTC m=+41.767231505" watchObservedRunningTime="2026-07-14 10:01:11.487566449 +0000 UTC m=+41.768774571" Jul 14 10:01:11.501123 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.501090 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-885wv" podStartSLOduration=3.619336233 podStartE2EDuration="6.501078135s" totalImagesPullingTime="2.881741902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:11.500623075 +0000 UTC m=+41.781831194" watchObservedRunningTime="2026-07-14 10:01:11.501078135 +0000 UTC m=+41.782286256" Jul 14 10:01:11.522011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.521988 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tbvr9_742df99c-85ca-4497-b782-c7ff51d7738a/migrator/0.log" Jul 14 10:01:11.718233 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:11.718163 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tbvr9_742df99c-85ca-4497-b782-c7ff51d7738a/graceful-termination/0.log" Jul 14 10:01:12.367928 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:12.367878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:13.355561 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:13.355521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:13.355938 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:13.355698 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:01:13.355938 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:13.355797 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls podName:1e1aaf0d-39c2-40de-aba0-cb8e92c789f2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:21.355774456 +0000 UTC m=+51.636982559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls") pod "dns-default-n7cjs" (UID: "1e1aaf0d-39c2-40de-aba0-cb8e92c789f2") : secret "dns-default-metrics-tls" not found Jul 14 10:01:13.463400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:13.463369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" event={"ID":"d2794a00-7a3a-43d8-b9cd-6c3bfbd1e49b","Type":"ContainerStarted","Data":"b7e26825a86c0d039b0e742716dafd216ced1c7f69d71800dfabdc67b5654d12"} Jul 14 10:01:13.479195 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:13.479156 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-n2nhr" podStartSLOduration=1.48709244 podStartE2EDuration="5.479143025s" totalImagesPullingTime="3.992050585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:13.478598204 +0000 UTC m=+43.759806326" watchObservedRunningTime="2026-07-14 10:01:13.479143025 +0000 UTC m=+43.760351182" Jul 14 10:01:13.572088 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:13.572058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:13.632258 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:13.632231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:13.908387 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:13.908302 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:14.009224 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:14.009188 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:14.118164 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:14.118130 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:14.263823 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:14.263715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:14.263823 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:14.263806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:14.264060 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:14.263941 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:14.264060 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:14.264022 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:22.264000587 +0000 UTC m=+52.545208689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:14.264206 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:14.264192 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:14.264333 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:14.264321 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:22.264305239 +0000 UTC m=+52.545513344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : configmap "kube-rbac-proxy" not found Jul 14 10:01:14.273162 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:14.273141 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:14.413287 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:14.413257 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:14.618574 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:14.618483 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:15.211242 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:15.211213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:15.262597 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:15.262569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:15.809129 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:15.809102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:17.101181 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:17.101145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:17.202261 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:17.202231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:17.408072 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:17.408039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:17.728565 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:17.728486 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:17.829585 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:17.829546 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:17.885328 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:17.885299 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:18.209098 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:18.209069 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:18.608652 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:18.608575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:18.709312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:18.709281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:18.809682 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:18.809652 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:19.329309 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:19.329258 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:19.593303 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:19.593220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:19.650141 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:19.650114 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:20.215194 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:20.215159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:20.407217 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:20.407187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:20.623467 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:20.623381 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:21.004080 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:21.004045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:21.209272 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:21.209233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:21.421494 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:21.421463 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:21.424997 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:21.424963 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e1aaf0d-39c2-40de-aba0-cb8e92c789f2-metrics-tls\") pod \"dns-default-n7cjs\" (UID: \"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2\") " pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:21.488015 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:21.487991 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:21.607771 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:21.607727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:21.629897 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:21.629770 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n7cjs"] Jul 14 10:01:21.632254 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:21.632228 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1aaf0d_39c2_40de_aba0_cb8e92c789f2.slice/crio-f1b4778a4c6185571d91962b36e4ebdef0c355c2b89217f4d0a7b51b4929a282 WatchSource:0}: Error finding container f1b4778a4c6185571d91962b36e4ebdef0c355c2b89217f4d0a7b51b4929a282: Status 404 returned error can't find the container with id f1b4778a4c6185571d91962b36e4ebdef0c355c2b89217f4d0a7b51b4929a282 Jul 14 10:01:22.003013 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:22.002976 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:22.328110 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:22.328028 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:22.328110 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:22.328102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:22.328285 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:22.328178 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:22.328285 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:22.328241 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls podName:179d3e74-4f58-420f-b67e-0066dc913005 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:38.328224701 +0000 UTC m=+68.609432801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls") pod "insights-runtime-extractor-49llj" (UID: "179d3e74-4f58-420f-b67e-0066dc913005") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:22.328561 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:22.328544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/179d3e74-4f58-420f-b67e-0066dc913005-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:22.488337 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:22.488294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n7cjs" event={"ID":"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2","Type":"ContainerStarted","Data":"f1b4778a4c6185571d91962b36e4ebdef0c355c2b89217f4d0a7b51b4929a282"} Jul 14 10:01:22.810779 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:22.810728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.007691 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.007643 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.069245 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.069151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.123195 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.123166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.313942 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.313909 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.415059 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.415011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.613802 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.613754 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.719083 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.719003 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.809734 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.809688 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.897970 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.897940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:23.953634 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:23.953608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:24.010211 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.010144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:24.125066 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.125040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:24.227584 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.227554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:24.413300 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.413267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:24.494885 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.494854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n7cjs" event={"ID":"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2","Type":"ContainerStarted","Data":"2fe0239c10541bde5744dd944fe18ab0877c24f54b318b1b0d8479d1efb69c2d"} Jul 14 10:01:24.495055 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.494903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n7cjs" event={"ID":"1e1aaf0d-39c2-40de-aba0-cb8e92c789f2","Type":"ContainerStarted","Data":"6be31b1707ad4bf40c1fc0f0d858ee73ef100e6b2a339cc01a5a465e834bacf9"} Jul 14 10:01:24.495055 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.494969 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:24.512258 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.512213 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n7cjs" podStartSLOduration=17.094290421 podStartE2EDuration="19.512199485s" totalImagesPullingTime="2.417909064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:24.511150697 +0000 UTC m=+54.792358819" watchObservedRunningTime="2026-07-14 10:01:24.512199485 +0000 UTC m=+54.793407624" Jul 14 10:01:24.513647 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.513613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:24.614243 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.614147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:24.917966 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:24.917932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:25.017475 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:25.017441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:25.724861 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:25.724813 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:25.826170 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:25.826140 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:26.754132 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:26.754100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:26.824150 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:26.824117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:27.382524 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:27.382479 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:27.434865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:27.434824 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:28.128372 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.128339 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-nzc7q"] Jul 14 10:01:28.130868 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.130849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-nzc7q" Jul 14 10:01:28.133404 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.133382 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zwpq9\"" Jul 14 10:01:28.133521 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.133388 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 10:01:28.133860 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.133841 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 10:01:28.141003 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.140980 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-nzc7q"] Jul 14 10:01:28.174996 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.174973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-695x7\" (UniqueName: \"kubernetes.io/projected/ca996fcc-80e5-45b2-9049-fa8ea75b1769-kube-api-access-695x7\") pod \"downloads-68c9cbb497-nzc7q\" (UID: \"ca996fcc-80e5-45b2-9049-fa8ea75b1769\") " pod="openshift-console/downloads-68c9cbb497-nzc7q" Jul 14 10:01:28.195312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.195286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:28.224060 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.224033 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fb9857868-tx5bh"] Jul 14 10:01:28.225760 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.225728 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.228408 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.228387 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 10:01:28.228501 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.228387 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 10:01:28.228501 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.228455 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 10:01:28.228501 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.228477 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zh9t2\"" Jul 14 10:01:28.233649 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.233631 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 10:01:28.240878 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.240860 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fb9857868-tx5bh"] Jul 14 10:01:28.275980 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.275955 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h77lv\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-kube-api-access-h77lv\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.276092 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.275997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7f68985-1af0-4c59-9b50-07038b8683ad-image-registry-private-configuration\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.276092 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.276027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7f68985-1af0-4c59-9b50-07038b8683ad-registry-certificates\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.276092 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.276077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7f68985-1af0-4c59-9b50-07038b8683ad-installation-pull-secrets\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.276264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.276127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-695x7\" (UniqueName: \"kubernetes.io/projected/ca996fcc-80e5-45b2-9049-fa8ea75b1769-kube-api-access-695x7\") pod \"downloads-68c9cbb497-nzc7q\" (UID: \"ca996fcc-80e5-45b2-9049-fa8ea75b1769\") " pod="openshift-console/downloads-68c9cbb497-nzc7q" Jul 14 10:01:28.276264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.276157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-registry-tls\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.276264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.276182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-bound-sa-token\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.276398 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.276275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7f68985-1af0-4c59-9b50-07038b8683ad-trusted-ca\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.276398 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.276296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7f68985-1af0-4c59-9b50-07038b8683ad-ca-trust-extracted\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.288462 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.288443 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-695x7\" (UniqueName: \"kubernetes.io/projected/ca996fcc-80e5-45b2-9049-fa8ea75b1769-kube-api-access-695x7\") pod \"downloads-68c9cbb497-nzc7q\" (UID: \"ca996fcc-80e5-45b2-9049-fa8ea75b1769\") " pod="openshift-console/downloads-68c9cbb497-nzc7q" Jul 14 10:01:28.300609 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.300591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:28.376840 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.376817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7f68985-1af0-4c59-9b50-07038b8683ad-registry-certificates\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.376937 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.376847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7f68985-1af0-4c59-9b50-07038b8683ad-installation-pull-secrets\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.376937 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.376869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-registry-tls\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.376937 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.376886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-bound-sa-token\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.376937 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.376913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7f68985-1af0-4c59-9b50-07038b8683ad-trusted-ca\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.377141 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.376937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7f68985-1af0-4c59-9b50-07038b8683ad-ca-trust-extracted\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.377141 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.377027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h77lv\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-kube-api-access-h77lv\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.377141 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.377073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7f68985-1af0-4c59-9b50-07038b8683ad-image-registry-private-configuration\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.377429 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.377397 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7f68985-1af0-4c59-9b50-07038b8683ad-ca-trust-extracted\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.377819 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.377800 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7f68985-1af0-4c59-9b50-07038b8683ad-registry-certificates\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.377819 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.377814 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7f68985-1af0-4c59-9b50-07038b8683ad-trusted-ca\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.379316 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.379272 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7f68985-1af0-4c59-9b50-07038b8683ad-installation-pull-secrets\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.379809 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.379784 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7f68985-1af0-4c59-9b50-07038b8683ad-image-registry-private-configuration\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.379919 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.379865 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-registry-tls\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.384675 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.384635 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-bound-sa-token\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.385479 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.385462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h77lv\" (UniqueName: \"kubernetes.io/projected/a7f68985-1af0-4c59-9b50-07038b8683ad-kube-api-access-h77lv\") pod \"image-registry-fb9857868-tx5bh\" (UID: \"a7f68985-1af0-4c59-9b50-07038b8683ad\") " pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.440300 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.440282 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-nzc7q" Jul 14 10:01:28.494223 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.494194 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:28.533658 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.533635 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:28.558227 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.558204 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-nzc7q"] Jul 14 10:01:28.560077 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:28.560035 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca996fcc_80e5_45b2_9049_fa8ea75b1769.slice/crio-7cc370060a19e713fc87bbaf2ae3d8008efbe3842adb099d6726ea0d9f7e8ead WatchSource:0}: Error finding container 7cc370060a19e713fc87bbaf2ae3d8008efbe3842adb099d6726ea0d9f7e8ead: Status 404 returned error can't find the container with id 7cc370060a19e713fc87bbaf2ae3d8008efbe3842adb099d6726ea0d9f7e8ead Jul 14 10:01:28.561953 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.561928 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:28.653948 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.653884 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fb9857868-tx5bh"] Jul 14 10:01:28.656643 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:28.656620 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f68985_1af0_4c59_9b50_07038b8683ad.slice/crio-3c580135ea8a5163efa0173ec5e1b8d9e950e6d169988e1c72245c79bd957b1a WatchSource:0}: Error finding container 3c580135ea8a5163efa0173ec5e1b8d9e950e6d169988e1c72245c79bd957b1a: Status 404 returned error can't find the container with id 3c580135ea8a5163efa0173ec5e1b8d9e950e6d169988e1c72245c79bd957b1a Jul 14 10:01:28.923182 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.923100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:28.979925 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:28.979896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:29.516587 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:29.516550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fb9857868-tx5bh" event={"ID":"a7f68985-1af0-4c59-9b50-07038b8683ad","Type":"ContainerStarted","Data":"e6bde04406cb8b99d9fcc3585ef6c7687ecae9d59f552c8e9eaac9c14b6d1777"} Jul 14 10:01:29.517059 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:29.516639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fb9857868-tx5bh" event={"ID":"a7f68985-1af0-4c59-9b50-07038b8683ad","Type":"ContainerStarted","Data":"3c580135ea8a5163efa0173ec5e1b8d9e950e6d169988e1c72245c79bd957b1a"} Jul 14 10:01:29.517059 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:29.516818 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:29.518048 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:29.518021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-nzc7q" event={"ID":"ca996fcc-80e5-45b2-9049-fa8ea75b1769","Type":"ContainerStarted","Data":"7cc370060a19e713fc87bbaf2ae3d8008efbe3842adb099d6726ea0d9f7e8ead"} Jul 14 10:01:29.536324 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:29.536282 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fb9857868-tx5bh" podStartSLOduration=1.53626675 podStartE2EDuration="1.53626675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:29.535829921 +0000 UTC m=+59.817038049" watchObservedRunningTime="2026-07-14 10:01:29.53626675 +0000 UTC m=+59.817474873" Jul 14 10:01:30.885176 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:30.885133 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:30.982664 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:30.982635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:31.124126 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:31.124076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:31.224793 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:31.224694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:31.323672 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:31.323638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:32.164852 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:32.164821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:32.266060 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:32.265949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:32.428384 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:32.428311 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrkr" Jul 14 10:01:33.142533 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.142500 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:33.243868 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.243825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:33.320665 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.320635 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7569848455-44zfv"] Jul 14 10:01:33.323481 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.323453 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.326000 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.325980 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 10:01:33.327468 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.327306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 10:01:33.327468 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.327351 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5ltrq\"" Jul 14 10:01:33.327468 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.327363 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 10:01:33.327723 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.327702 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 10:01:33.327723 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.327717 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 10:01:33.332043 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.332022 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 10:01:33.335200 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.335148 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7569848455-44zfv"] Jul 14 10:01:33.346682 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.346648 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:33.404081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.403995 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:33.417874 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.417847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-serving-cert\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.418041 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.417904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5rgg\" (UniqueName: \"kubernetes.io/projected/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-kube-api-access-x5rgg\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.418041 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.417944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-config\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.418041 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.417983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-trusted-ca-bundle\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.418199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.418074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-oauth-config\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.418199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.418108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-service-ca\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.418199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.418164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-oauth-serving-cert\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.518963 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.518929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-oauth-serving-cert\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.519151 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.518987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-serving-cert\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.519151 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.519017 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5rgg\" (UniqueName: \"kubernetes.io/projected/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-kube-api-access-x5rgg\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.519151 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.519045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-config\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.519151 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.519078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-trusted-ca-bundle\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.519151 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.519119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-oauth-config\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.519151 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.519147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-service-ca\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.519791 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.519733 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-oauth-serving-cert\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.519920 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.519881 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-service-ca\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.520290 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.520247 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-trusted-ca-bundle\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.520390 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.520320 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-config\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.521845 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.521822 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-serving-cert\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.521957 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.521937 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-oauth-config\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.527440 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.527413 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5rgg\" (UniqueName: \"kubernetes.io/projected/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-kube-api-access-x5rgg\") pod \"console-7569848455-44zfv\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.636475 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.636428 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:33.776110 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:33.776079 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7569848455-44zfv"] Jul 14 10:01:33.779513 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:33.779474 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd590cae6_7d95_46d1_a3c7_bb989c1f6ee9.slice/crio-dd9b8867985efec17a82107ba62392d5f5695762f8b2873455e5d4c47e5305a5 WatchSource:0}: Error finding container dd9b8867985efec17a82107ba62392d5f5695762f8b2873455e5d4c47e5305a5: Status 404 returned error can't find the container with id dd9b8867985efec17a82107ba62392d5f5695762f8b2873455e5d4c47e5305a5 Jul 14 10:01:34.502137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:34.502025 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n7cjs" Jul 14 10:01:34.539058 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:34.539013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569848455-44zfv" event={"ID":"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9","Type":"ContainerStarted","Data":"dd9b8867985efec17a82107ba62392d5f5695762f8b2873455e5d4c47e5305a5"} Jul 14 10:01:35.712573 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:35.712537 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:35.943083 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:35.943044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:01:35.943273 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:35.943092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:35.946070 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:35.945969 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 10:01:35.947066 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:35.947043 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 10:01:35.956733 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:35.956705 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31f1fe5-a4e5-431f-ab06-76962e254bc6-original-pull-secret\") pod \"global-pull-secret-syncer-xpr87\" (UID: \"e31f1fe5-a4e5-431f-ab06-76962e254bc6\") " pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:01:35.956733 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:35.956722 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c22291bc-7211-41c1-a8ab-72d4590d2734-metrics-certs\") pod \"network-metrics-daemon-srlpr\" (UID: \"c22291bc-7211-41c1-a8ab-72d4590d2734\") " pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:36.043646 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.043567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:36.046357 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.046328 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 10:01:36.056392 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.056363 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 10:01:36.067602 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.067556 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svlkn\" (UniqueName: \"kubernetes.io/projected/9bd128ba-13cb-451f-8e5d-5a0ebb967d0c-kube-api-access-svlkn\") pod \"network-check-target-wzhrp\" (UID: \"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c\") " pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:36.173925 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.173897 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pz2v6\"" Jul 14 10:01:36.181269 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.181246 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vm2xk\"" Jul 14 10:01:36.181438 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.181412 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:36.185635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.185472 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpr87" Jul 14 10:01:36.189826 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.189793 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srlpr" Jul 14 10:01:36.729378 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.729301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:36.792279 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:36.791130 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xpr87"] Jul 14 10:01:36.794560 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:36.794495 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31f1fe5_a4e5_431f_ab06_76962e254bc6.slice/crio-a4d685990efa70389166031b504c63ca13b7bb9635ad231a1a56b7070e1a387b WatchSource:0}: Error finding container a4d685990efa70389166031b504c63ca13b7bb9635ad231a1a56b7070e1a387b: Status 404 returned error can't find the container with id a4d685990efa70389166031b504c63ca13b7bb9635ad231a1a56b7070e1a387b Jul 14 10:01:37.019876 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:37.019849 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wzhrp"] Jul 14 10:01:37.021146 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:37.021120 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-srlpr"] Jul 14 10:01:37.022260 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:37.022233 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd128ba_13cb_451f_8e5d_5a0ebb967d0c.slice/crio-58aeb5cb85926d2fdb429c3afb2ab2c089d956d26b8d8c4499c4297baa1430ee WatchSource:0}: Error finding container 58aeb5cb85926d2fdb429c3afb2ab2c089d956d26b8d8c4499c4297baa1430ee: Status 404 returned error can't find the container with id 58aeb5cb85926d2fdb429c3afb2ab2c089d956d26b8d8c4499c4297baa1430ee Jul 14 10:01:37.024757 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:37.024645 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22291bc_7211_41c1_a8ab_72d4590d2734.slice/crio-d8ae9d94f0fcbcfc463a62f421ecac386fce45d084c94c8fb6637271e0d11cd4 WatchSource:0}: Error finding container d8ae9d94f0fcbcfc463a62f421ecac386fce45d084c94c8fb6637271e0d11cd4: Status 404 returned error can't find the container with id d8ae9d94f0fcbcfc463a62f421ecac386fce45d084c94c8fb6637271e0d11cd4 Jul 14 10:01:37.553055 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:37.552962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srlpr" event={"ID":"c22291bc-7211-41c1-a8ab-72d4590d2734","Type":"ContainerStarted","Data":"d8ae9d94f0fcbcfc463a62f421ecac386fce45d084c94c8fb6637271e0d11cd4"} Jul 14 10:01:37.554858 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:37.554783 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wzhrp" event={"ID":"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c","Type":"ContainerStarted","Data":"58aeb5cb85926d2fdb429c3afb2ab2c089d956d26b8d8c4499c4297baa1430ee"} Jul 14 10:01:37.556797 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:37.556773 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569848455-44zfv" event={"ID":"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9","Type":"ContainerStarted","Data":"ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9"} Jul 14 10:01:37.559465 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:37.559406 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xpr87" event={"ID":"e31f1fe5-a4e5-431f-ab06-76962e254bc6","Type":"ContainerStarted","Data":"a4d685990efa70389166031b504c63ca13b7bb9635ad231a1a56b7070e1a387b"} Jul 14 10:01:37.578609 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:37.576867 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7569848455-44zfv" podStartSLOduration=1.680653812 podStartE2EDuration="4.576850129s" totalImagesPullingTime="2.896196317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:37.575795227 +0000 UTC m=+67.857003350" watchObservedRunningTime="2026-07-14 10:01:37.576850129 +0000 UTC m=+67.858058253" Jul 14 10:01:38.021895 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.021857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:38.232351 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.232322 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:38.274458 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.273046 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-plm9f"] Jul 14 10:01:38.280523 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.279284 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8td6f"] Jul 14 10:01:38.280523 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.280485 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.283167 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.282441 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.284727 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.284390 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wkhrf\"" Jul 14 10:01:38.284727 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.284554 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 10:01:38.284727 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.284615 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 10:01:38.284950 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.284810 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 10:01:38.285003 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.284989 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 10:01:38.286757 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.285244 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 10:01:38.288400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.287111 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 10:01:38.288400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.287350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 10:01:38.288400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.287398 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2vrpr\"" Jul 14 10:01:38.288400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.287350 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 10:01:38.288400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.287567 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 10:01:38.303107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.302344 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8td6f"] Jul 14 10:01:38.342133 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.342108 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:38.364931 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.364905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q44bc\" (UniqueName: \"kubernetes.io/projected/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-kube-api-access-q44bc\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.365034 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.364958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:38.365034 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.364994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.365034 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/109f4a95-7e13-401f-8672-d1e510a5a845-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.365189 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-textfile\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.365189 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365081 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jckd\" (UniqueName: \"kubernetes.io/projected/109f4a95-7e13-401f-8672-d1e510a5a845-kube-api-access-2jckd\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.365289 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.365289 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-tls\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.365392 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-wtmp\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.365392 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365331 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.365392 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-root\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.365530 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/109f4a95-7e13-401f-8672-d1e510a5a845-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.365530 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-metrics-client-ca\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.365530 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.365530 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.365712 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.365543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-sys\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.377551 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.376396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/179d3e74-4f58-420f-b67e-0066dc913005-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-49llj\" (UID: \"179d3e74-4f58-420f-b67e-0066dc913005\") " pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:38.466729 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.466865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-tls\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.466865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-wtmp\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.466865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.467025 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-root\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.467025 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/109f4a95-7e13-401f-8672-d1e510a5a845-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.467025 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-metrics-client-ca\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.467025 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.467025 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.466997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.467025 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.467021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-sys\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.467312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.467059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q44bc\" (UniqueName: \"kubernetes.io/projected/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-kube-api-access-q44bc\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.467312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.467113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.467312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.467141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/109f4a95-7e13-401f-8672-d1e510a5a845-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.467312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.467179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-textfile\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.467312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.467203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jckd\" (UniqueName: \"kubernetes.io/projected/109f4a95-7e13-401f-8672-d1e510a5a845-kube-api-access-2jckd\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.468066 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.468436 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-root\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:38.468524 2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.468553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-wtmp\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:38.468585 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-tls podName:109f4a95-7e13-401f-8672-d1e510a5a845 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:38.968565482 +0000 UTC m=+69.249773597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-8td6f" (UID: "109f4a95-7e13-401f-8672-d1e510a5a845") : secret "kube-state-metrics-tls" not found Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.468999 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.469209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-metrics-client-ca\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.469224 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/109f4a95-7e13-401f-8672-d1e510a5a845-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.469294 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-sys\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.469551 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/109f4a95-7e13-401f-8672-d1e510a5a845-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.469782 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.469839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.469802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-textfile\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.473377 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.472036 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.473377 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.472546 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.476448 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.476392 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jckd\" (UniqueName: \"kubernetes.io/projected/109f4a95-7e13-401f-8672-d1e510a5a845-kube-api-access-2jckd\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.480961 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.480929 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-node-exporter-tls\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.484481 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.484439 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q44bc\" (UniqueName: \"kubernetes.io/projected/b319cabb-d68c-40aa-83bf-7c7f7ac467a9-kube-api-access-q44bc\") pod \"node-exporter-plm9f\" (UID: \"b319cabb-d68c-40aa-83bf-7c7f7ac467a9\") " pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.531706 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.528129 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:38.572836 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.572799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srlpr" event={"ID":"c22291bc-7211-41c1-a8ab-72d4590d2734","Type":"ContainerStarted","Data":"bafb6c9c76546778eefdbf874fd460b9307d27e95fe6fd62bc0bfc35ed8edc18"} Jul 14 10:01:38.572989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.572902 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srlpr" event={"ID":"c22291bc-7211-41c1-a8ab-72d4590d2734","Type":"ContainerStarted","Data":"684e4b09372950d9886228fe41a96efd23a17661d644fab8d028374b320cb381"} Jul 14 10:01:38.591501 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.591388 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-srlpr" podStartSLOduration=67.399638176 podStartE2EDuration="1m8.591373306s" totalImagesPullingTime="1.19173513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:38.590969347 +0000 UTC m=+68.872177470" watchObservedRunningTime="2026-07-14 10:01:38.591373306 +0000 UTC m=+68.872581430" Jul 14 10:01:38.593655 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.593354 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-szrgf\"" Jul 14 10:01:38.598977 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.598794 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-plm9f" Jul 14 10:01:38.601954 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.601875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-49llj" Jul 14 10:01:38.809314 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.809178 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-49llj"] Jul 14 10:01:38.813999 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:38.813961 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179d3e74_4f58_420f_b67e_0066dc913005.slice/crio-84c14e3a8290c558e3918a31f64a89a70cd08c44c3c9999263452dcbdbe1f7d0 WatchSource:0}: Error finding container 84c14e3a8290c558e3918a31f64a89a70cd08c44c3c9999263452dcbdbe1f7d0: Status 404 returned error can't find the container with id 84c14e3a8290c558e3918a31f64a89a70cd08c44c3c9999263452dcbdbe1f7d0 Jul 14 10:01:38.970955 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.970919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:38.975097 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:38.975066 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f4a95-7e13-401f-8672-d1e510a5a845-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8td6f\" (UID: \"109f4a95-7e13-401f-8672-d1e510a5a845\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:39.219121 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.219089 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" Jul 14 10:01:39.326326 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.326143 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 10:01:39.361869 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.359654 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 10:01:39.361869 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.359844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.369239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.365350 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 10:01:39.369239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.366093 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 10:01:39.369239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.366307 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l8mk9\"" Jul 14 10:01:39.369239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.366493 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 10:01:39.369239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.366690 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 10:01:39.369239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.366919 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 10:01:39.369239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.368063 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 10:01:39.369239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.368430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 10:01:39.371201 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.371019 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 10:01:39.378095 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.377466 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 10:01:39.415983 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.415926 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8td6f"] Jul 14 10:01:39.427936 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:39.422271 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109f4a95_7e13_401f_8672_d1e510a5a845.slice/crio-0f326232b9f4d0af3818bfa86784548214adde002576a345d2c26270b428ecc3 WatchSource:0}: Error finding container 0f326232b9f4d0af3818bfa86784548214adde002576a345d2c26270b428ecc3: Status 404 returned error can't find the container with id 0f326232b9f4d0af3818bfa86784548214adde002576a345d2c26270b428ecc3 Jul 14 10:01:39.478038 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.477956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478038 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-web-config\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478368 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478368 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478468 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478380 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxfxx\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-kube-api-access-zxfxx\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478468 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478619 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478619 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478619 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478619 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-out\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.478839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.478659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-out\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-web-config\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxfxx\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-kube-api-access-zxfxx\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.579562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.580873 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.580596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-plm9f" event={"ID":"b319cabb-d68c-40aa-83bf-7c7f7ac467a9","Type":"ContainerStarted","Data":"1812b0d090ed14f116bfb82ab751870c314b6d018794e44a66510bcba9dda9db"} Jul 14 10:01:39.580937 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.580877 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.582382 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:39.581379 2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 14 10:01:39.582382 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.581578 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.582382 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:01:39.581775 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls podName:fc0aace1-f9f4-4aa1-90e1-e927385936d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:40.081645012 +0000 UTC m=+70.362853126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0") : secret "alertmanager-main-tls" not found Jul 14 10:01:39.584491 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.584160 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.584491 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.584453 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.584674 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.584493 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.584955 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.584928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-49llj" event={"ID":"179d3e74-4f58-420f-b67e-0066dc913005","Type":"ContainerStarted","Data":"84c14e3a8290c558e3918a31f64a89a70cd08c44c3c9999263452dcbdbe1f7d0"} Jul 14 10:01:39.587229 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.586971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" event={"ID":"109f4a95-7e13-401f-8672-d1e510a5a845","Type":"ContainerStarted","Data":"0f326232b9f4d0af3818bfa86784548214adde002576a345d2c26270b428ecc3"} Jul 14 10:01:39.587229 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.587186 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.587229 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.587201 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-web-config\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.588194 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.588149 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-out\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.589535 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.589457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.589535 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.589467 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.589888 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.589851 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.590650 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.590598 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxfxx\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-kube-api-access-zxfxx\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:39.663087 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.663015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:39.719800 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:39.719694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:40.084415 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:40.084379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:40.087349 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:40.087301 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:40.192519 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:40.192435 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:40.281884 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:40.281844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:01:40.772265 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:40.772217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:40.873237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:40.873205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:41.210737 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:41.210706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:41.270688 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:41.270658 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:41.699115 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:41.699072 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:41.781045 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:41.780997 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:43.043251 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:43.043217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:43.097365 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:43.097333 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:43.635536 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:43.635500 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:43.637288 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:43.637252 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:43.637411 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:43.637305 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:43.643122 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:43.643097 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:43.689382 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:43.689352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:44.070222 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.070128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:44.166973 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.166933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:44.468855 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.468821 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:01:44.470297 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.470245 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:44.471623 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.471602 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.474271 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.474250 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 10:01:44.474271 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.474265 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 10:01:44.474271 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.474265 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 10:01:44.474499 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.474341 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 10:01:44.474499 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.474485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 10:01:44.474611 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.474590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 10:01:44.474702 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.474683 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 10:01:44.476303 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.476276 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 10:01:44.476403 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.476335 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 10:01:44.476875 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.476857 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 10:01:44.477847 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.477251 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s9b8f\"" Jul 14 10:01:44.480386 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.479250 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 10:01:44.480386 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.479898 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 10:01:44.480386 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.480193 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-n8dbv7mspfko\"" Jul 14 10:01:44.482213 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.482184 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 10:01:44.482320 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.482216 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 10:01:44.482924 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.482903 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 10:01:44.488770 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.488736 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:01:44.611270 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.611242 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7569848455-44zfv" Jul 14 10:01:44.625368 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625513 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625513 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625513 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625513 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625724 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625724 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625724 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-web-config\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625724 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.625724 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config-out\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625796 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626011 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.625991 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626282 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.626035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.626282 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.626060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh5r5\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-kube-api-access-bh5r5\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.726693 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.726613 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.726693 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.726647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh5r5\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-kube-api-access-bh5r5\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.726693 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.726678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.726973 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.726701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.726973 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.726725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.726973 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.726779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.726973 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.726808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.726973 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.726848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727205 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727205 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727087 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727205 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-web-config\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727205 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727205 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config-out\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727637 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727731 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.727820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.727811 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.728052 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.728029 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.730004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.728364 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.730004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.728468 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.731512 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.731400 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.731634 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.731587 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.731875 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.731853 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-web-config\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.732112 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.732089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.732194 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.732172 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.732283 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.732263 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config-out\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.732587 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.732535 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.732931 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.732891 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.733157 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.733089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.733430 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.733394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.733534 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.733515 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.733676 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.733645 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.734887 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.734857 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh5r5\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-kube-api-access-bh5r5\") pod \"prometheus-k8s-0\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:44.784568 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:44.784536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:01:46.795082 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:46.795034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:46.896446 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:46.896408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:47.168312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:47.168271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:48.250620 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:48.250579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:49.781601 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:49.781556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:50.526788 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:50.526759 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fb9857868-tx5bh" Jul 14 10:01:50.530100 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:50.530047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:50.673535 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:50.673506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:50.724863 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:50.724797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:50.741452 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:50.741422 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 10:01:50.761788 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:50.761536 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:01:50.811339 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:50.811257 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:50.871771 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:50.871680 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:51.079981 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:01:51.079486 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0aace1_f9f4_4aa1_90e1_e927385936d0.slice/crio-2e5f75d5a2ca0382c6b0432a9a34a1d7d5f149f4dae94d85fe2a2fc86fb2b33b WatchSource:0}: Error finding container 2e5f75d5a2ca0382c6b0432a9a34a1d7d5f149f4dae94d85fe2a2fc86fb2b33b: Status 404 returned error can't find the container with id 2e5f75d5a2ca0382c6b0432a9a34a1d7d5f149f4dae94d85fe2a2fc86fb2b33b Jul 14 10:01:51.643755 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.643719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wzhrp" event={"ID":"9bd128ba-13cb-451f-8e5d-5a0ebb967d0c","Type":"ContainerStarted","Data":"fa1446104d3b20e0eee1d989c8f22b5a6827cebf38aa28dd92806a59a9d71efc"} Jul 14 10:01:51.644235 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.644212 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:01:51.647407 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.647382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" event={"ID":"109f4a95-7e13-401f-8672-d1e510a5a845","Type":"ContainerStarted","Data":"830ee2e67acc216b5a9f834d5a1238db56a98a7309ec1f3159a078ddff607f61"} Jul 14 10:01:51.647515 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.647461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" event={"ID":"109f4a95-7e13-401f-8672-d1e510a5a845","Type":"ContainerStarted","Data":"653ac3d5189a843f6a98aa189168f4f744dc8f85319d49a2995b6634ef0ca625"} Jul 14 10:01:51.647515 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.647498 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" event={"ID":"109f4a95-7e13-401f-8672-d1e510a5a845","Type":"ContainerStarted","Data":"26e8d1681212b254d793d0633ce5166f15e1fdd72689f4d258ea2f9b1d48968c"} Jul 14 10:01:51.650516 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.650081 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-nzc7q" event={"ID":"ca996fcc-80e5-45b2-9049-fa8ea75b1769","Type":"ContainerStarted","Data":"ea0348d0de59d9839f5d35bc651e5f90cd53416b83f73582c92f43aaf1c284d6"} Jul 14 10:01:51.650516 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.650136 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-nzc7q" Jul 14 10:01:51.653104 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.653012 2565 generic.go:356] "Generic (PLEG): container finished" podID="b319cabb-d68c-40aa-83bf-7c7f7ac467a9" containerID="a8e67fc3f8844e9ad9c9f7f54b27e70a3471a645b9adb333d90a05eb43bef69e" exitCode=0 Jul 14 10:01:51.653104 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.653046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-plm9f" event={"ID":"b319cabb-d68c-40aa-83bf-7c7f7ac467a9","Type":"ContainerDied","Data":"a8e67fc3f8844e9ad9c9f7f54b27e70a3471a645b9adb333d90a05eb43bef69e"} Jul 14 10:01:51.655884 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.655670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerStarted","Data":"fb0c959af32f60b37e9c00eb20299d94ff7633e1ddc2dfd6631c64c185d8bd0b"} Jul 14 10:01:51.658469 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.658197 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xpr87" event={"ID":"e31f1fe5-a4e5-431f-ab06-76962e254bc6","Type":"ContainerStarted","Data":"7c0f9eb182da1174bc8c2d3fd32fb93bf91409cfeeaabfc5a12a740d08d6cbdb"} Jul 14 10:01:51.661040 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.660965 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerStarted","Data":"2e5f75d5a2ca0382c6b0432a9a34a1d7d5f149f4dae94d85fe2a2fc86fb2b33b"} Jul 14 10:01:51.662635 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.662593 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wzhrp" podStartSLOduration=68.114235546 podStartE2EDuration="1m21.662576623s" totalImagesPullingTime="13.548341077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:51.66060452 +0000 UTC m=+81.941812641" watchObservedRunningTime="2026-07-14 10:01:51.662576623 +0000 UTC m=+81.943784744" Jul 14 10:01:51.664448 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.664404 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-nzc7q" Jul 14 10:01:51.681992 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.681571 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xpr87" podStartSLOduration=67.906924319 podStartE2EDuration="1m21.681553554s" totalImagesPullingTime="13.774629235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:51.676077526 +0000 UTC m=+81.957285650" watchObservedRunningTime="2026-07-14 10:01:51.681553554 +0000 UTC m=+81.962761671" Jul 14 10:01:51.696451 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.696159 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-nzc7q" podStartSLOduration=1.167534048 podStartE2EDuration="23.696140033s" totalImagesPullingTime="22.528605985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:51.695048222 +0000 UTC m=+81.976256345" watchObservedRunningTime="2026-07-14 10:01:51.696140033 +0000 UTC m=+81.977348156" Jul 14 10:01:51.759349 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:51.758198 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-8td6f" podStartSLOduration=2.029671367 podStartE2EDuration="13.758172463s" totalImagesPullingTime="11.728501096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:51.737717449 +0000 UTC m=+82.018925564" watchObservedRunningTime="2026-07-14 10:01:51.758172463 +0000 UTC m=+82.039380586" Jul 14 10:01:52.670323 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:52.669978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-plm9f" event={"ID":"b319cabb-d68c-40aa-83bf-7c7f7ac467a9","Type":"ContainerStarted","Data":"17ff8dd55e0ad562cb7de52849d194adb7bb4365a60e23f6da6ba5299e2f5169"} Jul 14 10:01:52.670869 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:52.670837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-plm9f" event={"ID":"b319cabb-d68c-40aa-83bf-7c7f7ac467a9","Type":"ContainerStarted","Data":"add54be65bb067ddfd0ca7511edf3c9a3bd2a5ad2582ddcd8f0089a08605b8a4"} Jul 14 10:01:52.689220 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:52.689132 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-plm9f" podStartSLOduration=2.648182663 podStartE2EDuration="14.689114035s" totalImagesPullingTime="11.943747565s" totalInitContainerRuntime="97.183807ms" isStatefulPod=true podCreationTimestamp="2026-07-14 10:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:52.688531266 +0000 UTC m=+82.969739388" watchObservedRunningTime="2026-07-14 10:01:52.689114035 +0000 UTC m=+82.970322178" Jul 14 10:01:52.696628 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:52.696602 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:52.788196 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:52.788159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:53.539363 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:53.539327 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:53.641231 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:53.641200 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:54.136486 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:54.136450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:54.235128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:54.235091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:54.680761 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:54.680696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:54.782242 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:54.782209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:54.882267 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:54.882233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:56.687410 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:56.687370 2565 generic.go:356] "Generic (PLEG): container finished" podID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerID="4cc42040b0de4c46df47fc37ac5ae7b136cc5c830c8b3ea4ead7a2696d5e7336" exitCode=0 Jul 14 10:01:56.687977 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:56.687460 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerDied","Data":"4cc42040b0de4c46df47fc37ac5ae7b136cc5c830c8b3ea4ead7a2696d5e7336"} Jul 14 10:01:56.689446 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:56.689417 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerID="70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495" exitCode=0 Jul 14 10:01:56.689556 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:56.689538 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerDied","Data":"70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495"} Jul 14 10:01:56.691464 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:56.691428 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-49llj" event={"ID":"179d3e74-4f58-420f-b67e-0066dc913005","Type":"ContainerStarted","Data":"2ebb58a3393e71e6699ad9cfd10f02c6c0838f87c6b84b2d11a8955f3113cdde"} Jul 14 10:01:57.700604 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:57.700518 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-49llj" event={"ID":"179d3e74-4f58-420f-b67e-0066dc913005","Type":"ContainerStarted","Data":"0f050fa6de46a8d861b644cb439980c2dfa73de64dbddc7b5daac009cc217427"} Jul 14 10:01:58.842839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:58.842757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:58.943466 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:58.943425 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:01:59.715169 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:59.715120 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerStarted","Data":"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f"} Jul 14 10:01:59.715322 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:01:59.715207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerStarted","Data":"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244"} Jul 14 10:02:00.464881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:00.464845 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7569848455-44zfv"] Jul 14 10:02:00.583511 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:00.583478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:00.646765 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:00.646686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:00.702946 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:00.702891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:02.165863 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:02.165826 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:02.734656 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:02.734408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerStarted","Data":"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774"} Jul 14 10:02:02.972066 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:02.972025 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:03.740076 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:03.740032 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-49llj" event={"ID":"179d3e74-4f58-420f-b67e-0066dc913005","Type":"ContainerStarted","Data":"3733281af6aaf6fea4e1e84216c3b975b51f941837f75481d101291011f75675"} Jul 14 10:02:03.742032 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:03.742015 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerStarted","Data":"bc5e1517778f979ab074c472ab72fc7e0701446e0a8796f8a233b2202f10f9f1"} Jul 14 10:02:03.742097 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:03.742071 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerStarted","Data":"3bbe6f9e97d59c7b81184bbef52d639fea618a5e61b9c1f8bb1c250adb188316"} Jul 14 10:02:03.744977 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:03.744955 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerStarted","Data":"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0"} Jul 14 10:02:03.745082 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:03.745004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerStarted","Data":"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7"} Jul 14 10:02:03.760997 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:03.760952 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-49llj" podStartSLOduration=34.158344649 podStartE2EDuration="57.760935436s" totalImagesPullingTime="23.602590787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:01:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:02:03.759014382 +0000 UTC m=+94.040222505" watchObservedRunningTime="2026-07-14 10:02:03.760935436 +0000 UTC m=+94.042143571" Jul 14 10:02:04.752555 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:04.752477 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerStarted","Data":"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735"} Jul 14 10:02:04.784449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:04.784398 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=16.986876332 podStartE2EDuration="25.784381002s" totalImagesPullingTime="8.778840524s" totalInitContainerRuntime="18.664146ms" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:02:04.782811598 +0000 UTC m=+95.064019720" watchObservedRunningTime="2026-07-14 10:02:04.784381002 +0000 UTC m=+95.065589124" Jul 14 10:02:08.771608 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:08.771522 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerStarted","Data":"4835ffdfcbf116ddf8d759e7009f2cc534a1dba45c9e003acac81296e55b41f3"} Jul 14 10:02:08.771608 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:08.771584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerStarted","Data":"445827ae57367b329a02d11868c3cdbc181ec58ffdcf95975e6331af4fec21d8"} Jul 14 10:02:08.772161 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:08.771610 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerStarted","Data":"24200d1152c466153c9294f9f7bd958cf032483c3636259d8d2d9b8e3658bf0f"} Jul 14 10:02:08.772161 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:08.771636 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerStarted","Data":"0c4684046659ef6d2b0bdc2165dcdf7ef6cefed265e4167ac9115c608aa175cf"} Jul 14 10:02:08.799535 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:08.799484 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.800837652 podStartE2EDuration="24.799455007s" totalImagesPullingTime="15.977068635s" totalInitContainerRuntime="21.54872ms" isStatefulPod=false podCreationTimestamp="2026-07-14 10:01:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:02:08.797700045 +0000 UTC m=+99.078908164" watchObservedRunningTime="2026-07-14 10:02:08.799455007 +0000 UTC m=+99.080663144" Jul 14 10:02:09.785110 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:09.785079 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:02:15.156391 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:15.156347 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:15.258178 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:15.258149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:17.166959 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:17.166915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:17.265628 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:17.265586 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:22.673912 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:22.673882 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wzhrp" Jul 14 10:02:25.496171 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.496126 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7569848455-44zfv" podUID="d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" containerName="console" containerID="cri-o://ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9" gracePeriod=15 Jul 14 10:02:25.736895 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.736870 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569848455-44zfv" Jul 14 10:02:25.798775 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.798675 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-config\") pod \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " Jul 14 10:02:25.798775 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.798711 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5rgg\" (UniqueName: \"kubernetes.io/projected/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-kube-api-access-x5rgg\") pod \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " Jul 14 10:02:25.798775 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.798731 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-trusted-ca-bundle\") pod \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " Jul 14 10:02:25.799047 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.798781 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-oauth-config\") pod \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " Jul 14 10:02:25.799047 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.798866 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-oauth-serving-cert\") pod \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " Jul 14 10:02:25.799047 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799012 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-service-ca\") pod \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " Jul 14 10:02:25.799203 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799063 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-serving-cert\") pod \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\" (UID: \"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9\") " Jul 14 10:02:25.799203 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799172 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-config" (OuterVolumeSpecName: "console-config") pod "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" (UID: "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:02:25.799315 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799290 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" (UID: "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:02:25.799371 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799290 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" (UID: "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:02:25.799420 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799387 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-oauth-serving-cert\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:25.799420 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799408 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-config\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:25.799520 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799424 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-trusted-ca-bundle\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:25.799520 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.799454 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-service-ca" (OuterVolumeSpecName: "service-ca") pod "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" (UID: "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:02:25.801260 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.801229 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" (UID: "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:25.801260 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.801247 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-kube-api-access-x5rgg" (OuterVolumeSpecName: "kube-api-access-x5rgg") pod "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" (UID: "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9"). InnerVolumeSpecName "kube-api-access-x5rgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:02:25.801405 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.801276 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" (UID: "d590cae6-7d95-46d1-a3c7-bb989c1f6ee9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:25.833600 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.833566 2565 generic.go:356] "Generic (PLEG): container finished" podID="d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" containerID="ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9" exitCode=0 Jul 14 10:02:25.833716 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.833610 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569848455-44zfv" Jul 14 10:02:25.833716 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.833635 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569848455-44zfv" event={"ID":"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9","Type":"ContainerDied","Data":"ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9"} Jul 14 10:02:25.833716 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.833683 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569848455-44zfv" event={"ID":"d590cae6-7d95-46d1-a3c7-bb989c1f6ee9","Type":"ContainerDied","Data":"dd9b8867985efec17a82107ba62392d5f5695762f8b2873455e5d4c47e5305a5"} Jul 14 10:02:25.833843 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.833723 2565 scope.go:117] "RemoveContainer" containerID="ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9" Jul 14 10:02:25.842880 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.842863 2565 scope.go:117] "RemoveContainer" containerID="ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9" Jul 14 10:02:25.843124 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:02:25.843106 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9\": container with ID starting with ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9 not found: ID does not exist" containerID="ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9" Jul 14 10:02:25.843195 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.843130 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9"} err="failed to get container status \"ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9\": rpc error: code = NotFound desc = could not find container \"ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9\": container with ID starting with ec08dbe4a5ac88e819ca4af6690c5f8bf680fc3d9ce78b6250ca0e7362fa40c9 not found: ID does not exist" Jul 14 10:02:25.853852 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.853825 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7569848455-44zfv"] Jul 14 10:02:25.857428 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.857406 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7569848455-44zfv"] Jul 14 10:02:25.900046 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.900019 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5rgg\" (UniqueName: \"kubernetes.io/projected/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-kube-api-access-x5rgg\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:25.900046 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.900044 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-oauth-config\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:25.900193 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.900056 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-service-ca\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:25.900193 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:25.900064 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9-console-serving-cert\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:26.165634 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:26.165604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:26.165815 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:26.165707 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" path="/var/lib/kubelet/pods/d590cae6-7d95-46d1-a3c7-bb989c1f6ee9/volumes" Jul 14 10:02:26.227137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:26.227096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:26.612575 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:26.612498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:26.678280 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:26.678252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:34.748273 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:34.748234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:44.785435 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:44.785404 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:02:44.859989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:44.859962 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:02:44.915159 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:44.915137 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:02:57.415453 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:57.415416 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:57.735152 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:57.735067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:02:58.466053 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.466019 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 10:02:58.466449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.466299 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="alertmanager" containerID="cri-o://b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244" gracePeriod=120 Jul 14 10:02:58.466449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.466363 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy-metric" containerID="cri-o://a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0" gracePeriod=120 Jul 14 10:02:58.466449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.466399 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy" containerID="cri-o://7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7" gracePeriod=120 Jul 14 10:02:58.466449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.466397 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="config-reloader" containerID="cri-o://bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f" gracePeriod=120 Jul 14 10:02:58.466668 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.466438 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="prom-label-proxy" containerID="cri-o://e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735" gracePeriod=120 Jul 14 10:02:58.466668 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.466373 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy-web" containerID="cri-o://640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774" gracePeriod=120 Jul 14 10:02:58.958311 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.958280 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerID="e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735" exitCode=0 Jul 14 10:02:58.958311 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.958304 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerID="7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7" exitCode=0 Jul 14 10:02:58.958311 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.958310 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerID="bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f" exitCode=0 Jul 14 10:02:58.958311 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.958317 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerID="b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244" exitCode=0 Jul 14 10:02:58.958632 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.958355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerDied","Data":"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735"} Jul 14 10:02:58.958632 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.958458 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerDied","Data":"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7"} Jul 14 10:02:58.958632 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.958498 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerDied","Data":"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f"} Jul 14 10:02:58.958632 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:58.958539 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerDied","Data":"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244"} Jul 14 10:02:59.713381 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.713357 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:02:59.765760 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.765711 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-cluster-tls-config\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.765908 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.765796 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-trusted-ca-bundle\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.765908 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.765829 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.765908 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.765854 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-metrics-client-ca\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.765908 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.765878 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-volume\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.765916 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-main-db\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.765965 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-out\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.765996 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-tls-assets\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766023 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766064 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766101 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766147 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-web-config\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766173 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxfxx\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-kube-api-access-zxfxx\") pod \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\" (UID: \"fc0aace1-f9f4-4aa1-90e1-e927385936d0\") " Jul 14 10:02:59.766412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766168 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:02:59.766412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766210 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:02:59.766412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766377 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.766412 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.766393 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0aace1-f9f4-4aa1-90e1-e927385936d0-metrics-client-ca\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.767238 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.767182 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:02:59.770307 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.770233 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:59.770417 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.770372 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-out" (OuterVolumeSpecName: "config-out") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:02:59.770417 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.770379 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-kube-api-access-zxfxx" (OuterVolumeSpecName: "kube-api-access-zxfxx") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "kube-api-access-zxfxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:02:59.770770 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.770728 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-volume" (OuterVolumeSpecName: "config-volume") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:59.770894 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.770868 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:59.771013 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.770895 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:02:59.771013 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.770966 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:59.771135 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.771075 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:59.773795 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.773769 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:59.780434 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.780409 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-web-config" (OuterVolumeSpecName: "web-config") pod "fc0aace1-f9f4-4aa1-90e1-e927385936d0" (UID: "fc0aace1-f9f4-4aa1-90e1-e927385936d0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:59.867736 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867701 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-web-config\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867736 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867729 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxfxx\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-kube-api-access-zxfxx\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867736 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867762 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-cluster-tls-config\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867778 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867789 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-volume\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867797 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-alertmanager-main-db\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867806 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc0aace1-f9f4-4aa1-90e1-e927385936d0-config-out\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867814 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc0aace1-f9f4-4aa1-90e1-e927385936d0-tls-assets\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867822 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867831 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.867989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.867841 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc0aace1-f9f4-4aa1-90e1-e927385936d0-secret-alertmanager-main-tls\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:02:59.964572 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.964535 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerID="a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0" exitCode=0 Jul 14 10:02:59.964572 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.964560 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerID="640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774" exitCode=0 Jul 14 10:02:59.964831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.964580 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerDied","Data":"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0"} Jul 14 10:02:59.964831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.964617 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 10:02:59.964831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.964673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerDied","Data":"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774"} Jul 14 10:02:59.964831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.964717 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc0aace1-f9f4-4aa1-90e1-e927385936d0","Type":"ContainerDied","Data":"2e5f75d5a2ca0382c6b0432a9a34a1d7d5f149f4dae94d85fe2a2fc86fb2b33b"} Jul 14 10:02:59.964831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.964734 2565 scope.go:117] "RemoveContainer" containerID="e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735" Jul 14 10:02:59.973580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.973563 2565 scope.go:117] "RemoveContainer" containerID="a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0" Jul 14 10:02:59.980268 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.980248 2565 scope.go:117] "RemoveContainer" containerID="7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7" Jul 14 10:02:59.986904 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.986883 2565 scope.go:117] "RemoveContainer" containerID="640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774" Jul 14 10:02:59.988929 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.988910 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 10:02:59.991623 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.991604 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 10:02:59.994628 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:02:59.994613 2565 scope.go:117] "RemoveContainer" containerID="bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f" Jul 14 10:03:00.002692 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.002671 2565 scope.go:117] "RemoveContainer" containerID="b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244" Jul 14 10:03:00.009878 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.009862 2565 scope.go:117] "RemoveContainer" containerID="70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495" Jul 14 10:03:00.016230 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.016215 2565 scope.go:117] "RemoveContainer" containerID="e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735" Jul 14 10:03:00.016473 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:03:00.016454 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735\": container with ID starting with e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735 not found: ID does not exist" containerID="e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735" Jul 14 10:03:00.016534 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.016480 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735"} err="failed to get container status \"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735\": rpc error: code = NotFound desc = could not find container \"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735\": container with ID starting with e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735 not found: ID does not exist" Jul 14 10:03:00.016534 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.016498 2565 scope.go:117] "RemoveContainer" containerID="a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0" Jul 14 10:03:00.016713 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:03:00.016698 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0\": container with ID starting with a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0 not found: ID does not exist" containerID="a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0" Jul 14 10:03:00.016763 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.016719 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0"} err="failed to get container status \"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0\": rpc error: code = NotFound desc = could not find container \"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0\": container with ID starting with a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0 not found: ID does not exist" Jul 14 10:03:00.016763 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.016735 2565 scope.go:117] "RemoveContainer" containerID="7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7" Jul 14 10:03:00.016989 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:03:00.016972 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7\": container with ID starting with 7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7 not found: ID does not exist" containerID="7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7" Jul 14 10:03:00.017030 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.016992 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7"} err="failed to get container status \"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7\": rpc error: code = NotFound desc = could not find container \"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7\": container with ID starting with 7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7 not found: ID does not exist" Jul 14 10:03:00.017030 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017004 2565 scope.go:117] "RemoveContainer" containerID="640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774" Jul 14 10:03:00.017234 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:03:00.017218 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774\": container with ID starting with 640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774 not found: ID does not exist" containerID="640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774" Jul 14 10:03:00.017279 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017237 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774"} err="failed to get container status \"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774\": rpc error: code = NotFound desc = could not find container \"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774\": container with ID starting with 640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774 not found: ID does not exist" Jul 14 10:03:00.017279 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017249 2565 scope.go:117] "RemoveContainer" containerID="bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f" Jul 14 10:03:00.017454 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:03:00.017434 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f\": container with ID starting with bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f not found: ID does not exist" containerID="bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f" Jul 14 10:03:00.017489 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017458 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f"} err="failed to get container status \"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f\": rpc error: code = NotFound desc = could not find container \"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f\": container with ID starting with bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f not found: ID does not exist" Jul 14 10:03:00.017489 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017471 2565 scope.go:117] "RemoveContainer" containerID="b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244" Jul 14 10:03:00.017653 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:03:00.017638 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244\": container with ID starting with b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244 not found: ID does not exist" containerID="b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244" Jul 14 10:03:00.017690 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017655 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244"} err="failed to get container status \"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244\": rpc error: code = NotFound desc = could not find container \"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244\": container with ID starting with b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244 not found: ID does not exist" Jul 14 10:03:00.017690 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017666 2565 scope.go:117] "RemoveContainer" containerID="70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495" Jul 14 10:03:00.017858 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:03:00.017837 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495\": container with ID starting with 70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495 not found: ID does not exist" containerID="70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495" Jul 14 10:03:00.017961 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017863 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495"} err="failed to get container status \"70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495\": rpc error: code = NotFound desc = could not find container \"70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495\": container with ID starting with 70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495 not found: ID does not exist" Jul 14 10:03:00.017961 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.017884 2565 scope.go:117] "RemoveContainer" containerID="e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735" Jul 14 10:03:00.018083 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018067 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735"} err="failed to get container status \"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735\": rpc error: code = NotFound desc = could not find container \"e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735\": container with ID starting with e29e1e7d01246607f870592756105474dd671072453d6423e232996cf1156735 not found: ID does not exist" Jul 14 10:03:00.018130 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018084 2565 scope.go:117] "RemoveContainer" containerID="a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0" Jul 14 10:03:00.018245 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018230 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0"} err="failed to get container status \"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0\": rpc error: code = NotFound desc = could not find container \"a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0\": container with ID starting with a86a20f3b7f0ab5f0a4f518e91ece9114fd0bcc0ef2aa1effe5031c0b9b62cd0 not found: ID does not exist" Jul 14 10:03:00.018245 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018244 2565 scope.go:117] "RemoveContainer" containerID="7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7" Jul 14 10:03:00.018407 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018391 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7"} err="failed to get container status \"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7\": rpc error: code = NotFound desc = could not find container \"7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7\": container with ID starting with 7dfd4371294d6de893b2813e5eb0fc990364a3c98d8e9e9f7c1f8317c83e7dd7 not found: ID does not exist" Jul 14 10:03:00.018443 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018408 2565 scope.go:117] "RemoveContainer" containerID="640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774" Jul 14 10:03:00.018588 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018573 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774"} err="failed to get container status \"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774\": rpc error: code = NotFound desc = could not find container \"640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774\": container with ID starting with 640b22ab088bafbce8bb79a24ad93e78a82ac163d436e4defe9bef354b27c774 not found: ID does not exist" Jul 14 10:03:00.018639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018588 2565 scope.go:117] "RemoveContainer" containerID="bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f" Jul 14 10:03:00.018784 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018767 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f"} err="failed to get container status \"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f\": rpc error: code = NotFound desc = could not find container \"bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f\": container with ID starting with bd9bf24c8e746154b0496f057714507c69efb66a069f64e5f4f867cd5411687f not found: ID does not exist" Jul 14 10:03:00.018784 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018783 2565 scope.go:117] "RemoveContainer" containerID="b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244" Jul 14 10:03:00.019012 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.018996 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244"} err="failed to get container status \"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244\": rpc error: code = NotFound desc = could not find container \"b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244\": container with ID starting with b8a2ad94d010920b5cf006d4ab46afa6664f02509593ee0bbd10f29434911244 not found: ID does not exist" Jul 14 10:03:00.019012 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.019011 2565 scope.go:117] "RemoveContainer" containerID="70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495" Jul 14 10:03:00.019233 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.019216 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495"} err="failed to get container status \"70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495\": rpc error: code = NotFound desc = could not find container \"70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495\": container with ID starting with 70229a87b0f22629a8a257bf5b1d413ac16b3d2ce613aeaf0c17bb63ae0df495 not found: ID does not exist" Jul 14 10:03:00.164188 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:00.164163 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" path="/var/lib/kubelet/pods/fc0aace1-f9f4-4aa1-90e1-e927385936d0/volumes" Jul 14 10:03:02.810421 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.810384 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:03:02.810958 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.810690 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy" containerID="cri-o://445827ae57367b329a02d11868c3cdbc181ec58ffdcf95975e6331af4fec21d8" gracePeriod=600 Jul 14 10:03:02.810958 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.810782 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="thanos-sidecar" containerID="cri-o://0c4684046659ef6d2b0bdc2165dcdf7ef6cefed265e4167ac9115c608aa175cf" gracePeriod=600 Jul 14 10:03:02.810958 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.810820 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy-web" containerID="cri-o://24200d1152c466153c9294f9f7bd958cf032483c3636259d8d2d9b8e3658bf0f" gracePeriod=600 Jul 14 10:03:02.810958 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.810666 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="prometheus" containerID="cri-o://3bbe6f9e97d59c7b81184bbef52d639fea618a5e61b9c1f8bb1c250adb188316" gracePeriod=600 Jul 14 10:03:02.810958 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.810784 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="config-reloader" containerID="cri-o://bc5e1517778f979ab074c472ab72fc7e0701446e0a8796f8a233b2202f10f9f1" gracePeriod=600 Jul 14 10:03:02.810958 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.810807 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4835ffdfcbf116ddf8d759e7009f2cc534a1dba45c9e003acac81296e55b41f3" gracePeriod=600 Jul 14 10:03:02.978882 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.978844 2565 generic.go:356] "Generic (PLEG): container finished" podID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerID="4835ffdfcbf116ddf8d759e7009f2cc534a1dba45c9e003acac81296e55b41f3" exitCode=0 Jul 14 10:03:02.978882 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.978876 2565 generic.go:356] "Generic (PLEG): container finished" podID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerID="445827ae57367b329a02d11868c3cdbc181ec58ffdcf95975e6331af4fec21d8" exitCode=0 Jul 14 10:03:02.978882 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.978885 2565 generic.go:356] "Generic (PLEG): container finished" podID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerID="24200d1152c466153c9294f9f7bd958cf032483c3636259d8d2d9b8e3658bf0f" exitCode=0 Jul 14 10:03:02.978882 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.978892 2565 generic.go:356] "Generic (PLEG): container finished" podID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerID="0c4684046659ef6d2b0bdc2165dcdf7ef6cefed265e4167ac9115c608aa175cf" exitCode=0 Jul 14 10:03:02.979199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.978899 2565 generic.go:356] "Generic (PLEG): container finished" podID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerID="bc5e1517778f979ab074c472ab72fc7e0701446e0a8796f8a233b2202f10f9f1" exitCode=0 Jul 14 10:03:02.979199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.978906 2565 generic.go:356] "Generic (PLEG): container finished" podID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerID="3bbe6f9e97d59c7b81184bbef52d639fea618a5e61b9c1f8bb1c250adb188316" exitCode=0 Jul 14 10:03:02.979199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.978932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerDied","Data":"4835ffdfcbf116ddf8d759e7009f2cc534a1dba45c9e003acac81296e55b41f3"} Jul 14 10:03:02.979199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.979021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerDied","Data":"445827ae57367b329a02d11868c3cdbc181ec58ffdcf95975e6331af4fec21d8"} Jul 14 10:03:02.979199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.979061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerDied","Data":"24200d1152c466153c9294f9f7bd958cf032483c3636259d8d2d9b8e3658bf0f"} Jul 14 10:03:02.979199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.979099 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerDied","Data":"0c4684046659ef6d2b0bdc2165dcdf7ef6cefed265e4167ac9115c608aa175cf"} Jul 14 10:03:02.979199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.979132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerDied","Data":"bc5e1517778f979ab074c472ab72fc7e0701446e0a8796f8a233b2202f10f9f1"} Jul 14 10:03:02.979199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:02.979165 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerDied","Data":"3bbe6f9e97d59c7b81184bbef52d639fea618a5e61b9c1f8bb1c250adb188316"} Jul 14 10:03:03.046320 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.046296 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:03.095229 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095155 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095229 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095190 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-2\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095229 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095213 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095488 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095238 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-serving-certs-ca-bundle\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095488 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095369 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-thanos-prometheus-http-client-file\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095488 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095409 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-kube-rbac-proxy\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095488 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095444 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-metrics-client-certs\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095488 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095471 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-kubelet-serving-ca-bundle\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095519 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-trusted-ca-bundle\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095545 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-web-config\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095571 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-grpc-tls\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095577 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095601 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-tls\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095624 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095645 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-0\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095673 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-metrics-client-ca\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095699 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-tls-assets\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.095768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095728 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-1\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.096262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095773 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.096262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095803 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-db\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.096262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095833 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config-out\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.096262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095896 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh5r5\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-kube-api-access-bh5r5\") pod \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\" (UID: \"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b\") " Jul 14 10:03:03.096262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.095954 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:03:03.096262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.096135 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.096262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.096159 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.096262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.096176 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.097253 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.096709 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:03:03.097253 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.096972 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:03:03.099545 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.099504 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:03:03.099976 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.099888 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:03:03.100941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.100901 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:03:03.101314 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.101288 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-kube-api-access-bh5r5" (OuterVolumeSpecName: "kube-api-access-bh5r5") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "kube-api-access-bh5r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:03:03.101400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.101335 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config-out" (OuterVolumeSpecName: "config-out") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:03:03.101521 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.101500 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config" (OuterVolumeSpecName: "config") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.101865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.101656 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.101865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.101698 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:03:03.101865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.101796 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.102092 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.101874 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.102092 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.101939 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.102092 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.102053 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.102223 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.102129 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.102281 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.102266 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.109523 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.109499 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-web-config" (OuterVolumeSpecName: "web-config") pod "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" (UID: "b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:03:03.196695 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196660 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196704 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196726 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-kube-rbac-proxy\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196735 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-metrics-client-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196761 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196771 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-web-config\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196782 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-grpc-tls\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196790 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196798 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196807 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-configmap-metrics-client-ca\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196815 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-tls-assets\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196824 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196834 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196843 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-prometheus-k8s-db\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196851 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config-out\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196860 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh5r5\" (UniqueName: \"kubernetes.io/projected/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-kube-api-access-bh5r5\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.196881 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.196868 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b-config\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:03:03.985812 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.985777 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b","Type":"ContainerDied","Data":"fb0c959af32f60b37e9c00eb20299d94ff7633e1ddc2dfd6631c64c185d8bd0b"} Jul 14 10:03:03.986243 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.985835 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:03.986243 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.985872 2565 scope.go:117] "RemoveContainer" containerID="4835ffdfcbf116ddf8d759e7009f2cc534a1dba45c9e003acac81296e55b41f3" Jul 14 10:03:03.993367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:03.993349 2565 scope.go:117] "RemoveContainer" containerID="445827ae57367b329a02d11868c3cdbc181ec58ffdcf95975e6331af4fec21d8" Jul 14 10:03:04.000415 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.000395 2565 scope.go:117] "RemoveContainer" containerID="24200d1152c466153c9294f9f7bd958cf032483c3636259d8d2d9b8e3658bf0f" Jul 14 10:03:04.006737 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.006719 2565 scope.go:117] "RemoveContainer" containerID="0c4684046659ef6d2b0bdc2165dcdf7ef6cefed265e4167ac9115c608aa175cf" Jul 14 10:03:04.011484 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.011464 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:03:04.014253 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.014231 2565 scope.go:117] "RemoveContainer" containerID="bc5e1517778f979ab074c472ab72fc7e0701446e0a8796f8a233b2202f10f9f1" Jul 14 10:03:04.015905 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.015887 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:03:04.021178 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.021163 2565 scope.go:117] "RemoveContainer" containerID="3bbe6f9e97d59c7b81184bbef52d639fea618a5e61b9c1f8bb1c250adb188316" Jul 14 10:03:04.028131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.028115 2565 scope.go:117] "RemoveContainer" containerID="4cc42040b0de4c46df47fc37ac5ae7b136cc5c830c8b3ea4ead7a2696d5e7336" Jul 14 10:03:04.044358 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044331 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:03:04.044591 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044578 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy-web" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044593 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy-web" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044602 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy-thanos" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044608 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy-thanos" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044616 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="config-reloader" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044621 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="config-reloader" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044627 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy-metric" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044632 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy-metric" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044637 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="prom-label-proxy" Jul 14 10:03:04.044639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044643 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="prom-label-proxy" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044650 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="init-config-reloader" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044655 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="init-config-reloader" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044662 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044667 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044673 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="prometheus" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044678 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="prometheus" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044684 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy-web" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044689 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy-web" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044693 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="init-config-reloader" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044698 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="init-config-reloader" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044704 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="thanos-sidecar" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044708 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="thanos-sidecar" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044718 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044722 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044729 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="config-reloader" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044734 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="config-reloader" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044759 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="alertmanager" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044765 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="alertmanager" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044772 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" containerName="console" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044777 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" containerName="console" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044816 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d590cae6-7d95-46d1-a3c7-bb989c1f6ee9" containerName="console" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044824 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="config-reloader" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044831 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="prometheus" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044837 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044841 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy-metric" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044847 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="alertmanager" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044851 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="kube-rbac-proxy-web" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044856 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="thanos-sidecar" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044861 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0aace1-f9f4-4aa1-90e1-e927385936d0" containerName="prom-label-proxy" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044866 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy-web" Jul 14 10:03:04.044941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044870 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy-thanos" Jul 14 10:03:04.045826 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044875 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="kube-rbac-proxy" Jul 14 10:03:04.045826 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.044879 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" containerName="config-reloader" Jul 14 10:03:04.048633 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.048618 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.051323 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051304 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 10:03:04.051441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051321 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 10:03:04.051441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051362 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 10:03:04.051441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051386 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s9b8f\"" Jul 14 10:03:04.051621 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051604 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 10:03:04.051713 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051693 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 10:03:04.051785 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051703 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 10:03:04.051785 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051702 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-n8dbv7mspfko\"" Jul 14 10:03:04.051785 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051780 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 10:03:04.051899 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.051795 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 10:03:04.052573 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.052546 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 10:03:04.052670 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.052552 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 10:03:04.052670 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.052587 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 10:03:04.052860 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.052845 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 10:03:04.052922 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.052845 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 10:03:04.054848 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.054821 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 10:03:04.057821 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.057738 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 10:03:04.066606 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.066586 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:03:04.103737 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103737 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c7eb0df-beea-40ae-9450-385bf73ee4ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103737 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103737 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-config\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.103991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.103991 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.104237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.104005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.104237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.104020 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c7eb0df-beea-40ae-9450-385bf73ee4ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.104237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.104042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.104237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.104062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v498h\" (UniqueName: \"kubernetes.io/projected/9c7eb0df-beea-40ae-9450-385bf73ee4ff-kube-api-access-v498h\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.104237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.104080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.104237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.104094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.104237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.104119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.164789 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.164736 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b" path="/var/lib/kubelet/pods/b222e2ef-ad49-45ac-b4aa-72a8b9e6a67b/volumes" Jul 14 10:03:04.204790 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.204764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.204870 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.204798 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v498h\" (UniqueName: \"kubernetes.io/projected/9c7eb0df-beea-40ae-9450-385bf73ee4ff-kube-api-access-v498h\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.204870 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.204821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.204951 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.204929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.204981 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.204964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205025 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.204988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205025 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c7eb0df-beea-40ae-9450-385bf73ee4ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205177 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205307 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205307 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205307 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205483 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205441 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205807 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205499 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-config\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205807 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205807 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205807 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c7eb0df-beea-40ae-9450-385bf73ee4ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205807 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205609 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.205807 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.205681 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.206336 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.206311 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.208137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.207867 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c7eb0df-beea-40ae-9450-385bf73ee4ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.208137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.208048 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.208137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.208048 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.208553 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.208362 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c7eb0df-beea-40ae-9450-385bf73ee4ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.208631 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.208548 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.208844 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.208816 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.208922 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.208859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-config\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.209021 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.208998 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.209215 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.209165 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.209381 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.209356 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.209492 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.209467 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.210547 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.210520 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.210729 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.210711 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.210918 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.210899 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c7eb0df-beea-40ae-9450-385bf73ee4ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.211895 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.211874 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c7eb0df-beea-40ae-9450-385bf73ee4ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.213423 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.213406 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v498h\" (UniqueName: \"kubernetes.io/projected/9c7eb0df-beea-40ae-9450-385bf73ee4ff-kube-api-access-v498h\") pod \"prometheus-k8s-0\" (UID: \"9c7eb0df-beea-40ae-9450-385bf73ee4ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.358780 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.358669 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:04.490238 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.490143 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 10:03:04.492471 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:03:04.492445 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7eb0df_beea_40ae_9450_385bf73ee4ff.slice/crio-31354a81035dfa308594a0885687382552ee461697e1c9c18a9842fc9aaf2fc6 WatchSource:0}: Error finding container 31354a81035dfa308594a0885687382552ee461697e1c9c18a9842fc9aaf2fc6: Status 404 returned error can't find the container with id 31354a81035dfa308594a0885687382552ee461697e1c9c18a9842fc9aaf2fc6 Jul 14 10:03:04.992026 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.991993 2565 generic.go:356] "Generic (PLEG): container finished" podID="9c7eb0df-beea-40ae-9450-385bf73ee4ff" containerID="d8d83d3d0bcbdd6223fcd32e01d4fd6eea534851dd81fb1202c9d4fc765d40c9" exitCode=0 Jul 14 10:03:04.992026 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.992031 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c7eb0df-beea-40ae-9450-385bf73ee4ff","Type":"ContainerDied","Data":"d8d83d3d0bcbdd6223fcd32e01d4fd6eea534851dd81fb1202c9d4fc765d40c9"} Jul 14 10:03:04.992438 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:04.992078 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c7eb0df-beea-40ae-9450-385bf73ee4ff","Type":"ContainerStarted","Data":"31354a81035dfa308594a0885687382552ee461697e1c9c18a9842fc9aaf2fc6"} Jul 14 10:03:05.999666 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:05.999626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c7eb0df-beea-40ae-9450-385bf73ee4ff","Type":"ContainerStarted","Data":"baec307537248325d16137acbbe73970da97bc535ce386ebccea457e8a2d5964"} Jul 14 10:03:06.000180 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:05.999708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c7eb0df-beea-40ae-9450-385bf73ee4ff","Type":"ContainerStarted","Data":"340393aee29f18af144a18362f68cbf0073fc5ca5a4a9b327da516f39b42833c"} Jul 14 10:03:06.000180 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:05.999764 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c7eb0df-beea-40ae-9450-385bf73ee4ff","Type":"ContainerStarted","Data":"d08fe7ce02d3b717a554da1a60f66d3a21bb4dd1a774c748d0b88b9657b83f73"} Jul 14 10:03:06.000180 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:05.999808 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c7eb0df-beea-40ae-9450-385bf73ee4ff","Type":"ContainerStarted","Data":"942eb857e148b62778e30cb289cc2e21637fc635e82a23d8ab60b5263f5aacec"} Jul 14 10:03:06.000180 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:05.999843 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c7eb0df-beea-40ae-9450-385bf73ee4ff","Type":"ContainerStarted","Data":"6ca446135a5d9f0b89d1d4c171718653b573e921106e9923e2a1980c0c3dcaee"} Jul 14 10:03:06.000180 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:05.999883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c7eb0df-beea-40ae-9450-385bf73ee4ff","Type":"ContainerStarted","Data":"74f306468bdf1de03b8ceb16f332d86e8a9906aed4af56327028e46e61e558c0"} Jul 14 10:03:06.033753 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:06.033681 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.014451352 podStartE2EDuration="2.033660312s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.20896ms" isStatefulPod=false podCreationTimestamp="2026-07-14 10:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:03:06.031851498 +0000 UTC m=+156.313059613" watchObservedRunningTime="2026-07-14 10:03:06.033660312 +0000 UTC m=+156.314868439" Jul 14 10:03:06.511733 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:06.511697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:03:06.565107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:06.565078 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:03:09.359801 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:09.359760 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:03:17.915891 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:17.915847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:03:18.016971 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:18.016936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:03:52.049607 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:03:52.049562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:04.359230 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:04.359187 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:04:04.374335 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:04.374310 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:04:05.224797 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:05.224761 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 10:04:12.664137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:12.664100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:12.726370 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:12.726336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:23.286135 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:23.286097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:23.342993 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:23.342962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:24.685626 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:24.685572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:24.752983 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:24.752954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:32.201443 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:32.201400 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:32.303278 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:32.303239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:32.362284 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:32.362251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:34.176539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:34.176497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:34.280999 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:34.280956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:34.345809 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:34.345775 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:44.668930 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:44.668890 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:04:49.498689 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:04:49.498622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:23.442897 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:23.442858 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:24.712631 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:24.712581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:30.026356 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:30.026327 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:05:30.030053 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:30.030031 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 10:05:30.032076 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:30.032058 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:05:50.257451 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:50.257412 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:51.314714 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:51.314679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:54.076238 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:54.076200 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:54.187398 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:54.187364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:55.869578 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:55.869545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:55.989270 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:55.989237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:56.442854 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:56.442816 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:56.714022 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:56.713936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:58.994554 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:58.994519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:05:59.242292 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:05:59.242258 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:01.275484 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:01.275453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:01.346126 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:01.346094 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:06.208528 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:06.208493 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:08.817236 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:08.817199 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:08.912857 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:08.912820 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:14.599712 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:14.599670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:14.680475 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:14.680445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:16.488940 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:16.488909 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:18.432222 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:18.432190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:18.592956 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:18.592927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:28.106226 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:28.106148 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:28.217689 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:28.217659 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:28.766404 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:28.766372 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:29.019200 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.019091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:29.121496 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.121462 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:29.162374 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.162342 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t"] Jul 14 10:06:29.165551 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.165531 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.168586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.168566 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 10:06:29.168586 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.168578 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 10:06:29.168756 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.168600 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 10:06:29.168756 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.168625 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7mwsq\"" Jul 14 10:06:29.168966 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.168952 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 10:06:29.184700 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.184678 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t"] Jul 14 10:06:29.283405 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.283317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-tmp\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.283405 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.283355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.283405 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.283374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.283615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.283463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-manifests\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.283615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.283508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np5sx\" (UniqueName: \"kubernetes.io/projected/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-kube-api-access-np5sx\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.302665 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.302626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:29.384061 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.384023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-manifests\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.384234 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.384080 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np5sx\" (UniqueName: \"kubernetes.io/projected/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-kube-api-access-np5sx\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.384234 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.384117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-tmp\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.384234 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.384145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.384234 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.384170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.384458 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.384445 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-manifests\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.386227 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.386199 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-tmp\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.386537 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.386515 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.386610 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.386536 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.397267 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.397245 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np5sx\" (UniqueName: \"kubernetes.io/projected/6ce7d66a-8939-4c2b-b213-4bb86bd0814f-kube-api-access-np5sx\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t\" (UID: \"6ce7d66a-8939-4c2b-b213-4bb86bd0814f\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.399555 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.399526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:29.476668 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.476623 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:29.500401 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.500374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:29.598675 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.598642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:29.609831 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.609809 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t"] Jul 14 10:06:29.612243 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:06:29.612216 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce7d66a_8939_4c2b_b213_4bb86bd0814f.slice/crio-32a7303c41dbfc2989f99ab6e8251b9a660672dddb49f076b6769207e720f7a4 WatchSource:0}: Error finding container 32a7303c41dbfc2989f99ab6e8251b9a660672dddb49f076b6769207e720f7a4: Status 404 returned error can't find the container with id 32a7303c41dbfc2989f99ab6e8251b9a660672dddb49f076b6769207e720f7a4 Jul 14 10:06:29.614048 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.614033 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:06:29.702554 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.702523 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:29.716180 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.716144 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" event={"ID":"6ce7d66a-8939-4c2b-b213-4bb86bd0814f","Type":"ContainerStarted","Data":"32a7303c41dbfc2989f99ab6e8251b9a660672dddb49f076b6769207e720f7a4"} Jul 14 10:06:29.820880 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:29.820796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:32.730230 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:32.730196 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" event={"ID":"6ce7d66a-8939-4c2b-b213-4bb86bd0814f","Type":"ContainerStarted","Data":"405f59417d94109e94955960da102d47aa479cdcfc3f0c16b9fec9ef4f95456d"} Jul 14 10:06:33.736095 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:33.736058 2565 generic.go:356] "Generic (PLEG): container finished" podID="6ce7d66a-8939-4c2b-b213-4bb86bd0814f" containerID="405f59417d94109e94955960da102d47aa479cdcfc3f0c16b9fec9ef4f95456d" exitCode=0 Jul 14 10:06:33.736511 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:33.736104 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" event={"ID":"6ce7d66a-8939-4c2b-b213-4bb86bd0814f","Type":"ContainerDied","Data":"405f59417d94109e94955960da102d47aa479cdcfc3f0c16b9fec9ef4f95456d"} Jul 14 10:06:34.743120 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:34.743088 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" event={"ID":"6ce7d66a-8939-4c2b-b213-4bb86bd0814f","Type":"ContainerStarted","Data":"753c731b979f338fd3224347c99f9f56c5f4c48e8541b2880ed83cd1165447fc"} Jul 14 10:06:34.743502 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:34.743209 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:34.776399 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:34.776344 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" podStartSLOduration=1.376160884 podStartE2EDuration="5.776328994s" totalImagesPullingTime="3.343648355s" totalInitContainerRuntime="1.056519755s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:06:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:06:34.774072806 +0000 UTC m=+365.055280928" watchObservedRunningTime="2026-07-14 10:06:34.776328994 +0000 UTC m=+365.057537115" Jul 14 10:06:36.550564 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:36.550531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:36.648371 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:36.648335 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:40.117735 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:40.117695 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:40.197827 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:40.197793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:40.550488 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:40.550450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:40.650482 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:40.650446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:45.749569 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:45.749541 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t" Jul 14 10:06:49.320605 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.320567 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:49.452280 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.452244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:49.461400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.461373 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-589999c949-bflhz"] Jul 14 10:06:49.474249 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.474214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.479218 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.479195 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 10:06:49.479367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.479236 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 10:06:49.479367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.479253 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 10:06:49.479367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.479268 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hbwws\"" Jul 14 10:06:49.479367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.479195 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 10:06:49.479367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.479311 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:06:49.494951 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.494922 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-589999c949-bflhz"] Jul 14 10:06:49.557012 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.556972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/756962fc-82cb-475a-bfa0-63abc1b803c6-metrics-cert\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.557012 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.557024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/756962fc-82cb-475a-bfa0-63abc1b803c6-cert\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.557287 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.557042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5snj\" (UniqueName: \"kubernetes.io/projected/756962fc-82cb-475a-bfa0-63abc1b803c6-kube-api-access-l5snj\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.557287 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.557122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/756962fc-82cb-475a-bfa0-63abc1b803c6-manager-config\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.658489 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.658449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/756962fc-82cb-475a-bfa0-63abc1b803c6-metrics-cert\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.658673 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.658496 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/756962fc-82cb-475a-bfa0-63abc1b803c6-cert\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.658673 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.658656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5snj\" (UniqueName: \"kubernetes.io/projected/756962fc-82cb-475a-bfa0-63abc1b803c6-kube-api-access-l5snj\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.658810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.658705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/756962fc-82cb-475a-bfa0-63abc1b803c6-manager-config\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.659352 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.659335 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/756962fc-82cb-475a-bfa0-63abc1b803c6-manager-config\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.661093 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.661073 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/756962fc-82cb-475a-bfa0-63abc1b803c6-cert\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.661171 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.661119 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/756962fc-82cb-475a-bfa0-63abc1b803c6-metrics-cert\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.681945 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.681913 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5snj\" (UniqueName: \"kubernetes.io/projected/756962fc-82cb-475a-bfa0-63abc1b803c6-kube-api-access-l5snj\") pod \"lws-controller-manager-589999c949-bflhz\" (UID: \"756962fc-82cb-475a-bfa0-63abc1b803c6\") " pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.687075 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.687046 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78"] Jul 14 10:06:49.690769 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.690714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.695055 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.695031 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 10:06:49.695511 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.695332 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kc454\"" Jul 14 10:06:49.695638 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.695591 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 10:06:49.695717 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.695692 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 10:06:49.695993 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.695974 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 10:06:49.704903 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.704869 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78"] Jul 14 10:06:49.730839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.730793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:49.759192 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.759156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c44dce68-4bdf-4478-92e1-44604936aac3-tls-certs\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.759395 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.759205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkncx\" (UniqueName: \"kubernetes.io/projected/c44dce68-4bdf-4478-92e1-44604936aac3-kube-api-access-nkncx\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.759395 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.759225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c44dce68-4bdf-4478-92e1-44604936aac3-tmp\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.783803 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.783767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:49.826913 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.826874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:49.862317 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.860810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c44dce68-4bdf-4478-92e1-44604936aac3-tls-certs\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.862317 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.860879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkncx\" (UniqueName: \"kubernetes.io/projected/c44dce68-4bdf-4478-92e1-44604936aac3-kube-api-access-nkncx\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.862317 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.860907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c44dce68-4bdf-4478-92e1-44604936aac3-tmp\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.862317 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:06:49.861654 2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 14 10:06:49.862317 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:06:49.861990 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c44dce68-4bdf-4478-92e1-44604936aac3-tls-certs podName:c44dce68-4bdf-4478-92e1-44604936aac3 nodeName:}" failed. No retries permitted until 2026-07-14 10:06:50.36196536 +0000 UTC m=+380.643173478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c44dce68-4bdf-4478-92e1-44604936aac3-tls-certs") pod "kube-auth-proxy-66cfd9dd7c-9hj78" (UID: "c44dce68-4bdf-4478-92e1-44604936aac3") : secret "kube-auth-proxy-tls" not found Jul 14 10:06:49.864604 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.864573 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c44dce68-4bdf-4478-92e1-44604936aac3-tmp\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.881195 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.881132 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkncx\" (UniqueName: \"kubernetes.io/projected/c44dce68-4bdf-4478-92e1-44604936aac3-kube-api-access-nkncx\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:49.927632 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.927509 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:49.960727 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:49.960702 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-589999c949-bflhz"] Jul 14 10:06:49.963510 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:06:49.963479 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756962fc_82cb_475a_bfa0_63abc1b803c6.slice/crio-db22da945f8c138820fe3cc05f48690383689f614c03e48529735154e8c12192 WatchSource:0}: Error finding container db22da945f8c138820fe3cc05f48690383689f614c03e48529735154e8c12192: Status 404 returned error can't find the container with id db22da945f8c138820fe3cc05f48690383689f614c03e48529735154e8c12192 Jul 14 10:06:50.020735 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.020697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:50.127364 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.127331 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:50.226534 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.226449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:50.364495 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.364451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c44dce68-4bdf-4478-92e1-44604936aac3-tls-certs\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:50.366971 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.366947 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c44dce68-4bdf-4478-92e1-44604936aac3-tls-certs\") pod \"kube-auth-proxy-66cfd9dd7c-9hj78\" (UID: \"c44dce68-4bdf-4478-92e1-44604936aac3\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:50.583723 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.583632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:50.603804 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.603735 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" Jul 14 10:06:50.756588 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:06:50.756549 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44dce68_4bdf_4478_92e1_44604936aac3.slice/crio-288bb097cba8e55362a98223079edb1d5c6c93fb7b25551457542d7061ac82e5 WatchSource:0}: Error finding container 288bb097cba8e55362a98223079edb1d5c6c93fb7b25551457542d7061ac82e5: Status 404 returned error can't find the container with id 288bb097cba8e55362a98223079edb1d5c6c93fb7b25551457542d7061ac82e5 Jul 14 10:06:50.759113 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.759087 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78"] Jul 14 10:06:50.802941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.802899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" event={"ID":"c44dce68-4bdf-4478-92e1-44604936aac3","Type":"ContainerStarted","Data":"288bb097cba8e55362a98223079edb1d5c6c93fb7b25551457542d7061ac82e5"} Jul 14 10:06:50.804123 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.804098 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" event={"ID":"756962fc-82cb-475a-bfa0-63abc1b803c6","Type":"ContainerStarted","Data":"db22da945f8c138820fe3cc05f48690383689f614c03e48529735154e8c12192"} Jul 14 10:06:50.876887 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:50.876800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:51.073081 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:51.073048 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:51.135803 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:51.135770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:52.231398 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:52.231325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:54.826647 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:54.826606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" event={"ID":"756962fc-82cb-475a-bfa0-63abc1b803c6","Type":"ContainerStarted","Data":"c36ddde7c1ee5316c6e3b62d32b89b68560072a8445c997c73f47398dfba60e0"} Jul 14 10:06:54.827173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:54.826683 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:06:54.828066 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:54.828039 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" event={"ID":"c44dce68-4bdf-4478-92e1-44604936aac3","Type":"ContainerStarted","Data":"eb87a097d882c73af509055b09657cdb7c6806472aeb41b7a1814de81c5a824b"} Jul 14 10:06:54.845667 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:54.845617 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" podStartSLOduration=1.908462483 podStartE2EDuration="5.845599796s" totalImagesPullingTime="3.937137313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:06:54.844084355 +0000 UTC m=+385.125292504" watchObservedRunningTime="2026-07-14 10:06:54.845599796 +0000 UTC m=+385.126807915" Jul 14 10:06:54.861570 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:54.861522 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-9hj78" podStartSLOduration=2.715365029 podStartE2EDuration="5.861506544s" totalImagesPullingTime="3.146141515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:06:54.86024811 +0000 UTC m=+385.141456231" watchObservedRunningTime="2026-07-14 10:06:54.861506544 +0000 UTC m=+385.142714666" Jul 14 10:06:56.565415 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:56.565373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:56.665464 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:56.665431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:56.861883 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:56.861807 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:57.075394 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:57.075360 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:57.183458 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:57.183428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:06:59.972572 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:06:59.972522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:00.041804 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.041771 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr"] Jul 14 10:07:00.045501 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.045476 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:00.049517 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.049487 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rs7r4\"" Jul 14 10:07:00.049663 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.049494 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 14 10:07:00.062792 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.059174 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr"] Jul 14 10:07:00.073191 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.073158 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:00.152333 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.152297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fthr\" (UID: \"7ce08cf7-2fec-4a99-a91c-50d361abed7f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:00.152519 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.152369 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwt69\" (UniqueName: \"kubernetes.io/projected/7ce08cf7-2fec-4a99-a91c-50d361abed7f-kube-api-access-qwt69\") pod \"llmisvc-controller-manager-777c6bd7d5-6fthr\" (UID: \"7ce08cf7-2fec-4a99-a91c-50d361abed7f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:00.253061 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.252968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fthr\" (UID: \"7ce08cf7-2fec-4a99-a91c-50d361abed7f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:00.253061 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.253047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwt69\" (UniqueName: \"kubernetes.io/projected/7ce08cf7-2fec-4a99-a91c-50d361abed7f-kube-api-access-qwt69\") pod \"llmisvc-controller-manager-777c6bd7d5-6fthr\" (UID: \"7ce08cf7-2fec-4a99-a91c-50d361abed7f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:00.253255 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:07:00.253153 2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 14 10:07:00.253255 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:07:00.253234 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert podName:7ce08cf7-2fec-4a99-a91c-50d361abed7f nodeName:}" failed. No retries permitted until 2026-07-14 10:07:00.753211453 +0000 UTC m=+391.034419555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert") pod "llmisvc-controller-manager-777c6bd7d5-6fthr" (UID: "7ce08cf7-2fec-4a99-a91c-50d361abed7f") : secret "llmisvc-webhook-server-cert" not found Jul 14 10:07:00.274914 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.274876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:00.277413 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.277383 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwt69\" (UniqueName: \"kubernetes.io/projected/7ce08cf7-2fec-4a99-a91c-50d361abed7f-kube-api-access-qwt69\") pod \"llmisvc-controller-manager-777c6bd7d5-6fthr\" (UID: \"7ce08cf7-2fec-4a99-a91c-50d361abed7f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:00.757724 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.757684 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fthr\" (UID: \"7ce08cf7-2fec-4a99-a91c-50d361abed7f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:00.757927 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:07:00.757876 2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 14 10:07:00.757974 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:07:00.757954 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert podName:7ce08cf7-2fec-4a99-a91c-50d361abed7f nodeName:}" failed. No retries permitted until 2026-07-14 10:07:01.757932937 +0000 UTC m=+392.039141041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert") pod "llmisvc-controller-manager-777c6bd7d5-6fthr" (UID: "7ce08cf7-2fec-4a99-a91c-50d361abed7f") : secret "llmisvc-webhook-server-cert" not found Jul 14 10:07:00.869867 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:00.869834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:01.309071 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:01.309035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:01.379475 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:01.379444 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:01.478958 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:01.478925 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:01.766760 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:01.766706 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fthr\" (UID: \"7ce08cf7-2fec-4a99-a91c-50d361abed7f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:01.769191 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:01.769172 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ce08cf7-2fec-4a99-a91c-50d361abed7f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fthr\" (UID: \"7ce08cf7-2fec-4a99-a91c-50d361abed7f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:01.863683 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:01.863644 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:02.000559 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:02.000534 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr"] Jul 14 10:07:02.002261 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:07:02.002236 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ce08cf7_2fec_4a99_a91c_50d361abed7f.slice/crio-5c8ee8485a122346574ddfda21722092c08d11c744ebe80b25ec67c11641ceac WatchSource:0}: Error finding container 5c8ee8485a122346574ddfda21722092c08d11c744ebe80b25ec67c11641ceac: Status 404 returned error can't find the container with id 5c8ee8485a122346574ddfda21722092c08d11c744ebe80b25ec67c11641ceac Jul 14 10:07:02.860693 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:02.860655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" event={"ID":"7ce08cf7-2fec-4a99-a91c-50d361abed7f","Type":"ContainerStarted","Data":"5c8ee8485a122346574ddfda21722092c08d11c744ebe80b25ec67c11641ceac"} Jul 14 10:07:03.135765 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:03.135722 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:03.202244 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:03.202210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:05.833703 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:05.833670 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-589999c949-bflhz" Jul 14 10:07:05.874505 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:05.874475 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" event={"ID":"7ce08cf7-2fec-4a99-a91c-50d361abed7f","Type":"ContainerStarted","Data":"098c977ed5fe6f56d418eb72aa4ed09e939583c67ff4a54d5335625a8406be90"} Jul 14 10:07:05.874716 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:05.874699 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:05.891146 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:05.891104 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" podStartSLOduration=2.656641153 podStartE2EDuration="5.891091054s" totalImagesPullingTime="3.234449901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:07:05.890281844 +0000 UTC m=+396.171489967" watchObservedRunningTime="2026-07-14 10:07:05.891091054 +0000 UTC m=+396.172299175" Jul 14 10:07:33.762707 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:33.762675 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:33.829871 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:33.829827 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:36.879556 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:36.879530 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fthr" Jul 14 10:07:50.099752 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:50.099673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:50.157889 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:50.157853 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:50.289307 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:50.289271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:51.030478 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:51.030445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:07:51.235312 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:07:51.235277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:20.815397 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:20.815362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:21.813506 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:21.813466 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:23.188112 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.188078 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-787545f464-rqv7g"] Jul 14 10:08:23.192959 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.192938 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.195699 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.195678 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 10:08:23.196967 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.196943 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 10:08:23.196967 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.196947 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 10:08:23.197140 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.196952 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 10:08:23.197140 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.197056 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5ltrq\"" Jul 14 10:08:23.197140 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.197097 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 10:08:23.201811 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.201790 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 10:08:23.202672 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.202653 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787545f464-rqv7g"] Jul 14 10:08:23.221570 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.221541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-oauth-serving-cert\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.221717 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.221582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrmfb\" (UniqueName: \"kubernetes.io/projected/3ba1af47-c987-427d-87a6-9be0a1d6d01d-kube-api-access-wrmfb\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.221717 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.221680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-trusted-ca-bundle\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.221842 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.221725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-serving-cert\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.221842 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.221811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-oauth-config\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.221842 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.221834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-config\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.221946 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.221853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-service-ca\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.239615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.239584 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:23.296450 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.296411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:23.322912 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.322880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrmfb\" (UniqueName: \"kubernetes.io/projected/3ba1af47-c987-427d-87a6-9be0a1d6d01d-kube-api-access-wrmfb\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.323006 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.322931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-trusted-ca-bundle\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.323006 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.322959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-serving-cert\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.323006 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.322986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-oauth-config\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.323006 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.323003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-config\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.323216 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.323017 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-service-ca\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.323216 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.323044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-oauth-serving-cert\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.323940 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.323903 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-service-ca\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.324058 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.323906 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-oauth-serving-cert\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.324058 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.323908 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-config\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.324126 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.324086 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba1af47-c987-427d-87a6-9be0a1d6d01d-trusted-ca-bundle\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.325602 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.325573 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-serving-cert\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.325701 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.325619 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ba1af47-c987-427d-87a6-9be0a1d6d01d-console-oauth-config\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.331665 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.331641 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrmfb\" (UniqueName: \"kubernetes.io/projected/3ba1af47-c987-427d-87a6-9be0a1d6d01d-kube-api-access-wrmfb\") pod \"console-787545f464-rqv7g\" (UID: \"3ba1af47-c987-427d-87a6-9be0a1d6d01d\") " pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.503575 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.503481 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:23.635254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:23.635230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787545f464-rqv7g"] Jul 14 10:08:23.637444 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:08:23.637418 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba1af47_c987_427d_87a6_9be0a1d6d01d.slice/crio-f17f4711419f28995fa733b591349b4fde6925d31d45c0003d764e5c02d1584b WatchSource:0}: Error finding container f17f4711419f28995fa733b591349b4fde6925d31d45c0003d764e5c02d1584b: Status 404 returned error can't find the container with id f17f4711419f28995fa733b591349b4fde6925d31d45c0003d764e5c02d1584b Jul 14 10:08:24.167811 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:24.167774 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787545f464-rqv7g" event={"ID":"3ba1af47-c987-427d-87a6-9be0a1d6d01d","Type":"ContainerStarted","Data":"e5d96ce294bb11c6157699ee1e2db622cd3613005097f5cbd7a582a63aea0abb"} Jul 14 10:08:24.168014 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:24.167832 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787545f464-rqv7g" event={"ID":"3ba1af47-c987-427d-87a6-9be0a1d6d01d","Type":"ContainerStarted","Data":"f17f4711419f28995fa733b591349b4fde6925d31d45c0003d764e5c02d1584b"} Jul 14 10:08:24.186453 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:24.186393 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-787545f464-rqv7g" podStartSLOduration=1.18637833 podStartE2EDuration="1.18637833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:08:24.184667857 +0000 UTC m=+474.465875981" watchObservedRunningTime="2026-07-14 10:08:24.18637833 +0000 UTC m=+474.467586452" Jul 14 10:08:25.947134 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:25.947101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:26.039467 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:26.039436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:26.621432 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:26.621398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:27.844541 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:27.844509 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:27.950577 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:27.950544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:29.658220 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:29.658187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:29.758345 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:29.758308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:31.838343 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:31.838299 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:31.932217 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:31.932182 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:33.073647 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:33.073609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:33.504393 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:33.504345 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:33.504599 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:33.504421 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:33.509360 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:33.509334 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:34.212222 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:34.212193 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-787545f464-rqv7g" Jul 14 10:08:34.387256 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:34.387226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:34.494806 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:34.494663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:34.599042 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:34.599006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:34.691659 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:34.691628 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:39.229034 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:39.228974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:39.290123 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:39.290090 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:40.424222 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.424190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:40.528985 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.528956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:40.989155 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.989114 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n"] Jul 14 10:08:40.992972 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.992948 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:40.995768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.995718 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 10:08:40.995768 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.995769 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sxmr7\"" Jul 14 10:08:40.995956 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.995776 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 10:08:40.996993 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.996975 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 10:08:40.997095 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.997006 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 10:08:40.997957 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:40.997903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:41.005484 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.003692 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n"] Jul 14 10:08:41.073165 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.073119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnsgw\" (UniqueName: \"kubernetes.io/projected/249cb629-9f48-4b34-872b-c0fca3eda4d8-kube-api-access-qnsgw\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.073452 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.073179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/249cb629-9f48-4b34-872b-c0fca3eda4d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.073452 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.073297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/249cb629-9f48-4b34-872b-c0fca3eda4d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.174660 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.174617 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnsgw\" (UniqueName: \"kubernetes.io/projected/249cb629-9f48-4b34-872b-c0fca3eda4d8-kube-api-access-qnsgw\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.174660 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.174660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/249cb629-9f48-4b34-872b-c0fca3eda4d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.174941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.174706 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/249cb629-9f48-4b34-872b-c0fca3eda4d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.174941 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:08:41.174826 2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 14 10:08:41.174941 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:08:41.174900 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249cb629-9f48-4b34-872b-c0fca3eda4d8-plugin-serving-cert podName:249cb629-9f48-4b34-872b-c0fca3eda4d8 nodeName:}" failed. No retries permitted until 2026-07-14 10:08:41.674881364 +0000 UTC m=+491.956089486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/249cb629-9f48-4b34-872b-c0fca3eda4d8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-5zn7n" (UID: "249cb629-9f48-4b34-872b-c0fca3eda4d8") : secret "plugin-serving-cert" not found Jul 14 10:08:41.175471 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.175445 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/249cb629-9f48-4b34-872b-c0fca3eda4d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.183999 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.183963 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnsgw\" (UniqueName: \"kubernetes.io/projected/249cb629-9f48-4b34-872b-c0fca3eda4d8-kube-api-access-qnsgw\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.436448 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.436408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:41.679325 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.679281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/249cb629-9f48-4b34-872b-c0fca3eda4d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.681698 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.681676 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/249cb629-9f48-4b34-872b-c0fca3eda4d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5zn7n\" (UID: \"249cb629-9f48-4b34-872b-c0fca3eda4d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:41.920034 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:41.919985 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" Jul 14 10:08:42.048977 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:42.048945 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n"] Jul 14 10:08:42.052087 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:08:42.052055 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod249cb629_9f48_4b34_872b_c0fca3eda4d8.slice/crio-b6aef5f1bfc937f2ffb1910718c20e3672aba5c2e36c5092a84e57098a058c7b WatchSource:0}: Error finding container b6aef5f1bfc937f2ffb1910718c20e3672aba5c2e36c5092a84e57098a058c7b: Status 404 returned error can't find the container with id b6aef5f1bfc937f2ffb1910718c20e3672aba5c2e36c5092a84e57098a058c7b Jul 14 10:08:42.238867 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:42.238772 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" event={"ID":"249cb629-9f48-4b34-872b-c0fca3eda4d8","Type":"ContainerStarted","Data":"b6aef5f1bfc937f2ffb1910718c20e3672aba5c2e36c5092a84e57098a058c7b"} Jul 14 10:08:44.823990 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:44.823951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:44.924284 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:44.924241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:53.070998 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:53.070967 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:53.163141 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:53.163104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:57.228281 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:57.228229 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:08:57.339211 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:08:57.339123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:01.021377 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:01.021344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:01.122629 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:01.122595 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:01.422951 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:01.422911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:01.482854 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:01.482801 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:05.662054 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:05.662019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:05.764475 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:05.764432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:07.365249 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:07.365213 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" event={"ID":"249cb629-9f48-4b34-872b-c0fca3eda4d8","Type":"ContainerStarted","Data":"7ddfe4aa258c36ffc527aec5299c1dcfeb5d721b9bdcc564a8d2b585d3b05c8c"} Jul 14 10:09:07.381778 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:07.381710 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zn7n" podStartSLOduration=2.74921974 podStartE2EDuration="27.381691711s" totalImagesPullingTime="24.632471971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:09:07.380632522 +0000 UTC m=+517.661840644" watchObservedRunningTime="2026-07-14 10:09:07.381691711 +0000 UTC m=+517.662899885" Jul 14 10:09:12.745129 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:12.745093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:13.271467 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:13.271432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:13.372650 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:13.372613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:18.056619 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:18.056581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:18.169989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:18.169955 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:20.187071 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:20.187027 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:20.718055 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:20.718019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:23.029567 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:23.029489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:23.090983 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:23.090945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:35.289568 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.289522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:35.389244 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.389206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:35.448558 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.448511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:35.675355 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.675320 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:09:35.749534 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.749505 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:09:35.749534 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.749541 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:09:35.749761 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.749611 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:35.752375 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.752351 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 10:09:35.834828 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.834790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb9cb\" (UniqueName: \"kubernetes.io/projected/54890927-5de0-4ba8-89cd-c5c3676f991f-kube-api-access-mb9cb\") pod \"limitador-limitador-54d6d988d5-ssvkd\" (UID: \"54890927-5de0-4ba8-89cd-c5c3676f991f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:35.834994 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.834925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54890927-5de0-4ba8-89cd-c5c3676f991f-config-file\") pod \"limitador-limitador-54d6d988d5-ssvkd\" (UID: \"54890927-5de0-4ba8-89cd-c5c3676f991f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:35.936325 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.936241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54890927-5de0-4ba8-89cd-c5c3676f991f-config-file\") pod \"limitador-limitador-54d6d988d5-ssvkd\" (UID: \"54890927-5de0-4ba8-89cd-c5c3676f991f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:35.936472 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.936324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb9cb\" (UniqueName: \"kubernetes.io/projected/54890927-5de0-4ba8-89cd-c5c3676f991f-kube-api-access-mb9cb\") pod \"limitador-limitador-54d6d988d5-ssvkd\" (UID: \"54890927-5de0-4ba8-89cd-c5c3676f991f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:35.937007 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.936985 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54890927-5de0-4ba8-89cd-c5c3676f991f-config-file\") pod \"limitador-limitador-54d6d988d5-ssvkd\" (UID: \"54890927-5de0-4ba8-89cd-c5c3676f991f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:35.946196 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:35.946169 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb9cb\" (UniqueName: \"kubernetes.io/projected/54890927-5de0-4ba8-89cd-c5c3676f991f-kube-api-access-mb9cb\") pod \"limitador-limitador-54d6d988d5-ssvkd\" (UID: \"54890927-5de0-4ba8-89cd-c5c3676f991f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:36.059264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:36.059231 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:36.138449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:36.138412 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:36.199082 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:36.198991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:09:36.261674 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:36.261652 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:09:36.263897 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:09:36.263874 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54890927_5de0_4ba8_89cd_c5c3676f991f.slice/crio-49d8b8619af5a978b5d6ea8f174aafe9bc34238b58d30556ec044b08c0f57e16 WatchSource:0}: Error finding container 49d8b8619af5a978b5d6ea8f174aafe9bc34238b58d30556ec044b08c0f57e16: Status 404 returned error can't find the container with id 49d8b8619af5a978b5d6ea8f174aafe9bc34238b58d30556ec044b08c0f57e16 Jul 14 10:09:36.482613 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:36.482535 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" event={"ID":"54890927-5de0-4ba8-89cd-c5c3676f991f","Type":"ContainerStarted","Data":"49d8b8619af5a978b5d6ea8f174aafe9bc34238b58d30556ec044b08c0f57e16"} Jul 14 10:09:39.498214 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:39.498171 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" event={"ID":"54890927-5de0-4ba8-89cd-c5c3676f991f","Type":"ContainerStarted","Data":"e3d3d31dc592d27fb66381ab6e225bf7b4df890d4e08266b6b1f6b5c8d76153a"} Jul 14 10:09:39.498629 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:39.498348 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:39.517109 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:39.517053 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" podStartSLOduration=1.710095371 podStartE2EDuration="4.517038746s" totalImagesPullingTime="2.806943375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:09:39.515509089 +0000 UTC m=+549.796717210" watchObservedRunningTime="2026-07-14 10:09:39.517038746 +0000 UTC m=+549.798246868" Jul 14 10:09:50.503368 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:50.503338 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ssvkd" Jul 14 10:09:54.402560 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:09:54.402525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:06.455068 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:06.455036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:06.574009 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:06.573977 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:10.314991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:10.314955 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:10.373173 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:10.373099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:13.632658 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:13.632620 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:13.735479 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:13.735448 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:13.809102 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:13.809070 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:16.704964 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:16.704917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:16.799248 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:16.799214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:30.052602 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:30.052575 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:10:30.055000 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:30.054982 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:10:35.431657 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:35.431608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:36.975705 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:36.975650 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:43.626533 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:43.626503 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:43.681880 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:43.681852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:49.126110 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:49.126071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:49.601702 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:49.601670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:49.925424 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:49.925367 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:50.061913 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:50.061876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:50.164383 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:50.164354 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:10:50.270817 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:50.270671 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:10:54.746578 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:10:54.746496 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:11:00.471330 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:00.471297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:11:00.554936 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:00.554904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:11:09.330889 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:09.330856 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:11:09.810472 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:09.810436 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:11:14.584874 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:14.584840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:11:15.307999 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:15.307965 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:11:22.175904 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:22.175871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:11:23.212540 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:23.212498 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:11:33.235413 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.235380 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk"] Jul 14 10:11:33.238850 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.238815 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.241568 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.241544 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 10:11:33.241717 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.241630 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 10:11:33.241717 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.241639 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j6fwv\"" Jul 14 10:11:33.241717 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.241656 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 10:11:33.251162 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.251137 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk"] Jul 14 10:11:33.270042 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.270014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:11:33.304071 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.304026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.304230 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.304088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.304230 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.304137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g58m8\" (UniqueName: \"kubernetes.io/projected/b97f6121-993b-4645-a63a-e0fb67eb0f5e-kube-api-access-g58m8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.304230 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.304158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b97f6121-993b-4645-a63a-e0fb67eb0f5e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.304345 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.304250 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.304345 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.304295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405035 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.404998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b97f6121-993b-4645-a63a-e0fb67eb0f5e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405198 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.405049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405198 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.405070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405198 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.405103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405198 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.405132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405198 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.405183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g58m8\" (UniqueName: \"kubernetes.io/projected/b97f6121-993b-4645-a63a-e0fb67eb0f5e-kube-api-access-g58m8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405570 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.405542 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405570 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.405565 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.405715 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.405631 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.407542 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.407512 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b97f6121-993b-4645-a63a-e0fb67eb0f5e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.407655 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.407638 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b97f6121-993b-4645-a63a-e0fb67eb0f5e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.415097 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.415077 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g58m8\" (UniqueName: \"kubernetes.io/projected/b97f6121-993b-4645-a63a-e0fb67eb0f5e-kube-api-access-g58m8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk\" (UID: \"b97f6121-993b-4645-a63a-e0fb67eb0f5e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.552572 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.552478 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:33.684231 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.684204 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk"] Jul 14 10:11:33.686507 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:11:33.686481 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97f6121_993b_4645_a63a_e0fb67eb0f5e.slice/crio-629cb1a86e6da20d9bca99e02e1e021dd619fdc0bbe424531aa1fc293b048ac4 WatchSource:0}: Error finding container 629cb1a86e6da20d9bca99e02e1e021dd619fdc0bbe424531aa1fc293b048ac4: Status 404 returned error can't find the container with id 629cb1a86e6da20d9bca99e02e1e021dd619fdc0bbe424531aa1fc293b048ac4 Jul 14 10:11:33.687843 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.687826 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:11:33.962121 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:33.962079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" event={"ID":"b97f6121-993b-4645-a63a-e0fb67eb0f5e","Type":"ContainerStarted","Data":"629cb1a86e6da20d9bca99e02e1e021dd619fdc0bbe424531aa1fc293b048ac4"} Jul 14 10:11:34.715140 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:34.715109 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:11:34.967820 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:34.967730 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" event={"ID":"b97f6121-993b-4645-a63a-e0fb67eb0f5e","Type":"ContainerStarted","Data":"b6ee2ef1a1d50cdf90b115cde186ce232dbed617c25564cb3c823a84a313a8c9"} Jul 14 10:11:34.993649 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:34.993599 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" podStartSLOduration=0.955408423 podStartE2EDuration="1.99358638s" totalImagesPullingTime="1.038177957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:11:34.991974673 +0000 UTC m=+665.273182800" watchObservedRunningTime="2026-07-14 10:11:34.99358638 +0000 UTC m=+665.274794502" Jul 14 10:11:43.552975 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:43.552937 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:43.553461 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:43.553026 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:43.565478 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:43.565450 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:44.014814 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:44.014784 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk" Jul 14 10:11:54.365762 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.365717 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k"] Jul 14 10:11:54.369246 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.369223 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.372062 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.372029 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 10:11:54.386268 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.386246 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k"] Jul 14 10:11:54.456706 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.456660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:11:54.479814 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.479790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39f55190-e5d1-422c-bfc6-eebb6dea451b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.479887 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.479832 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6r7q\" (UniqueName: \"kubernetes.io/projected/39f55190-e5d1-422c-bfc6-eebb6dea451b-kube-api-access-s6r7q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.479931 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.479880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.479972 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.479932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.480005 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.479982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.480005 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.480000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.580833 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.580804 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.580952 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.580917 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.580952 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.580944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.581041 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.580973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39f55190-e5d1-422c-bfc6-eebb6dea451b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.581041 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.581009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6r7q\" (UniqueName: \"kubernetes.io/projected/39f55190-e5d1-422c-bfc6-eebb6dea451b-kube-api-access-s6r7q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.581141 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.581052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.581342 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.581320 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.581342 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.581331 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.581478 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.581376 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.582978 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.582961 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39f55190-e5d1-422c-bfc6-eebb6dea451b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.583364 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.583319 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39f55190-e5d1-422c-bfc6-eebb6dea451b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.588781 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.588763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6r7q\" (UniqueName: \"kubernetes.io/projected/39f55190-e5d1-422c-bfc6-eebb6dea451b-kube-api-access-s6r7q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-q6s9k\" (UID: \"39f55190-e5d1-422c-bfc6-eebb6dea451b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.678865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.678846 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:11:54.806644 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:54.806617 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k"] Jul 14 10:11:54.809709 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:11:54.809682 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f55190_e5d1_422c_bfc6_eebb6dea451b.slice/crio-c1a3f6dbb96e5d9b18c93f8f92a2ae75d69ce660baf6e2d148031f327e86d48c WatchSource:0}: Error finding container c1a3f6dbb96e5d9b18c93f8f92a2ae75d69ce660baf6e2d148031f327e86d48c: Status 404 returned error can't find the container with id c1a3f6dbb96e5d9b18c93f8f92a2ae75d69ce660baf6e2d148031f327e86d48c Jul 14 10:11:55.048731 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:55.048705 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" event={"ID":"39f55190-e5d1-422c-bfc6-eebb6dea451b","Type":"ContainerStarted","Data":"c1a3f6dbb96e5d9b18c93f8f92a2ae75d69ce660baf6e2d148031f327e86d48c"} Jul 14 10:11:56.054471 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:56.054435 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" event={"ID":"39f55190-e5d1-422c-bfc6-eebb6dea451b","Type":"ContainerStarted","Data":"ce93af376854642a6cd55364fc4cc910c2e610a2dacb4ade8ddcd8b97a3e5343"} Jul 14 10:11:56.072956 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:56.072905 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" podStartSLOduration=1.881920566 podStartE2EDuration="2.072890804s" totalImagesPullingTime="190.970238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:11:56.072618231 +0000 UTC m=+686.353826354" watchObservedRunningTime="2026-07-14 10:11:56.072890804 +0000 UTC m=+686.354098926" Jul 14 10:11:56.209579 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:56.209551 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:11:59.192250 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:11:59.192213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:12:02.002094 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:02.002060 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:12:04.679445 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:04.679401 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:12:04.679968 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:04.679488 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:12:04.691853 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:04.691828 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:12:05.105335 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:05.105250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-q6s9k" Jul 14 10:12:07.255465 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:07.255433 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:12:58.430372 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:58.430341 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:12:58.530276 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:58.530244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:12:59.579563 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:59.579532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:12:59.674800 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:12:59.674766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:13:05.501711 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:13:05.501678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:13:45.414685 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:13:45.414653 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:13:54.727135 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:13:54.727059 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:14:05.503426 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:05.503392 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:14:14.421183 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:14.421151 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:14:25.309108 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:25.309073 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:14:27.696638 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:27.696603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:14:29.087182 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:29.087143 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:14:40.777939 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:40.777905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:14:40.834847 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:40.834819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:14:49.541042 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:49.541004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:14:49.642012 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:49.641980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:14:54.116277 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:14:54.116238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:15:05.712115 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:05.712073 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:15:10.793267 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:10.793232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:10.890603 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:10.890566 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:11.026658 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:11.026629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:17.810856 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:17.810819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:17.910736 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:17.910707 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:18.010479 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:18.010448 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:18.162596 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:18.162562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:23.995910 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:23.995802 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:24.266694 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:24.266617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:24.367597 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:24.367548 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:15:30.078828 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:30.078804 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:15:30.079237 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:30.078864 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:15:40.708030 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:40.707989 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:15:50.713798 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:50.713761 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:15:59.120644 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:15:59.120605 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:16:08.345773 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:16:08.345730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:16:18.909244 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:16:18.909205 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:16:28.319127 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:16:28.319090 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:16:39.923865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:16:39.923833 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:16:49.507969 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:16:49.507935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:17:12.411769 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:17:12.411725 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:17:21.912345 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:17:21.912308 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:17:46.110315 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:17:46.110281 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:17:55.515093 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:17:55.515062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:17:56.921015 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:17:56.920973 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:17:57.755661 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:17:57.755628 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:18:11.113963 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:18:11.113927 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:18:22.121836 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:18:22.121805 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:18:31.641626 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:18:31.641591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:18:32.418120 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:18:32.418086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:18:41.229960 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:18:41.229926 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:18:50.316606 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:18:50.316570 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:20:15.009219 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:20:15.009186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:20:30.102389 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:20:30.102363 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:20:30.103137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:20:30.103116 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:20:39.210287 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:20:39.210247 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:20:51.614063 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:20:51.614029 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:21:00.408042 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:21:00.408011 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:21:12.312607 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:21:12.312573 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:21:22.611652 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:21:22.611564 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:21:33.416266 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:21:33.416234 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:21:37.576782 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:21:37.576718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:21:43.115998 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:21:43.115965 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:21:53.817921 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:21:53.817880 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:22:03.870446 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:22:03.870379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:22:04.024756 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:22:04.024710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:22:04.730172 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:22:04.730137 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:22:14.023621 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:22:14.023590 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:22:25.603659 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:22:25.603621 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:22:48.321880 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:22:48.321843 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:22:57.714543 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:22:57.714511 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:23:06.423379 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:23:06.423340 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:23:18.517048 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:23:18.517012 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:23:34.608256 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:23:34.608226 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:23:44.123147 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:23:44.123115 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:23:48.389004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:23:48.388949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:23:49.787474 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:23:49.787434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:23:53.408708 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:23:53.408674 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:24:01.218055 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:24:01.218021 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:24:10.516814 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:24:10.516784 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:24:22.204154 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:24:22.204055 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:24:35.616208 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:24:35.616169 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:24:45.120217 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:24:45.120181 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:24:54.320074 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:24:54.320039 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:25:04.697845 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:04.697796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:25:04.792236 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:04.792198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:25:07.034250 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:07.034212 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:25:18.706537 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:18.706503 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:25:27.621661 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:27.621621 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:25:30.126343 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:30.126314 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:25:30.128439 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:30.128421 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:25:38.818632 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:38.818598 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:25:55.615021 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:25:55.614989 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:26:06.418402 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:06.418359 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:26:10.236087 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:10.236051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:10.335847 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:10.335811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:10.731528 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:10.731489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:17.222100 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:17.222062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:17.336773 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:17.336720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:17.465513 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:17.465477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:17.552145 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:17.552035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:18.600595 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:18.600557 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:18.680649 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:18.680614 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:18.746421 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:18.746380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:19.108089 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:19.108058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:19.243250 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:19.243218 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:19.340388 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:19.340359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:21.171262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:21.171228 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:23.660001 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:23.659972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:23.848062 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:23.848022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:23.928667 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:23.928577 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:24.091327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:24.091289 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:25.879438 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:25.879408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:30.742266 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:30.742233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:30.841958 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:30.841926 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:30.960591 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:30.960558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:31.030975 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:31.030873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:32.128384 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:32.128348 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:32.225141 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:32.225097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:32.299190 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:32.299154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:32.478599 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:32.478504 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:32.817275 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:32.817183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:32.917611 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:32.917574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:34.086835 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:34.086799 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:34.924539 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:34.924501 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:26:37.110028 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:37.109979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:37.567760 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:37.567693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:43.192254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:43.192217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:43.293050 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:43.293005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:45.327828 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:45.327792 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:26:46.025162 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:46.025129 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:50.296418 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:50.296381 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:50.368666 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:50.368632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:50.523717 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:50.523677 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:50.621801 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:50.621707 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:51.735655 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:51.735620 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:51.845875 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:51.845840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:51.926632 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:51.926596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:52.157894 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:52.157860 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:52.650076 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:52.650041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:52.764071 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:52.764014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:53.829703 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:53.829672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:54.789393 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:54.789365 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:26:56.135430 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:56.135402 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:56.305494 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:56.305454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:56.402481 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:56.402406 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:56.687296 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:56.687193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:26:57.728334 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:26:57.728300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:03.337839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:03.337803 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:27:03.589105 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:03.589022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:03.699992 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:03.699956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:04.121634 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:04.121600 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:04.222305 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:04.222238 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:04.330441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:04.330405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:06.008917 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:06.008869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:12.585154 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:12.585109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:12.667909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:12.667876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:12.772193 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:12.772161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:12.867966 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:12.867887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:13.417401 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:13.417365 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:18.542218 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:18.542180 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:29.029472 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:29.029440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:39.431062 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:39.431022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:46.002372 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:46.002336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:46.098396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:46.098368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:27:46.198691 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:27:46.198661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:02.149821 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:02.149787 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:08.551932 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:08.551902 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:08.650865 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:08.650832 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:08.757901 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:08.757867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:08.857968 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:08.857892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:19.341712 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:19.341675 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:20.116451 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:20.116421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:27.024052 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:27.024006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:27.126460 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:27.126427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:27.225663 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:27.225634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:27.323525 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:27.323461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:28.144172 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:28.144136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:28.271559 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:28.271527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:28.378033 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:28.378003 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:29.546619 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:29.546582 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:28:30.016999 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:30.016967 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:36.701194 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:36.701156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:36.864468 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:36.864419 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:36.936270 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:36.936241 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:28:37.532064 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:37.532012 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:43.799064 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:43.799012 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:43.900300 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:43.900263 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:44.088633 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:44.088555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:44.328178 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:44.328145 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:28:44.435637 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:44.435599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:44.883296 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:44.883262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:47.804850 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:47.804809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:47.918520 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:47.918484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:48.047463 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:48.047428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:48.327579 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:48.327543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:48.852969 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:48.852939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:48.949311 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:48.949267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:52.410421 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:52.410332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:53.780920 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:53.780885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:28:54.619276 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:54.619207 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:28:54.856017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:28:54.855989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:00.967346 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:00.967298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:01.068895 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:01.068861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:01.630436 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:01.630404 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:02.181171 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:02.181139 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:02.317649 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:02.317613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:05.225486 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:05.225459 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:29:09.063850 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:09.063821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:09.165903 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:09.165873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:09.481512 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:09.481484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:09.712968 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:09.712924 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:09.841103 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:09.840998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:09.936152 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:09.936122 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:10.179038 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:10.179008 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:17.427455 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:17.427398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:17.542667 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:17.542625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:17.711981 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:17.711874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:17.812366 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:17.812337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:24.098247 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:24.098207 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:24.203634 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:24.203597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:30.641869 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:30.641836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:31.017896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:31.017821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:31.119328 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:31.119292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:34.015106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:34.015072 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:34.110895 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:34.110854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:34.201316 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:34.201278 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:34.355561 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:34.355455 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:34.735266 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:34.735227 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:34.914446 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:34.914410 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:38.512811 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:38.512781 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:40.810525 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:40.810492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:29:47.969072 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:47.969037 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc"] Jul 14 10:29:47.972440 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:47.972420 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:47.976963 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:47.976935 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b18fcbaa\"/\"default-dockercfg-j6b95\"" Jul 14 10:29:47.977072 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:47.977023 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b18fcbaa\"/\"openshift-service-ca.crt\"" Jul 14 10:29:47.977072 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:47.977034 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b18fcbaa\"/\"e2e-lifecycle-model-b18fcbaa-kserve-self-signed-certs\"" Jul 14 10:29:47.977157 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:47.977079 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b18fcbaa\"/\"kube-root-ca.crt\"" Jul 14 10:29:47.990245 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:47.990220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc"] Jul 14 10:29:47.999178 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:47.999152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:48.082099 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.082067 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-tmp-dir\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.082281 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.082107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-model-cache\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.082281 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.082154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-home\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.082281 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.082198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/408e796e-c790-4978-929f-25b2003858f9-tls-certs\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.082281 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.082266 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh7p8\" (UniqueName: \"kubernetes.io/projected/408e796e-c790-4978-929f-25b2003858f9-kube-api-access-hh7p8\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.082436 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.082314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-dshm\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.182954 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.182921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/408e796e-c790-4978-929f-25b2003858f9-tls-certs\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.183107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.182960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh7p8\" (UniqueName: \"kubernetes.io/projected/408e796e-c790-4978-929f-25b2003858f9-kube-api-access-hh7p8\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.183107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.182999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-dshm\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.183107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.183038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-tmp-dir\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.183107 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.183058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-model-cache\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.183279 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.183127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-home\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.183469 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.183440 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-tmp-dir\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.183581 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.183470 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-home\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.183581 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.183556 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-model-cache\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.185296 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.185277 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-dshm\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.185519 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.185496 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/408e796e-c790-4978-929f-25b2003858f9-tls-certs\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.194182 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.194160 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh7p8\" (UniqueName: \"kubernetes.io/projected/408e796e-c790-4978-929f-25b2003858f9-kube-api-access-hh7p8\") pod \"e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.281786 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.281677 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:48.410087 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.410063 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc"] Jul 14 10:29:48.412732 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:29:48.412705 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod408e796e_c790_4978_929f_25b2003858f9.slice/crio-507c43f2508b0f0c896034b78cea7ee2e14300bd05203877499ed550b2bd9413 WatchSource:0}: Error finding container 507c43f2508b0f0c896034b78cea7ee2e14300bd05203877499ed550b2bd9413: Status 404 returned error can't find the container with id 507c43f2508b0f0c896034b78cea7ee2e14300bd05203877499ed550b2bd9413 Jul 14 10:29:48.485310 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.485275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" event={"ID":"408e796e-c790-4978-929f-25b2003858f9","Type":"ContainerStarted","Data":"d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08"} Jul 14 10:29:48.485454 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.485325 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" event={"ID":"408e796e-c790-4978-929f-25b2003858f9","Type":"ContainerStarted","Data":"507c43f2508b0f0c896034b78cea7ee2e14300bd05203877499ed550b2bd9413"} Jul 14 10:29:48.504047 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:48.503994 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" podStartSLOduration=1.503974237 podStartE2EDuration="1.503974237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:29:48.503284271 +0000 UTC m=+1758.784492393" watchObservedRunningTime="2026-07-14 10:29:48.503974237 +0000 UTC m=+1758.785182359" Jul 14 10:29:51.926108 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:51.926078 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:29:52.947899 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:52.947862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:53.048091 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:53.048051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:56.512301 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:56.512269 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:56.609922 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:56.609873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:29:58.281896 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:58.281861 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:58.282264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:58.281913 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:58.294037 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:58.294015 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:29:58.538681 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:29:58.538598 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:30:03.523275 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:03.523237 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:30:05.783524 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:05.783487 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:30:06.113347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:06.113255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:30:12.289480 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:12.289438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:30:14.015765 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:14.015716 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:30:16.976313 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:16.976279 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc"] Jul 14 10:30:17.074101 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:17.074056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:30:30.153145 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:30.153119 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:30:30.156370 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:30.156352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:30:31.996339 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:31.996275 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" podUID="408e796e-c790-4978-929f-25b2003858f9" containerName="main" containerID="cri-o://d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08" gracePeriod=45 Jul 14 10:30:32.250727 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.250672 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:30:32.351674 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.351643 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh7p8\" (UniqueName: \"kubernetes.io/projected/408e796e-c790-4978-929f-25b2003858f9-kube-api-access-hh7p8\") pod \"408e796e-c790-4978-929f-25b2003858f9\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " Jul 14 10:30:32.351877 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.351687 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-model-cache\") pod \"408e796e-c790-4978-929f-25b2003858f9\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " Jul 14 10:30:32.351877 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.351707 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-home\") pod \"408e796e-c790-4978-929f-25b2003858f9\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " Jul 14 10:30:32.351877 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.351729 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-tmp-dir\") pod \"408e796e-c790-4978-929f-25b2003858f9\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " Jul 14 10:30:32.351877 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.351788 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/408e796e-c790-4978-929f-25b2003858f9-tls-certs\") pod \"408e796e-c790-4978-929f-25b2003858f9\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " Jul 14 10:30:32.351877 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.351860 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-dshm\") pod \"408e796e-c790-4978-929f-25b2003858f9\" (UID: \"408e796e-c790-4978-929f-25b2003858f9\") " Jul 14 10:30:32.352137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.352000 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-home" (OuterVolumeSpecName: "home") pod "408e796e-c790-4978-929f-25b2003858f9" (UID: "408e796e-c790-4978-929f-25b2003858f9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:30:32.352137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.352015 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-model-cache" (OuterVolumeSpecName: "model-cache") pod "408e796e-c790-4978-929f-25b2003858f9" (UID: "408e796e-c790-4978-929f-25b2003858f9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:30:32.352137 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.352045 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "408e796e-c790-4978-929f-25b2003858f9" (UID: "408e796e-c790-4978-929f-25b2003858f9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:30:32.352238 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.352162 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-model-cache\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:30:32.352238 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.352181 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-home\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:30:32.352238 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.352194 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-tmp-dir\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:30:32.354002 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.353975 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-dshm" (OuterVolumeSpecName: "dshm") pod "408e796e-c790-4978-929f-25b2003858f9" (UID: "408e796e-c790-4978-929f-25b2003858f9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:30:32.354104 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.354019 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408e796e-c790-4978-929f-25b2003858f9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "408e796e-c790-4978-929f-25b2003858f9" (UID: "408e796e-c790-4978-929f-25b2003858f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:30:32.354104 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.354046 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408e796e-c790-4978-929f-25b2003858f9-kube-api-access-hh7p8" (OuterVolumeSpecName: "kube-api-access-hh7p8") pod "408e796e-c790-4978-929f-25b2003858f9" (UID: "408e796e-c790-4978-929f-25b2003858f9"). InnerVolumeSpecName "kube-api-access-hh7p8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:30:32.452600 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.452560 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/408e796e-c790-4978-929f-25b2003858f9-tls-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:30:32.452600 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.452591 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/408e796e-c790-4978-929f-25b2003858f9-dshm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:30:32.452600 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.452601 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh7p8\" (UniqueName: \"kubernetes.io/projected/408e796e-c790-4978-929f-25b2003858f9-kube-api-access-hh7p8\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:30:32.668228 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.668195 2565 generic.go:356] "Generic (PLEG): container finished" podID="408e796e-c790-4978-929f-25b2003858f9" containerID="d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08" exitCode=0 Jul 14 10:30:32.668400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.668233 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" Jul 14 10:30:32.668400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.668245 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" event={"ID":"408e796e-c790-4978-929f-25b2003858f9","Type":"ContainerDied","Data":"d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08"} Jul 14 10:30:32.668400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.668278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc" event={"ID":"408e796e-c790-4978-929f-25b2003858f9","Type":"ContainerDied","Data":"507c43f2508b0f0c896034b78cea7ee2e14300bd05203877499ed550b2bd9413"} Jul 14 10:30:32.668400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.668296 2565 scope.go:117] "RemoveContainer" containerID="d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08" Jul 14 10:30:32.676887 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.676865 2565 scope.go:117] "RemoveContainer" containerID="d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08" Jul 14 10:30:32.677130 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:30:32.677112 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08\": container with ID starting with d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08 not found: ID does not exist" containerID="d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08" Jul 14 10:30:32.677193 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.677138 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08"} err="failed to get container status \"d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08\": rpc error: code = NotFound desc = could not find container \"d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08\": container with ID starting with d200d619559fdb87db5a7bdbb1ce827786143671844db427ee32b256ff51ba08 not found: ID does not exist" Jul 14 10:30:32.688986 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.688965 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc"] Jul 14 10:30:32.694700 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:32.694681 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b18fcbaa/e2e-lifecycle-model-b18fcbaa-kserve-64bcc4875f-2tjgc"] Jul 14 10:30:34.166201 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:34.166166 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="408e796e-c790-4978-929f-25b2003858f9" path="/var/lib/kubelet/pods/408e796e-c790-4978-929f-25b2003858f9/volumes" Jul 14 10:30:53.794292 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:53.794256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:30:55.173839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:55.173804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:30:57.121106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:30:57.121073 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:31:00.745985 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:00.745949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:00.942229 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:00.942192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:01.022910 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:01.022828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:01.229431 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:01.229400 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:02.248243 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:02.248208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:02.348039 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:02.348000 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:02.447762 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:02.447710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:03.166097 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:03.166067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:03.264897 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:03.264858 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:03.436157 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:03.436064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:04.683560 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:04.683529 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:06.025791 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:06.025756 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:31:10.877365 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:10.877332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:10.977637 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:10.977599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:11.509771 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:11.509724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:17.691298 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:17.691262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:17.763444 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:17.763409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:17.843769 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:17.843714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:18.809226 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:18.809189 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:31:28.392034 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:28.391992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:28.740086 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:28.740002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:49.666967 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:49.666931 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:55.891072 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:55.891040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:55.953405 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:55.953374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:56.284068 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:56.283986 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:56.601656 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:56.601577 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:56.709200 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:56.709169 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:59.874449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:59.874417 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:31:59.976538 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:31:59.976497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:00.042581 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:00.042545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:00.422132 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:00.422103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:00.639988 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:00.639950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:00.736103 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:00.736023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:04.358243 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:04.358212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:04.688352 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:04.688324 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:05.025359 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:05.025274 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:05.310979 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:05.310899 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:07.214775 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:07.214730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:32:07.837163 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:07.837132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:07.933122 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:07.933093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:08.477679 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:08.477645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:08.573372 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:08.573338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:08.673778 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:08.673708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:12.325006 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:12.324963 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:17.421332 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:17.421297 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:32:21.062176 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.062142 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4"] Jul 14 10:32:21.062555 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.062452 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408e796e-c790-4978-929f-25b2003858f9" containerName="main" Jul 14 10:32:21.062555 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.062462 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="408e796e-c790-4978-929f-25b2003858f9" containerName="main" Jul 14 10:32:21.062555 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.062519 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="408e796e-c790-4978-929f-25b2003858f9" containerName="main" Jul 14 10:32:21.065581 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.065565 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.068506 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.068485 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-37ad9d\"/\"openshift-service-ca.crt\"" Jul 14 10:32:21.069813 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.069793 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-37ad9d\"/\"kube-root-ca.crt\"" Jul 14 10:32:21.069813 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.069811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-37ad9d\"/\"default-dockercfg-674ln\"" Jul 14 10:32:21.069995 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.069810 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-37ad9d\"/\"test-model-37ad9d-kserve-self-signed-certs\"" Jul 14 10:32:21.077846 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.077824 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4"] Jul 14 10:32:21.153480 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.153449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-home\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.153625 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.153489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-dshm\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.153625 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.153521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-model-cache\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.153625 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.153546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/530a0169-aa3e-4b68-b094-a69787890a2b-tls-certs\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.153625 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.153570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rftng\" (UniqueName: \"kubernetes.io/projected/530a0169-aa3e-4b68-b094-a69787890a2b-kube-api-access-rftng\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.153625 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.153602 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-tmp-dir\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.247999 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.247963 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:21.255008 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.254985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-model-cache\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.255131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.255015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/530a0169-aa3e-4b68-b094-a69787890a2b-tls-certs\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.255131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.255049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rftng\" (UniqueName: \"kubernetes.io/projected/530a0169-aa3e-4b68-b094-a69787890a2b-kube-api-access-rftng\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.255131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.255106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-tmp-dir\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.255292 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.255193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-home\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.255292 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.255249 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-dshm\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.255584 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.255557 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-tmp-dir\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.255779 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.255727 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-home\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.255897 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.255864 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-model-cache\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.257417 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.257389 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-dshm\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.257514 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.257477 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/530a0169-aa3e-4b68-b094-a69787890a2b-tls-certs\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.266984 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.266960 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rftng\" (UniqueName: \"kubernetes.io/projected/530a0169-aa3e-4b68-b094-a69787890a2b-kube-api-access-rftng\") pod \"test-model-37ad9d-kserve-6f884d4465-477p4\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.374699 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.374643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:21.428674 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.428596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:21.505964 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.505944 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4"] Jul 14 10:32:21.507982 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:32:21.507953 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod530a0169_aa3e_4b68_b094_a69787890a2b.slice/crio-e824921f4c0e3f437ba6dd5ef4d9f0dc9ba2c3f6caf1158b31f19ae069c71df9 WatchSource:0}: Error finding container e824921f4c0e3f437ba6dd5ef4d9f0dc9ba2c3f6caf1158b31f19ae069c71df9: Status 404 returned error can't find the container with id e824921f4c0e3f437ba6dd5ef4d9f0dc9ba2c3f6caf1158b31f19ae069c71df9 Jul 14 10:32:21.509072 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:21.509040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:22.126042 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:22.126006 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" event={"ID":"530a0169-aa3e-4b68-b094-a69787890a2b","Type":"ContainerStarted","Data":"9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4"} Jul 14 10:32:22.126042 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:22.126044 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" event={"ID":"530a0169-aa3e-4b68-b094-a69787890a2b","Type":"ContainerStarted","Data":"e824921f4c0e3f437ba6dd5ef4d9f0dc9ba2c3f6caf1158b31f19ae069c71df9"} Jul 14 10:32:22.144445 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:22.144401 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" podStartSLOduration=1.144386313 podStartE2EDuration="1.144386313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:32:22.142440634 +0000 UTC m=+1912.423648784" watchObservedRunningTime="2026-07-14 10:32:22.144386313 +0000 UTC m=+1912.425594435" Jul 14 10:32:26.212385 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:26.212353 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:32:29.325978 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:29.325944 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:29.427021 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:29.426990 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:31.375090 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:31.375055 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:31.375090 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:31.375098 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:31.387332 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:31.387298 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:32.183240 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:32.183213 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:32:36.453674 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.453642 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm"] Jul 14 10:32:36.457356 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.457334 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.460128 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.460099 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1242c6\"/\"kube-root-ca.crt\"" Jul 14 10:32:36.461376 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.461351 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1242c6\"/\"openshift-service-ca.crt\"" Jul 14 10:32:36.461544 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.461523 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1242c6\"/\"test-model-1242c6-kserve-self-signed-certs\"" Jul 14 10:32:36.461604 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.461581 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1242c6\"/\"default-dockercfg-nnnps\"" Jul 14 10:32:36.467103 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.467082 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm"] Jul 14 10:32:36.493462 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.493435 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:36.587302 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.587265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-home\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.587458 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.587311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-model-cache\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.587458 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.587339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpkz6\" (UniqueName: \"kubernetes.io/projected/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-kube-api-access-tpkz6\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.587458 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.587446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-dshm\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.587574 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.587482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tls-certs\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.587574 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.587557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tmp-dir\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688045 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-dshm\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688207 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tls-certs\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688207 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tmp-dir\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688207 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-home\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688207 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-model-cache\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688407 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpkz6\" (UniqueName: \"kubernetes.io/projected/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-kube-api-access-tpkz6\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688595 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688562 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-home\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688595 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688578 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tmp-dir\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.688783 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.688645 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-model-cache\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.690478 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.690450 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-dshm\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.690576 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.690563 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tls-certs\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.699490 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.699466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpkz6\" (UniqueName: \"kubernetes.io/projected/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-kube-api-access-tpkz6\") pod \"test-model-1242c6-kserve-797dcdbbbf-q6qdm\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.767580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.767503 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:36.899498 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:36.899472 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm"] Jul 14 10:32:36.900995 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:32:36.900966 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9736f7b0_e2dd_4cf1_aa38_a73c3393f49f.slice/crio-1be67b5ba06da7bedaa3173c17dc376878dd5f8bf0cdefb630174950edb9a7b8 WatchSource:0}: Error finding container 1be67b5ba06da7bedaa3173c17dc376878dd5f8bf0cdefb630174950edb9a7b8: Status 404 returned error can't find the container with id 1be67b5ba06da7bedaa3173c17dc376878dd5f8bf0cdefb630174950edb9a7b8 Jul 14 10:32:37.192558 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:37.192524 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" event={"ID":"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f","Type":"ContainerStarted","Data":"c0193055a5bcbf8297a57f9ca43f03062ab26134a7e2d23b322f069a636e929a"} Jul 14 10:32:37.192558 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:37.192560 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" event={"ID":"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f","Type":"ContainerStarted","Data":"1be67b5ba06da7bedaa3173c17dc376878dd5f8bf0cdefb630174950edb9a7b8"} Jul 14 10:32:37.212221 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:37.212176 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" podStartSLOduration=1.212160553 podStartE2EDuration="1.212160553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:32:37.211813933 +0000 UTC m=+1927.493022055" watchObservedRunningTime="2026-07-14 10:32:37.212160553 +0000 UTC m=+1927.493368682" Jul 14 10:32:39.419792 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:39.419736 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:32:43.010291 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:43.010250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:46.768447 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:46.768412 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:46.768981 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:46.768486 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:46.780989 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:46.780965 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:47.245243 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:47.245210 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:32:55.258328 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:55.258287 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4"] Jul 14 10:32:55.284737 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:55.284677 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:55.711801 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:55.711764 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:32:56.175575 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:56.175544 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm"] Jul 14 10:32:56.201611 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:56.201574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:56.347578 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:56.347541 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:56.744810 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:56.744772 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:56.919555 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:56.919522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:57.017066 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:57.016988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:32:57.162698 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:32:57.162666 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:01.821809 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:01.821775 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:07.313295 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:07.313259 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:33:10.278463 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.278406 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" podUID="530a0169-aa3e-4b68-b094-a69787890a2b" containerName="main" containerID="cri-o://9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4" gracePeriod=45 Jul 14 10:33:10.523054 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.523029 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:33:10.578714 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.578648 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-tmp-dir\") pod \"530a0169-aa3e-4b68-b094-a69787890a2b\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " Jul 14 10:33:10.578714 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.578701 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-model-cache\") pod \"530a0169-aa3e-4b68-b094-a69787890a2b\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " Jul 14 10:33:10.578922 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.578776 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rftng\" (UniqueName: \"kubernetes.io/projected/530a0169-aa3e-4b68-b094-a69787890a2b-kube-api-access-rftng\") pod \"530a0169-aa3e-4b68-b094-a69787890a2b\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " Jul 14 10:33:10.578922 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.578807 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-dshm\") pod \"530a0169-aa3e-4b68-b094-a69787890a2b\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " Jul 14 10:33:10.578922 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.578826 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-home\") pod \"530a0169-aa3e-4b68-b094-a69787890a2b\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " Jul 14 10:33:10.578922 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.578841 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/530a0169-aa3e-4b68-b094-a69787890a2b-tls-certs\") pod \"530a0169-aa3e-4b68-b094-a69787890a2b\" (UID: \"530a0169-aa3e-4b68-b094-a69787890a2b\") " Jul 14 10:33:10.579131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.578926 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "530a0169-aa3e-4b68-b094-a69787890a2b" (UID: "530a0169-aa3e-4b68-b094-a69787890a2b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:33:10.579131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.578973 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-model-cache" (OuterVolumeSpecName: "model-cache") pod "530a0169-aa3e-4b68-b094-a69787890a2b" (UID: "530a0169-aa3e-4b68-b094-a69787890a2b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:33:10.579131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.579089 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-home" (OuterVolumeSpecName: "home") pod "530a0169-aa3e-4b68-b094-a69787890a2b" (UID: "530a0169-aa3e-4b68-b094-a69787890a2b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:33:10.579131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.579125 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-tmp-dir\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:10.579298 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.579139 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-model-cache\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:10.581021 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.580999 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-dshm" (OuterVolumeSpecName: "dshm") pod "530a0169-aa3e-4b68-b094-a69787890a2b" (UID: "530a0169-aa3e-4b68-b094-a69787890a2b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:33:10.581106 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.581032 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/530a0169-aa3e-4b68-b094-a69787890a2b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "530a0169-aa3e-4b68-b094-a69787890a2b" (UID: "530a0169-aa3e-4b68-b094-a69787890a2b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:33:10.581145 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.581119 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530a0169-aa3e-4b68-b094-a69787890a2b-kube-api-access-rftng" (OuterVolumeSpecName: "kube-api-access-rftng") pod "530a0169-aa3e-4b68-b094-a69787890a2b" (UID: "530a0169-aa3e-4b68-b094-a69787890a2b"). InnerVolumeSpecName "kube-api-access-rftng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:33:10.680467 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.680430 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rftng\" (UniqueName: \"kubernetes.io/projected/530a0169-aa3e-4b68-b094-a69787890a2b-kube-api-access-rftng\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:10.680467 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.680466 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-dshm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:10.680467 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.680475 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/530a0169-aa3e-4b68-b094-a69787890a2b-home\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:10.680467 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:10.680483 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/530a0169-aa3e-4b68-b094-a69787890a2b-tls-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:11.203594 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.203537 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" podUID="9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" containerName="main" containerID="cri-o://c0193055a5bcbf8297a57f9ca43f03062ab26134a7e2d23b322f069a636e929a" gracePeriod=45 Jul 14 10:33:11.338162 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.338134 2565 generic.go:356] "Generic (PLEG): container finished" podID="530a0169-aa3e-4b68-b094-a69787890a2b" containerID="9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4" exitCode=0 Jul 14 10:33:11.338726 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.338205 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" Jul 14 10:33:11.338726 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.338213 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" event={"ID":"530a0169-aa3e-4b68-b094-a69787890a2b","Type":"ContainerDied","Data":"9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4"} Jul 14 10:33:11.338726 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.338259 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4" event={"ID":"530a0169-aa3e-4b68-b094-a69787890a2b","Type":"ContainerDied","Data":"e824921f4c0e3f437ba6dd5ef4d9f0dc9ba2c3f6caf1158b31f19ae069c71df9"} Jul 14 10:33:11.338726 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.338282 2565 scope.go:117] "RemoveContainer" containerID="9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4" Jul 14 10:33:11.340056 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.340017 2565 generic.go:356] "Generic (PLEG): container finished" podID="9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" containerID="c0193055a5bcbf8297a57f9ca43f03062ab26134a7e2d23b322f069a636e929a" exitCode=0 Jul 14 10:33:11.340144 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.340096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" event={"ID":"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f","Type":"ContainerDied","Data":"c0193055a5bcbf8297a57f9ca43f03062ab26134a7e2d23b322f069a636e929a"} Jul 14 10:33:11.346168 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.346147 2565 scope.go:117] "RemoveContainer" containerID="9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4" Jul 14 10:33:11.346412 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:33:11.346393 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4\": container with ID starting with 9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4 not found: ID does not exist" containerID="9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4" Jul 14 10:33:11.346493 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.346418 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4"} err="failed to get container status \"9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4\": rpc error: code = NotFound desc = could not find container \"9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4\": container with ID starting with 9931f84289c7ca017295806ec1759759a207016a03418a6eca7a93f13b3537d4 not found: ID does not exist" Jul 14 10:33:11.363791 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.363763 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4"] Jul 14 10:33:11.367065 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.367045 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-37ad9d/test-model-37ad9d-kserve-6f884d4465-477p4"] Jul 14 10:33:11.461394 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.461333 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:33:11.589861 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.589831 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-dshm\") pod \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " Jul 14 10:33:11.590023 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.589869 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tls-certs\") pod \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " Jul 14 10:33:11.590023 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.589910 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tmp-dir\") pod \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " Jul 14 10:33:11.590023 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.589927 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-home\") pod \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " Jul 14 10:33:11.590023 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.589944 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpkz6\" (UniqueName: \"kubernetes.io/projected/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-kube-api-access-tpkz6\") pod \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " Jul 14 10:33:11.590023 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.589982 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-model-cache\") pod \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\" (UID: \"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f\") " Jul 14 10:33:11.590291 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.590192 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" (UID: "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:33:11.590291 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.590227 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-home" (OuterVolumeSpecName: "home") pod "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" (UID: "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:33:11.590366 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.590324 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-model-cache" (OuterVolumeSpecName: "model-cache") pod "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" (UID: "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:33:11.592093 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.592071 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-dshm" (OuterVolumeSpecName: "dshm") pod "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" (UID: "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:33:11.592187 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.592105 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" (UID: "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:33:11.592230 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.592211 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-kube-api-access-tpkz6" (OuterVolumeSpecName: "kube-api-access-tpkz6") pod "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" (UID: "9736f7b0-e2dd-4cf1-aa38-a73c3393f49f"). InnerVolumeSpecName "kube-api-access-tpkz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:33:11.690466 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.690439 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tmp-dir\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:11.690466 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.690460 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-home\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:11.690466 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.690469 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpkz6\" (UniqueName: \"kubernetes.io/projected/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-kube-api-access-tpkz6\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:11.690639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.690478 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-model-cache\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:11.690639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.690487 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-dshm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:11.690639 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:11.690494 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f-tls-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:33:12.167287 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:12.167253 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="530a0169-aa3e-4b68-b094-a69787890a2b" path="/var/lib/kubelet/pods/530a0169-aa3e-4b68-b094-a69787890a2b/volumes" Jul 14 10:33:12.345710 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:12.345687 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" Jul 14 10:33:12.345710 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:12.345693 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm" event={"ID":"9736f7b0-e2dd-4cf1-aa38-a73c3393f49f","Type":"ContainerDied","Data":"1be67b5ba06da7bedaa3173c17dc376878dd5f8bf0cdefb630174950edb9a7b8"} Jul 14 10:33:12.346175 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:12.345765 2565 scope.go:117] "RemoveContainer" containerID="c0193055a5bcbf8297a57f9ca43f03062ab26134a7e2d23b322f069a636e929a" Jul 14 10:33:12.364641 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:12.364613 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm"] Jul 14 10:33:12.369692 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:12.369672 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1242c6/test-model-1242c6-kserve-797dcdbbbf-q6qdm"] Jul 14 10:33:14.166116 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:14.166086 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" path="/var/lib/kubelet/pods/9736f7b0-e2dd-4cf1-aa38-a73c3393f49f/volumes" Jul 14 10:33:18.334245 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:18.334205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:18.437010 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:18.436976 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:39.317637 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:39.317599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:39.574493 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:39.574401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:39.837422 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:39.837327 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:39.990565 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:39.990529 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:40.653185 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:40.653154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:40.771190 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:40.771151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:44.110981 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:44.110947 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:33:46.877070 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:46.877037 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:46.975903 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:46.975873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:47.196993 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:47.196960 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:47.376186 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:47.376156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:47.721450 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:47.721412 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:48.038759 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:48.038652 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:48.229093 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:48.229059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:50.536805 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:50.536771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:50.630847 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:50.630809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:50.875094 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:50.875009 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:51.177373 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:51.177344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:51.281077 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:51.281041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:53.706998 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:53.706966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:54.899926 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:54.899888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:55.000914 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:55.000885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:55.432905 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:55.432879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:55.723184 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:55.723106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:55.919732 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:55.919702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:57.828923 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:57.828887 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:33:58.496130 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:58.496085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:58.588254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:58.588215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:58.959971 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:58.959937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:59.134050 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:59.134013 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:33:59.234191 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:33:59.234098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:02.956185 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:02.956149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:10.895882 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:10.895850 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:11.347484 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:11.347391 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:11.574480 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:11.574445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:11.676296 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:11.676247 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:11.824373 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:11.824340 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:12.390060 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:12.390023 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:34:18.059349 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:18.059304 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:18.156980 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:18.156948 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:18.255167 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:18.255136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:18.570822 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:18.570783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:18.670991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:18.670953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:18.996065 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:18.996023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:19.110161 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:19.110129 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:19.211696 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:19.211657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:19.388615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:19.388581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:22.008824 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:22.008790 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:34:25.401861 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:25.401814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:25.501864 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:25.501836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:25.648882 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:25.648838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:25.871351 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:25.871238 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:26.191511 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:26.191478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:26.488161 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:26.488058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:26.726476 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:26.726431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:29.708955 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:29.708923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:29.792723 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:29.792678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:29.865720 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:29.865688 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:29.969203 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:29.969116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:30.334197 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:30.334123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:30.434218 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:30.434193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:30.881275 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:30.881243 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:34.169245 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:34.169214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:34.478602 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:34.478524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:34.614209 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:34.614174 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:34:34.762578 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:34.762502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:35.235733 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:35.235686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:37.755984 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:37.755945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:37.861099 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:37.861069 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:37.958444 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:37.958415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:38.396726 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:38.396694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:38.495681 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:38.495645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:42.210455 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:42.210411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:43.217555 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:43.217519 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:34:48.464520 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.464479 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh"] Jul 14 10:34:48.464913 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.464862 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" containerName="main" Jul 14 10:34:48.464913 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.464876 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" containerName="main" Jul 14 10:34:48.464913 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.464900 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530a0169-aa3e-4b68-b094-a69787890a2b" containerName="main" Jul 14 10:34:48.464913 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.464905 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="530a0169-aa3e-4b68-b094-a69787890a2b" containerName="main" Jul 14 10:34:48.465061 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.464952 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9736f7b0-e2dd-4cf1-aa38-a73c3393f49f" containerName="main" Jul 14 10:34:48.465061 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.464962 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="530a0169-aa3e-4b68-b094-a69787890a2b" containerName="main" Jul 14 10:34:48.468142 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.468122 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.471875 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.471854 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"openshift-service-ca.crt\"" Jul 14 10:34:48.471993 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.471890 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"kube-root-ca.crt\"" Jul 14 10:34:48.473153 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.473136 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"auth-test-model-817aae-kserve-self-signed-certs\"" Jul 14 10:34:48.473246 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.473166 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"default-dockercfg-8f4dw\"" Jul 14 10:34:48.482794 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.482775 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh"] Jul 14 10:34:48.493883 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.493856 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:48.612912 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.612885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-dshm\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.613056 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.612924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de6c3642-8d45-451c-8338-89299e56d6fe-tls-certs\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.613056 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.612950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll59n\" (UniqueName: \"kubernetes.io/projected/de6c3642-8d45-451c-8338-89299e56d6fe-kube-api-access-ll59n\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.613129 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.613062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-tmp-dir\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.613129 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.613080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-model-cache\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.613129 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.613098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-home\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.714487 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.714454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-tmp-dir\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.714487 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.714486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-model-cache\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.714713 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.714509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-home\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.714713 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.714525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-dshm\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.714713 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.714652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de6c3642-8d45-451c-8338-89299e56d6fe-tls-certs\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.714713 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.714692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll59n\" (UniqueName: \"kubernetes.io/projected/de6c3642-8d45-451c-8338-89299e56d6fe-kube-api-access-ll59n\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.715015 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.714988 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-tmp-dir\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.715085 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.715022 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-model-cache\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.715085 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.715051 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-home\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.716642 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.716623 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-dshm\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.717019 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.716999 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de6c3642-8d45-451c-8338-89299e56d6fe-tls-certs\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.723532 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.723497 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll59n\" (UniqueName: \"kubernetes.io/projected/de6c3642-8d45-451c-8338-89299e56d6fe-kube-api-access-ll59n\") pod \"auth-test-model-817aae-kserve-8647cfc759-48pjh\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.776895 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.776859 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:48.909996 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:48.909967 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh"] Jul 14 10:34:48.911519 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:34:48.911496 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde6c3642_8d45_451c_8338_89299e56d6fe.slice/crio-0d14b9373f42550ddb8ca616b8693d28f19dedf49db586359671a618fcaee1c6 WatchSource:0}: Error finding container 0d14b9373f42550ddb8ca616b8693d28f19dedf49db586359671a618fcaee1c6: Status 404 returned error can't find the container with id 0d14b9373f42550ddb8ca616b8693d28f19dedf49db586359671a618fcaee1c6 Jul 14 10:34:49.754633 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:49.754600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" event={"ID":"de6c3642-8d45-451c-8338-89299e56d6fe","Type":"ContainerStarted","Data":"66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd"} Jul 14 10:34:49.754633 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:49.754637 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" event={"ID":"de6c3642-8d45-451c-8338-89299e56d6fe","Type":"ContainerStarted","Data":"0d14b9373f42550ddb8ca616b8693d28f19dedf49db586359671a618fcaee1c6"} Jul 14 10:34:49.774390 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:49.774330 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" podStartSLOduration=1.774314653 podStartE2EDuration="1.774314653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:34:49.772886259 +0000 UTC m=+2060.054094382" watchObservedRunningTime="2026-07-14 10:34:49.774314653 +0000 UTC m=+2060.055522775" Jul 14 10:34:51.002658 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:51.002605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:51.103983 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:51.103954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:52.612126 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:52.612046 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:34:53.678929 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:53.678893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:53.780684 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:53.780644 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:34:58.777770 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:58.777716 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:58.777770 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:58.777769 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:58.790464 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:58.790439 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:34:58.804190 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:34:58.804165 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:35:00.059401 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:00.059356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:35:00.158670 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:00.158623 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:35:29.689300 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.689270 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b"] Jul 14 10:35:29.692789 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.692768 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.695448 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.695416 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"default-dockercfg-q46jq\"" Jul 14 10:35:29.696694 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.696669 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"kube-root-ca.crt\"" Jul 14 10:35:29.696829 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.696698 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"openshift-service-ca.crt\"" Jul 14 10:35:29.696829 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.696669 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"auth-test-model-684339-kserve-self-signed-certs\"" Jul 14 10:35:29.716433 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.716407 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b"] Jul 14 10:35:29.729737 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.729714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:35:29.761513 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.761491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-dshm\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.761625 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.761541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tls-certs\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.761625 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.761616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-model-cache\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.761729 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.761646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k74wp\" (UniqueName: \"kubernetes.io/projected/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-kube-api-access-k74wp\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.761799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.761721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tmp-dir\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.761799 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.761763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-home\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.862580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.862543 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tmp-dir\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.862580 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.862577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-home\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.862828 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.862707 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-dshm\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.862869 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.862823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tls-certs\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.862921 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.862865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-model-cache\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.862921 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.862891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k74wp\" (UniqueName: \"kubernetes.io/projected/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-kube-api-access-k74wp\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.863024 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.862992 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-home\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.863109 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.863089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tmp-dir\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.863227 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.863207 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-model-cache\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.864880 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.864855 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-dshm\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.865227 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.865211 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tls-certs\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:29.874916 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:29.874889 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k74wp\" (UniqueName: \"kubernetes.io/projected/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-kube-api-access-k74wp\") pod \"auth-test-model-684339-kserve-789db4755f-mxg2b\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:30.002484 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:30.002408 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:30.134406 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:30.134379 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b"] Jul 14 10:35:30.136259 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:35:30.136233 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b5b49b7_8e54_45ae_aeac_4ef96a73e061.slice/crio-6f044211203546372c7e5d2b431c43793be4168da9d3271b16829c4b2ac33653 WatchSource:0}: Error finding container 6f044211203546372c7e5d2b431c43793be4168da9d3271b16829c4b2ac33653: Status 404 returned error can't find the container with id 6f044211203546372c7e5d2b431c43793be4168da9d3271b16829c4b2ac33653 Jul 14 10:35:30.182262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:30.182244 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:35:30.185603 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:30.185588 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:35:30.934481 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:30.934443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" event={"ID":"2b5b49b7-8e54-45ae-aeac-4ef96a73e061","Type":"ContainerStarted","Data":"2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d"} Jul 14 10:35:30.934860 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:30.934493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" event={"ID":"2b5b49b7-8e54-45ae-aeac-4ef96a73e061","Type":"ContainerStarted","Data":"6f044211203546372c7e5d2b431c43793be4168da9d3271b16829c4b2ac33653"} Jul 14 10:35:30.954977 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:30.954931 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" podStartSLOduration=1.95491532 podStartE2EDuration="1.95491532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:35:30.953465761 +0000 UTC m=+2101.234673884" watchObservedRunningTime="2026-07-14 10:35:30.95491532 +0000 UTC m=+2101.236123441" Jul 14 10:35:32.922482 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:32.922448 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:35:40.003218 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:40.003177 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:40.003593 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:40.003440 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:40.015650 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:40.015623 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:40.986349 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:40.986317 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:35:48.422395 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:35:48.422361 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:36:05.927052 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:36:05.927019 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:36:19.616214 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:36:19.616177 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:36:31.666905 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:36:31.666817 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:36:38.026835 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:36:38.026795 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:36:55.618274 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:36:55.618237 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:37:11.813386 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:11.813352 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:37:29.414761 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:29.414711 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:37:33.628360 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:33.628328 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh"] Jul 14 10:37:33.648542 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:33.648515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:37:34.733689 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:34.733655 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b"] Jul 14 10:37:34.786924 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:34.786887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:37:40.681127 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:40.681096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:37:45.705131 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:45.705097 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:37:48.647910 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.647870 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" podUID="de6c3642-8d45-451c-8338-89299e56d6fe" containerName="main" containerID="cri-o://66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd" gracePeriod=45 Jul 14 10:37:48.794213 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.794157 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" podUID="de6c3642-8d45-451c-8338-89299e56d6fe" containerName="main" probeResult="failure" output="Get \"https://10.134.0.30:8000/ready\": dial tcp 10.134.0.30:8000: connect: connection refused" Jul 14 10:37:48.897126 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.897101 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:37:48.959355 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959272 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-dshm\") pod \"de6c3642-8d45-451c-8338-89299e56d6fe\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " Jul 14 10:37:48.959355 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959354 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-model-cache\") pod \"de6c3642-8d45-451c-8338-89299e56d6fe\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " Jul 14 10:37:48.959553 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959402 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de6c3642-8d45-451c-8338-89299e56d6fe-tls-certs\") pod \"de6c3642-8d45-451c-8338-89299e56d6fe\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " Jul 14 10:37:48.959553 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959448 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll59n\" (UniqueName: \"kubernetes.io/projected/de6c3642-8d45-451c-8338-89299e56d6fe-kube-api-access-ll59n\") pod \"de6c3642-8d45-451c-8338-89299e56d6fe\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " Jul 14 10:37:48.959553 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959473 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-home\") pod \"de6c3642-8d45-451c-8338-89299e56d6fe\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " Jul 14 10:37:48.959553 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959517 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-tmp-dir\") pod \"de6c3642-8d45-451c-8338-89299e56d6fe\" (UID: \"de6c3642-8d45-451c-8338-89299e56d6fe\") " Jul 14 10:37:48.959760 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959631 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "de6c3642-8d45-451c-8338-89299e56d6fe" (UID: "de6c3642-8d45-451c-8338-89299e56d6fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:37:48.959830 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959792 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-home" (OuterVolumeSpecName: "home") pod "de6c3642-8d45-451c-8338-89299e56d6fe" (UID: "de6c3642-8d45-451c-8338-89299e56d6fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:37:48.959891 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959830 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-model-cache\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:48.959891 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.959865 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "de6c3642-8d45-451c-8338-89299e56d6fe" (UID: "de6c3642-8d45-451c-8338-89299e56d6fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:37:48.961602 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.961579 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-dshm" (OuterVolumeSpecName: "dshm") pod "de6c3642-8d45-451c-8338-89299e56d6fe" (UID: "de6c3642-8d45-451c-8338-89299e56d6fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:37:48.961702 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.961635 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de6c3642-8d45-451c-8338-89299e56d6fe-kube-api-access-ll59n" (OuterVolumeSpecName: "kube-api-access-ll59n") pod "de6c3642-8d45-451c-8338-89299e56d6fe" (UID: "de6c3642-8d45-451c-8338-89299e56d6fe"). InnerVolumeSpecName "kube-api-access-ll59n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:37:48.961702 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:48.961639 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de6c3642-8d45-451c-8338-89299e56d6fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "de6c3642-8d45-451c-8338-89299e56d6fe" (UID: "de6c3642-8d45-451c-8338-89299e56d6fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:37:49.060436 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.060400 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de6c3642-8d45-451c-8338-89299e56d6fe-tls-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:49.060436 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.060432 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll59n\" (UniqueName: \"kubernetes.io/projected/de6c3642-8d45-451c-8338-89299e56d6fe-kube-api-access-ll59n\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:49.060640 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.060445 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-home\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:49.060640 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.060458 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-tmp-dir\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:49.060640 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.060470 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de6c3642-8d45-451c-8338-89299e56d6fe-dshm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:49.514941 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.514909 2565 generic.go:356] "Generic (PLEG): container finished" podID="de6c3642-8d45-451c-8338-89299e56d6fe" containerID="66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd" exitCode=0 Jul 14 10:37:49.515119 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.514953 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" Jul 14 10:37:49.515119 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.514957 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" event={"ID":"de6c3642-8d45-451c-8338-89299e56d6fe","Type":"ContainerDied","Data":"66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd"} Jul 14 10:37:49.515119 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.515064 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh" event={"ID":"de6c3642-8d45-451c-8338-89299e56d6fe","Type":"ContainerDied","Data":"0d14b9373f42550ddb8ca616b8693d28f19dedf49db586359671a618fcaee1c6"} Jul 14 10:37:49.515119 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.515084 2565 scope.go:117] "RemoveContainer" containerID="66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd" Jul 14 10:37:49.523830 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.523810 2565 scope.go:117] "RemoveContainer" containerID="66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd" Jul 14 10:37:49.524096 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:37:49.524078 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd\": container with ID starting with 66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd not found: ID does not exist" containerID="66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd" Jul 14 10:37:49.524149 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.524107 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd"} err="failed to get container status \"66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd\": rpc error: code = NotFound desc = could not find container \"66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd\": container with ID starting with 66b66c5cadf74ea7509d4f18bc2e984dd17720a2fc35e7d94b849afd37be00bd not found: ID does not exist" Jul 14 10:37:49.535571 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.535551 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh"] Jul 14 10:37:49.539515 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.539496 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/auth-test-model-817aae-kserve-8647cfc759-48pjh"] Jul 14 10:37:49.753607 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:49.753572 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" podUID="2b5b49b7-8e54-45ae-aeac-4ef96a73e061" containerName="main" containerID="cri-o://2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d" gracePeriod=45 Jul 14 10:37:50.001192 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.001164 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:37:50.068682 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.068599 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-model-cache\") pod \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " Jul 14 10:37:50.068682 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.068666 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-home\") pod \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " Jul 14 10:37:50.068924 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.068712 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tls-certs\") pod \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " Jul 14 10:37:50.068924 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.068732 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k74wp\" (UniqueName: \"kubernetes.io/projected/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-kube-api-access-k74wp\") pod \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " Jul 14 10:37:50.068924 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.068805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tmp-dir\") pod \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " Jul 14 10:37:50.068924 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.068845 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-dshm\") pod \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\" (UID: \"2b5b49b7-8e54-45ae-aeac-4ef96a73e061\") " Jul 14 10:37:50.069139 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.068929 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b5b49b7-8e54-45ae-aeac-4ef96a73e061" (UID: "2b5b49b7-8e54-45ae-aeac-4ef96a73e061"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:37:50.069139 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.068980 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-home" (OuterVolumeSpecName: "home") pod "2b5b49b7-8e54-45ae-aeac-4ef96a73e061" (UID: "2b5b49b7-8e54-45ae-aeac-4ef96a73e061"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:37:50.069139 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.069105 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b5b49b7-8e54-45ae-aeac-4ef96a73e061" (UID: "2b5b49b7-8e54-45ae-aeac-4ef96a73e061"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:37:50.069286 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.069221 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-model-cache\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:50.069286 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.069240 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-home\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:50.069286 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.069252 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tmp-dir\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:50.071017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.070994 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-dshm" (OuterVolumeSpecName: "dshm") pod "2b5b49b7-8e54-45ae-aeac-4ef96a73e061" (UID: "2b5b49b7-8e54-45ae-aeac-4ef96a73e061"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:37:50.071120 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.071024 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b5b49b7-8e54-45ae-aeac-4ef96a73e061" (UID: "2b5b49b7-8e54-45ae-aeac-4ef96a73e061"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:37:50.071120 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.071030 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-kube-api-access-k74wp" (OuterVolumeSpecName: "kube-api-access-k74wp") pod "2b5b49b7-8e54-45ae-aeac-4ef96a73e061" (UID: "2b5b49b7-8e54-45ae-aeac-4ef96a73e061"). InnerVolumeSpecName "kube-api-access-k74wp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:37:50.165695 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.165664 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de6c3642-8d45-451c-8338-89299e56d6fe" path="/var/lib/kubelet/pods/de6c3642-8d45-451c-8338-89299e56d6fe/volumes" Jul 14 10:37:50.170330 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.170304 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-dshm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:50.170436 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.170329 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-tls-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:50.170436 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.170351 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k74wp\" (UniqueName: \"kubernetes.io/projected/2b5b49b7-8e54-45ae-aeac-4ef96a73e061-kube-api-access-k74wp\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:37:50.520891 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.520855 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b5b49b7-8e54-45ae-aeac-4ef96a73e061" containerID="2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d" exitCode=0 Jul 14 10:37:50.520891 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.520893 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" Jul 14 10:37:50.521089 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.520932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" event={"ID":"2b5b49b7-8e54-45ae-aeac-4ef96a73e061","Type":"ContainerDied","Data":"2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d"} Jul 14 10:37:50.521089 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.520964 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b" event={"ID":"2b5b49b7-8e54-45ae-aeac-4ef96a73e061","Type":"ContainerDied","Data":"6f044211203546372c7e5d2b431c43793be4168da9d3271b16829c4b2ac33653"} Jul 14 10:37:50.521089 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.520985 2565 scope.go:117] "RemoveContainer" containerID="2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d" Jul 14 10:37:50.529361 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.529345 2565 scope.go:117] "RemoveContainer" containerID="2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d" Jul 14 10:37:50.529596 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:37:50.529578 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d\": container with ID starting with 2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d not found: ID does not exist" containerID="2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d" Jul 14 10:37:50.529641 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.529604 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d"} err="failed to get container status \"2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d\": rpc error: code = NotFound desc = could not find container \"2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d\": container with ID starting with 2237863eadad3d228f8a72bbcf38ac5441821f032428acef998ef7ec93b17b7d not found: ID does not exist" Jul 14 10:37:50.539619 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.539595 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b"] Jul 14 10:37:50.547857 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:50.547838 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-684339/auth-test-model-684339-kserve-789db4755f-mxg2b"] Jul 14 10:37:52.166668 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:52.166594 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b5b49b7-8e54-45ae-aeac-4ef96a73e061" path="/var/lib/kubelet/pods/2b5b49b7-8e54-45ae-aeac-4ef96a73e061/volumes" Jul 14 10:37:57.927991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:37:57.927958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:38:27.393533 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.393503 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz"] Jul 14 10:38:27.394123 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.393998 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de6c3642-8d45-451c-8338-89299e56d6fe" containerName="main" Jul 14 10:38:27.394123 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.394017 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de6c3642-8d45-451c-8338-89299e56d6fe" containerName="main" Jul 14 10:38:27.394123 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.394067 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b5b49b7-8e54-45ae-aeac-4ef96a73e061" containerName="main" Jul 14 10:38:27.394123 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.394077 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b5b49b7-8e54-45ae-aeac-4ef96a73e061" containerName="main" Jul 14 10:38:27.394345 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.394164 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b5b49b7-8e54-45ae-aeac-4ef96a73e061" containerName="main" Jul 14 10:38:27.394345 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.394180 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de6c3642-8d45-451c-8338-89299e56d6fe" containerName="main" Jul 14 10:38:27.401315 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.401288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.406156 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.406138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"kube-root-ca.crt\"" Jul 14 10:38:27.406274 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.406257 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"sub-test-model-684339-kserve-self-signed-certs\"" Jul 14 10:38:27.406327 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.406306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"default-dockercfg-q46jq\"" Jul 14 10:38:27.406379 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.406327 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"openshift-service-ca.crt\"" Jul 14 10:38:27.410384 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.410361 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz"] Jul 14 10:38:27.435478 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.435437 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:38:27.581016 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.580979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbljk\" (UniqueName: \"kubernetes.io/projected/afc9fb11-ffee-404e-b6c9-0618f1023ad8-kube-api-access-zbljk\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.581183 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.581070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tmp-dir\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.581183 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.581103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-dshm\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.581183 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.581161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-model-cache\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.581304 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.581209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-home\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.581304 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.581231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tls-certs\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.681941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-dshm\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682017 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.681992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-model-cache\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682208 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.682040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-home\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682208 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.682064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tls-certs\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682208 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.682098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbljk\" (UniqueName: \"kubernetes.io/projected/afc9fb11-ffee-404e-b6c9-0618f1023ad8-kube-api-access-zbljk\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682208 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.682167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tmp-dir\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682492 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.682462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-model-cache\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682614 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.682561 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tmp-dir\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.682614 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.682587 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-home\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.684367 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.684345 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-dshm\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.684482 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.684465 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tls-certs\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.693193 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.693173 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbljk\" (UniqueName: \"kubernetes.io/projected/afc9fb11-ffee-404e-b6c9-0618f1023ad8-kube-api-access-zbljk\") pod \"sub-test-model-684339-kserve-6ddd798bd9-xkmbz\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.710886 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.710860 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:27.849971 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:27.849941 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz"] Jul 14 10:38:27.850345 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:38:27.850319 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafc9fb11_ffee_404e_b6c9_0618f1023ad8.slice/crio-eedf7a91e7e48e01899732ee01aaf132403a9fc9f9b6550985b0690141d84747 WatchSource:0}: Error finding container eedf7a91e7e48e01899732ee01aaf132403a9fc9f9b6550985b0690141d84747: Status 404 returned error can't find the container with id eedf7a91e7e48e01899732ee01aaf132403a9fc9f9b6550985b0690141d84747 Jul 14 10:38:28.695837 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:28.695798 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" event={"ID":"afc9fb11-ffee-404e-b6c9-0618f1023ad8","Type":"ContainerStarted","Data":"e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb"} Jul 14 10:38:28.696196 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:28.695845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" event={"ID":"afc9fb11-ffee-404e-b6c9-0618f1023ad8","Type":"ContainerStarted","Data":"eedf7a91e7e48e01899732ee01aaf132403a9fc9f9b6550985b0690141d84747"} Jul 14 10:38:28.722848 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:28.722806 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" podStartSLOduration=1.7227391810000001 podStartE2EDuration="1.722739181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:38:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:38:28.72148374 +0000 UTC m=+2279.002691863" watchObservedRunningTime="2026-07-14 10:38:28.722739181 +0000 UTC m=+2279.003947303" Jul 14 10:38:31.931120 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:31.931085 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:38:37.711624 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:37.711587 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:37.712083 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:37.711648 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:37.723858 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:37.723835 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:37.745004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:37.744981 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:38:47.531130 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:38:47.531096 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:39:06.112066 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:06.112018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:39:06.294352 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:06.294317 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:07.138606 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:07.138576 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz"] Jul 14 10:39:07.733391 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:07.733362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:18.312046 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.312005 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:39:18.962222 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.962187 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h"] Jul 14 10:39:18.965615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.965593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:18.969396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.969368 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"kube-root-ca.crt\"" Jul 14 10:39:18.969396 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.969389 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"openshift-service-ca.crt\"" Jul 14 10:39:18.969561 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.969433 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"rate-test-model-817aae-kserve-self-signed-certs\"" Jul 14 10:39:18.969561 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.969387 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"default-dockercfg-8f4dw\"" Jul 14 10:39:18.976143 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.976117 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h"] Jul 14 10:39:18.997263 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:18.997220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:19.110476 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.110445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-model-cache\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.110476 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.110475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-tmp-dir\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.110712 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.110505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrksm\" (UniqueName: \"kubernetes.io/projected/858e6e31-34c2-4f47-b622-94d6d44a8f78-kube-api-access-lrksm\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.110712 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.110557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/858e6e31-34c2-4f47-b622-94d6d44a8f78-tls-certs\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.110712 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.110650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-dshm\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.110712 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.110695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-home\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211229 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-dshm\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211348 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-home\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211399 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-model-cache\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211399 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-tmp-dir\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211481 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrksm\" (UniqueName: \"kubernetes.io/projected/858e6e31-34c2-4f47-b622-94d6d44a8f78-kube-api-access-lrksm\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211481 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/858e6e31-34c2-4f47-b622-94d6d44a8f78-tls-certs\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211607 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211589 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-home\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211685 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211662 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-model-cache\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.211760 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.211707 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-tmp-dir\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.213566 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.213505 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-dshm\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.213916 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.213897 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/858e6e31-34c2-4f47-b622-94d6d44a8f78-tls-certs\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.221192 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.221171 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrksm\" (UniqueName: \"kubernetes.io/projected/858e6e31-34c2-4f47-b622-94d6d44a8f78-kube-api-access-lrksm\") pod \"rate-test-model-817aae-kserve-d6bcbc679-p472h\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.274062 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.274037 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:19.403729 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.403706 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h"] Jul 14 10:39:19.405677 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:39:19.405652 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod858e6e31_34c2_4f47_b622_94d6d44a8f78.slice/crio-d7622f50913c5dcbb995aa587f91b02b4991d0659680b961ed3642b81ba579aa WatchSource:0}: Error finding container d7622f50913c5dcbb995aa587f91b02b4991d0659680b961ed3642b81ba579aa: Status 404 returned error can't find the container with id d7622f50913c5dcbb995aa587f91b02b4991d0659680b961ed3642b81ba579aa Jul 14 10:39:19.915378 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.915338 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" event={"ID":"858e6e31-34c2-4f47-b622-94d6d44a8f78","Type":"ContainerStarted","Data":"a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4"} Jul 14 10:39:19.915543 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.915389 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" event={"ID":"858e6e31-34c2-4f47-b622-94d6d44a8f78","Type":"ContainerStarted","Data":"d7622f50913c5dcbb995aa587f91b02b4991d0659680b961ed3642b81ba579aa"} Jul 14 10:39:19.933692 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:19.933645 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" podStartSLOduration=1.933627722 podStartE2EDuration="1.933627722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:39:19.932661226 +0000 UTC m=+2330.213869361" watchObservedRunningTime="2026-07-14 10:39:19.933627722 +0000 UTC m=+2330.214835843" Jul 14 10:39:22.158659 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.158577 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" podUID="afc9fb11-ffee-404e-b6c9-0618f1023ad8" containerName="main" containerID="cri-o://e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb" gracePeriod=45 Jul 14 10:39:22.403706 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.403682 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:39:22.538728 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.538649 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tls-certs\") pod \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " Jul 14 10:39:22.538880 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.538793 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tmp-dir\") pod \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " Jul 14 10:39:22.538880 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.538842 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbljk\" (UniqueName: \"kubernetes.io/projected/afc9fb11-ffee-404e-b6c9-0618f1023ad8-kube-api-access-zbljk\") pod \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " Jul 14 10:39:22.538991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.538896 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-model-cache\") pod \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " Jul 14 10:39:22.538991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.538936 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-dshm\") pod \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " Jul 14 10:39:22.538991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.538964 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-home\") pod \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\" (UID: \"afc9fb11-ffee-404e-b6c9-0618f1023ad8\") " Jul 14 10:39:22.539143 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.539042 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "afc9fb11-ffee-404e-b6c9-0618f1023ad8" (UID: "afc9fb11-ffee-404e-b6c9-0618f1023ad8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:39:22.539239 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.539213 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-model-cache" (OuterVolumeSpecName: "model-cache") pod "afc9fb11-ffee-404e-b6c9-0618f1023ad8" (UID: "afc9fb11-ffee-404e-b6c9-0618f1023ad8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:39:22.539320 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.539280 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-home" (OuterVolumeSpecName: "home") pod "afc9fb11-ffee-404e-b6c9-0618f1023ad8" (UID: "afc9fb11-ffee-404e-b6c9-0618f1023ad8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:39:22.539320 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.539293 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tmp-dir\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:39:22.540934 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.540900 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-dshm" (OuterVolumeSpecName: "dshm") pod "afc9fb11-ffee-404e-b6c9-0618f1023ad8" (UID: "afc9fb11-ffee-404e-b6c9-0618f1023ad8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:39:22.540934 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.540917 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "afc9fb11-ffee-404e-b6c9-0618f1023ad8" (UID: "afc9fb11-ffee-404e-b6c9-0618f1023ad8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:39:22.541071 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.540968 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc9fb11-ffee-404e-b6c9-0618f1023ad8-kube-api-access-zbljk" (OuterVolumeSpecName: "kube-api-access-zbljk") pod "afc9fb11-ffee-404e-b6c9-0618f1023ad8" (UID: "afc9fb11-ffee-404e-b6c9-0618f1023ad8"). InnerVolumeSpecName "kube-api-access-zbljk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:39:22.640518 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.640493 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-model-cache\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:39:22.640518 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.640513 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-dshm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:39:22.640518 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.640521 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc9fb11-ffee-404e-b6c9-0618f1023ad8-home\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:39:22.640692 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.640530 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc9fb11-ffee-404e-b6c9-0618f1023ad8-tls-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:39:22.640692 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.640538 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbljk\" (UniqueName: \"kubernetes.io/projected/afc9fb11-ffee-404e-b6c9-0618f1023ad8-kube-api-access-zbljk\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:39:22.930157 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.930125 2565 generic.go:356] "Generic (PLEG): container finished" podID="afc9fb11-ffee-404e-b6c9-0618f1023ad8" containerID="e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb" exitCode=0 Jul 14 10:39:22.930347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.930173 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" Jul 14 10:39:22.930347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.930215 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" event={"ID":"afc9fb11-ffee-404e-b6c9-0618f1023ad8","Type":"ContainerDied","Data":"e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb"} Jul 14 10:39:22.930347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.930254 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz" event={"ID":"afc9fb11-ffee-404e-b6c9-0618f1023ad8","Type":"ContainerDied","Data":"eedf7a91e7e48e01899732ee01aaf132403a9fc9f9b6550985b0690141d84747"} Jul 14 10:39:22.930347 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.930272 2565 scope.go:117] "RemoveContainer" containerID="e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb" Jul 14 10:39:22.938868 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.938821 2565 scope.go:117] "RemoveContainer" containerID="e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb" Jul 14 10:39:22.939108 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:39:22.939091 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb\": container with ID starting with e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb not found: ID does not exist" containerID="e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb" Jul 14 10:39:22.939162 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.939118 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb"} err="failed to get container status \"e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb\": rpc error: code = NotFound desc = could not find container \"e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb\": container with ID starting with e6e4ca4fc1fc2e9b0e54ea6aa701a1c715d966d13b6472df0d849d86ea4052cb not found: ID does not exist" Jul 14 10:39:22.951883 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.951859 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz"] Jul 14 10:39:22.954542 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:22.954522 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-684339/sub-test-model-684339-kserve-6ddd798bd9-xkmbz"] Jul 14 10:39:24.165845 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:24.165816 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afc9fb11-ffee-404e-b6c9-0618f1023ad8" path="/var/lib/kubelet/pods/afc9fb11-ffee-404e-b6c9-0618f1023ad8/volumes" Jul 14 10:39:29.274409 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:29.274372 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:29.274812 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:29.274462 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:29.287089 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:29.287071 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:29.515604 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:29.515574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:39:29.970547 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:29.970520 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:39:48.141124 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.141087 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn"] Jul 14 10:39:48.141477 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.141457 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc9fb11-ffee-404e-b6c9-0618f1023ad8" containerName="main" Jul 14 10:39:48.141477 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.141468 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc9fb11-ffee-404e-b6c9-0618f1023ad8" containerName="main" Jul 14 10:39:48.141548 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.141524 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc9fb11-ffee-404e-b6c9-0618f1023ad8" containerName="main" Jul 14 10:39:48.144224 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.144204 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.147370 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.147350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"kube-root-ca.crt\"" Jul 14 10:39:48.147500 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.147350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"openshift-service-ca.crt\"" Jul 14 10:39:48.148771 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.148739 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"rate-test-model-684339-kserve-self-signed-certs\"" Jul 14 10:39:48.148857 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.148794 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-684339\"/\"default-dockercfg-q46jq\"" Jul 14 10:39:48.156249 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.156228 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn"] Jul 14 10:39:48.183179 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.183151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:48.265381 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.265345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-home\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.265381 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.265382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tmp-dir\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.265615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.265469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-model-cache\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.265615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.265493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vx5z\" (UniqueName: \"kubernetes.io/projected/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-kube-api-access-2vx5z\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.265615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.265524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-dshm\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.265615 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.265591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tls-certs\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367016 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.366983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-model-cache\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367016 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.367016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vx5z\" (UniqueName: \"kubernetes.io/projected/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-kube-api-access-2vx5z\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.367041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-dshm\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.367081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tls-certs\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.367149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-home\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367264 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.367172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tmp-dir\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367480 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.367439 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-model-cache\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367538 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.367504 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tmp-dir\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.367596 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.367579 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-home\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.369317 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.369299 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-dshm\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.369552 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.369536 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tls-certs\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.375295 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.375273 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vx5z\" (UniqueName: \"kubernetes.io/projected/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-kube-api-access-2vx5z\") pod \"rate-test-model-684339-kserve-7cfdfb7567-5tkbn\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.453882 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.453804 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:48.582731 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:48.582701 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn"] Jul 14 10:39:48.585684 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:39:48.585656 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda21d31a5_c285_4a81_8d72_6f4ecc6d8da7.slice/crio-e34c22727049e12f8e9b88826fd0cca265db21fe4ab2568c92614f9d2ee48a97 WatchSource:0}: Error finding container e34c22727049e12f8e9b88826fd0cca265db21fe4ab2568c92614f9d2ee48a97: Status 404 returned error can't find the container with id e34c22727049e12f8e9b88826fd0cca265db21fe4ab2568c92614f9d2ee48a97 Jul 14 10:39:49.040154 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:49.040116 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" event={"ID":"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7","Type":"ContainerStarted","Data":"1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e"} Jul 14 10:39:49.040154 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:49.040157 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" event={"ID":"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7","Type":"ContainerStarted","Data":"e34c22727049e12f8e9b88826fd0cca265db21fe4ab2568c92614f9d2ee48a97"} Jul 14 10:39:49.061544 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:49.061496 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" podStartSLOduration=1.061480678 podStartE2EDuration="1.061480678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:39:49.059427651 +0000 UTC m=+2359.340635775" watchObservedRunningTime="2026-07-14 10:39:49.061480678 +0000 UTC m=+2359.342688799" Jul 14 10:39:51.063991 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:51.063957 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:51.654029 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:51.653994 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:51.755148 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:51.755119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:52.114254 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:52.114180 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:39:54.340616 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:54.340586 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:54.442199 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:54.442167 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:39:58.453993 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:58.453949 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:58.454473 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:58.454012 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:58.466370 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:58.466342 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:39:59.094897 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:39:59.094864 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:40:00.806226 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:00.806186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:00.900466 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:00.900435 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:13.530500 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:13.530469 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:13.632108 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:13.632076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:14.417184 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:14.417155 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:40:29.409486 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:29.409457 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:40:30.207493 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:30.207466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:40:30.212550 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:30.212529 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrkr_a43b79a4-508a-4578-9e30-f71adbdd3bd1/ovn-acl-logging/0.log" Jul 14 10:40:36.544408 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:36.544371 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h"] Jul 14 10:40:36.563384 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:36.563354 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:37.361926 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:37.361892 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn"] Jul 14 10:40:37.387988 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:37.387949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:38.473839 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:38.473802 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:38.866728 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:38.866639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:38.965718 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:38.965688 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:39.132322 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:39.132287 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:42.410756 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:42.410726 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:40:44.198999 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:44.198966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:40:51.564663 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.564624 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" podUID="858e6e31-34c2-4f47-b622-94d6d44a8f78" containerName="main" containerID="cri-o://a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4" gracePeriod=45 Jul 14 10:40:51.815405 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.815345 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:40:51.925686 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.925660 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/858e6e31-34c2-4f47-b622-94d6d44a8f78-tls-certs\") pod \"858e6e31-34c2-4f47-b622-94d6d44a8f78\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " Jul 14 10:40:51.925850 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.925727 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrksm\" (UniqueName: \"kubernetes.io/projected/858e6e31-34c2-4f47-b622-94d6d44a8f78-kube-api-access-lrksm\") pod \"858e6e31-34c2-4f47-b622-94d6d44a8f78\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " Jul 14 10:40:51.925850 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.925784 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-home\") pod \"858e6e31-34c2-4f47-b622-94d6d44a8f78\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " Jul 14 10:40:51.925850 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.925847 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-model-cache\") pod \"858e6e31-34c2-4f47-b622-94d6d44a8f78\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " Jul 14 10:40:51.925995 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.925877 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-dshm\") pod \"858e6e31-34c2-4f47-b622-94d6d44a8f78\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " Jul 14 10:40:51.925995 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.925906 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-tmp-dir\") pod \"858e6e31-34c2-4f47-b622-94d6d44a8f78\" (UID: \"858e6e31-34c2-4f47-b622-94d6d44a8f78\") " Jul 14 10:40:51.926100 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.926035 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-home" (OuterVolumeSpecName: "home") pod "858e6e31-34c2-4f47-b622-94d6d44a8f78" (UID: "858e6e31-34c2-4f47-b622-94d6d44a8f78"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:40:51.926200 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.926169 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-model-cache" (OuterVolumeSpecName: "model-cache") pod "858e6e31-34c2-4f47-b622-94d6d44a8f78" (UID: "858e6e31-34c2-4f47-b622-94d6d44a8f78"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:40:51.926267 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.926208 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "858e6e31-34c2-4f47-b622-94d6d44a8f78" (UID: "858e6e31-34c2-4f47-b622-94d6d44a8f78"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:40:51.926267 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.926234 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-home\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:51.927847 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.927821 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-dshm" (OuterVolumeSpecName: "dshm") pod "858e6e31-34c2-4f47-b622-94d6d44a8f78" (UID: "858e6e31-34c2-4f47-b622-94d6d44a8f78"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:40:51.927930 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.927887 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/858e6e31-34c2-4f47-b622-94d6d44a8f78-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "858e6e31-34c2-4f47-b622-94d6d44a8f78" (UID: "858e6e31-34c2-4f47-b622-94d6d44a8f78"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:40:51.927930 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:51.927911 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/858e6e31-34c2-4f47-b622-94d6d44a8f78-kube-api-access-lrksm" (OuterVolumeSpecName: "kube-api-access-lrksm") pod "858e6e31-34c2-4f47-b622-94d6d44a8f78" (UID: "858e6e31-34c2-4f47-b622-94d6d44a8f78"). InnerVolumeSpecName "kube-api-access-lrksm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:40:52.026909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.026879 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/858e6e31-34c2-4f47-b622-94d6d44a8f78-tls-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.026909 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.026908 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrksm\" (UniqueName: \"kubernetes.io/projected/858e6e31-34c2-4f47-b622-94d6d44a8f78-kube-api-access-lrksm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.027109 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.026922 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-model-cache\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.027109 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.026934 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-dshm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.027109 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.026971 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858e6e31-34c2-4f47-b622-94d6d44a8f78-tmp-dir\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.313573 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.313542 2565 generic.go:356] "Generic (PLEG): container finished" podID="858e6e31-34c2-4f47-b622-94d6d44a8f78" containerID="a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4" exitCode=0 Jul 14 10:40:52.313763 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.313582 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" Jul 14 10:40:52.313763 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.313597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" event={"ID":"858e6e31-34c2-4f47-b622-94d6d44a8f78","Type":"ContainerDied","Data":"a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4"} Jul 14 10:40:52.313763 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.313628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h" event={"ID":"858e6e31-34c2-4f47-b622-94d6d44a8f78","Type":"ContainerDied","Data":"d7622f50913c5dcbb995aa587f91b02b4991d0659680b961ed3642b81ba579aa"} Jul 14 10:40:52.313763 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.313646 2565 scope.go:117] "RemoveContainer" containerID="a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4" Jul 14 10:40:52.321884 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.321865 2565 scope.go:117] "RemoveContainer" containerID="a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4" Jul 14 10:40:52.322126 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:40:52.322104 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4\": container with ID starting with a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4 not found: ID does not exist" containerID="a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4" Jul 14 10:40:52.322171 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.322134 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4"} err="failed to get container status \"a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4\": rpc error: code = NotFound desc = could not find container \"a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4\": container with ID starting with a56a6535f3a5c50145478248d185b6f95598174ccae8a2266668e5888132d6f4 not found: ID does not exist" Jul 14 10:40:52.328844 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.328820 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h"] Jul 14 10:40:52.334938 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.334918 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/rate-test-model-817aae-kserve-d6bcbc679-p472h"] Jul 14 10:40:52.381959 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.381918 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" podUID="a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" containerName="main" containerID="cri-o://1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e" gracePeriod=45 Jul 14 10:40:52.619242 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.619220 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:40:52.732981 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.732946 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-model-cache\") pod \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " Jul 14 10:40:52.733166 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.732996 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tls-certs\") pod \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " Jul 14 10:40:52.733166 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733058 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-home\") pod \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " Jul 14 10:40:52.733166 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733077 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tmp-dir\") pod \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " Jul 14 10:40:52.733166 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733091 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-dshm\") pod \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " Jul 14 10:40:52.733380 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733173 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vx5z\" (UniqueName: \"kubernetes.io/projected/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-kube-api-access-2vx5z\") pod \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\" (UID: \"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7\") " Jul 14 10:40:52.733380 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733193 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-model-cache" (OuterVolumeSpecName: "model-cache") pod "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" (UID: "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:40:52.733380 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733369 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-home" (OuterVolumeSpecName: "home") pod "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" (UID: "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:40:52.733510 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733384 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" (UID: "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:40:52.733546 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733535 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-home\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.733579 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733556 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tmp-dir\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.733579 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.733568 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-model-cache\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.735144 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.735125 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-dshm" (OuterVolumeSpecName: "dshm") pod "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" (UID: "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:40:52.735614 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.735585 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" (UID: "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:40:52.735614 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.735598 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-kube-api-access-2vx5z" (OuterVolumeSpecName: "kube-api-access-2vx5z") pod "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" (UID: "a21d31a5-c285-4a81-8d72-6f4ecc6d8da7"). InnerVolumeSpecName "kube-api-access-2vx5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:40:52.835049 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.834960 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-dshm\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.835049 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.834991 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vx5z\" (UniqueName: \"kubernetes.io/projected/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-kube-api-access-2vx5z\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:52.835049 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:52.835001 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7-tls-certs\") on node \"ip-10-0-132-174.ec2.internal\" DevicePath \"\"" Jul 14 10:40:53.320641 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.320608 2565 generic.go:356] "Generic (PLEG): container finished" podID="a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" containerID="1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e" exitCode=0 Jul 14 10:40:53.320824 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.320649 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" Jul 14 10:40:53.320824 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.320660 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" event={"ID":"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7","Type":"ContainerDied","Data":"1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e"} Jul 14 10:40:53.320824 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.320691 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn" event={"ID":"a21d31a5-c285-4a81-8d72-6f4ecc6d8da7","Type":"ContainerDied","Data":"e34c22727049e12f8e9b88826fd0cca265db21fe4ab2568c92614f9d2ee48a97"} Jul 14 10:40:53.320824 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.320709 2565 scope.go:117] "RemoveContainer" containerID="1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e" Jul 14 10:40:53.334875 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.334849 2565 scope.go:117] "RemoveContainer" containerID="1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e" Jul 14 10:40:53.335186 ip-10-0-132-174 kubenswrapper[2565]: E0714 10:40:53.335163 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e\": container with ID starting with 1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e not found: ID does not exist" containerID="1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e" Jul 14 10:40:53.335263 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.335195 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e"} err="failed to get container status \"1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e\": rpc error: code = NotFound desc = could not find container \"1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e\": container with ID starting with 1f7badcd262e69c2fbbaee65b989c66c57ee9446ebce2a159754aa9c5ef1085e not found: ID does not exist" Jul 14 10:40:53.345547 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.345524 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn"] Jul 14 10:40:53.349245 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:53.349225 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-684339/rate-test-model-684339-kserve-7cfdfb7567-5tkbn"] Jul 14 10:40:54.165154 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:54.165121 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="858e6e31-34c2-4f47-b622-94d6d44a8f78" path="/var/lib/kubelet/pods/858e6e31-34c2-4f47-b622-94d6d44a8f78/volumes" Jul 14 10:40:54.165522 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:40:54.165506 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" path="/var/lib/kubelet/pods/a21d31a5-c285-4a81-8d72-6f4ecc6d8da7/volumes" Jul 14 10:41:21.294389 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:21.294351 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:21.565064 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:21.564972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:21.816160 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:21.816073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:21.992964 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:21.992928 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:22.387976 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:22.387940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:22.487487 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:22.487446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:22.679388 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:22.679309 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:25.606223 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:25.606190 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ssvkd"] Jul 14 10:41:28.913000 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:28.912964 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:28.973995 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:28.973965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:29.189089 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:29.188998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:29.407224 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:29.407190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:34.596115 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:34.596062 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6fthr_7ce08cf7-2fec-4a99-a91c-50d361abed7f/manager/0.log" Jul 14 10:41:35.446790 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:35.446732 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t_6ce7d66a-8939-4c2b-b213-4bb86bd0814f/copy-manifests/0.log" Jul 14 10:41:35.465927 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:35.465896 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t_6ce7d66a-8939-4c2b-b213-4bb86bd0814f/manager/0.log" Jul 14 10:41:37.475213 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:37.475184 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5zn7n_249cb629-9f48-4b34-872b-c0fca3eda4d8/kuadrant-console-plugin/0.log" Jul 14 10:41:37.874841 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:37.874756 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ssvkd_54890927-5de0-4ba8-89cd-c5c3676f991f/limitador/0.log" Jul 14 10:41:38.590947 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:38.590915 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66cfd9dd7c-9hj78_c44dce68-4bdf-4478-92e1-44604936aac3/kube-auth-proxy/0.log" Jul 14 10:41:39.927028 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:39.927000 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfvpk_b97f6121-993b-4645-a63a-e0fb67eb0f5e/main/0.log" Jul 14 10:41:40.074047 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:40.074017 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-q6s9k_39f55190-e5d1-422c-bfc6-eebb6dea451b/main/0.log" Jul 14 10:41:43.965451 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.965416 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5rfhj/must-gather-tp6d5"] Jul 14 10:41:43.965837 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.965722 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" containerName="main" Jul 14 10:41:43.965837 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.965732 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" containerName="main" Jul 14 10:41:43.965837 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.965765 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858e6e31-34c2-4f47-b622-94d6d44a8f78" containerName="main" Jul 14 10:41:43.965837 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.965771 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="858e6e31-34c2-4f47-b622-94d6d44a8f78" containerName="main" Jul 14 10:41:43.965837 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.965821 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a21d31a5-c285-4a81-8d72-6f4ecc6d8da7" containerName="main" Jul 14 10:41:43.965837 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.965829 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="858e6e31-34c2-4f47-b622-94d6d44a8f78" containerName="main" Jul 14 10:41:43.968942 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.968921 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfhj/must-gather-tp6d5" Jul 14 10:41:43.971550 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.971529 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5rfhj\"/\"kube-root-ca.crt\"" Jul 14 10:41:43.971649 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.971566 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5rfhj\"/\"openshift-service-ca.crt\"" Jul 14 10:41:43.971649 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.971575 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5rfhj\"/\"default-dockercfg-f5pxx\"" Jul 14 10:41:43.979089 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.979067 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfhj/must-gather-tp6d5"] Jul 14 10:41:43.982166 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:43.982142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:44.064280 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.064243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c9kr\" (UniqueName: \"kubernetes.io/projected/0757eec6-5cdc-4a09-adc7-25e91b4b8717-kube-api-access-2c9kr\") pod \"must-gather-tp6d5\" (UID: \"0757eec6-5cdc-4a09-adc7-25e91b4b8717\") " pod="openshift-must-gather-5rfhj/must-gather-tp6d5" Jul 14 10:41:44.064432 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.064285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0757eec6-5cdc-4a09-adc7-25e91b4b8717-must-gather-output\") pod \"must-gather-tp6d5\" (UID: \"0757eec6-5cdc-4a09-adc7-25e91b4b8717\") " pod="openshift-must-gather-5rfhj/must-gather-tp6d5" Jul 14 10:41:44.083234 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.083184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" limit=1024 Jul 14 10:41:44.164666 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.164640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c9kr\" (UniqueName: \"kubernetes.io/projected/0757eec6-5cdc-4a09-adc7-25e91b4b8717-kube-api-access-2c9kr\") pod \"must-gather-tp6d5\" (UID: \"0757eec6-5cdc-4a09-adc7-25e91b4b8717\") " pod="openshift-must-gather-5rfhj/must-gather-tp6d5" Jul 14 10:41:44.164834 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.164672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0757eec6-5cdc-4a09-adc7-25e91b4b8717-must-gather-output\") pod \"must-gather-tp6d5\" (UID: \"0757eec6-5cdc-4a09-adc7-25e91b4b8717\") " pod="openshift-must-gather-5rfhj/must-gather-tp6d5" Jul 14 10:41:44.165000 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.164982 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0757eec6-5cdc-4a09-adc7-25e91b4b8717-must-gather-output\") pod \"must-gather-tp6d5\" (UID: \"0757eec6-5cdc-4a09-adc7-25e91b4b8717\") " pod="openshift-must-gather-5rfhj/must-gather-tp6d5" Jul 14 10:41:44.175853 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.175833 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c9kr\" (UniqueName: \"kubernetes.io/projected/0757eec6-5cdc-4a09-adc7-25e91b4b8717-kube-api-access-2c9kr\") pod \"must-gather-tp6d5\" (UID: \"0757eec6-5cdc-4a09-adc7-25e91b4b8717\") " pod="openshift-must-gather-5rfhj/must-gather-tp6d5" Jul 14 10:41:44.277915 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.277834 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfhj/must-gather-tp6d5" Jul 14 10:41:44.405444 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.405421 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfhj/must-gather-tp6d5"] Jul 14 10:41:44.407243 ip-10-0-132-174 kubenswrapper[2565]: W0714 10:41:44.407219 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0757eec6_5cdc_4a09_adc7_25e91b4b8717.slice/crio-2b3ae864770e9329c7672d9a4028681ba3724a6e5f2774b7afd5bd735c8ce71e WatchSource:0}: Error finding container 2b3ae864770e9329c7672d9a4028681ba3724a6e5f2774b7afd5bd735c8ce71e: Status 404 returned error can't find the container with id 2b3ae864770e9329c7672d9a4028681ba3724a6e5f2774b7afd5bd735c8ce71e Jul 14 10:41:44.409194 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.409177 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:41:44.531206 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:44.531131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfhj/must-gather-tp6d5" event={"ID":"0757eec6-5cdc-4a09-adc7-25e91b4b8717","Type":"ContainerStarted","Data":"2b3ae864770e9329c7672d9a4028681ba3724a6e5f2774b7afd5bd735c8ce71e"} Jul 14 10:41:45.537727 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:45.537697 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfhj/must-gather-tp6d5" event={"ID":"0757eec6-5cdc-4a09-adc7-25e91b4b8717","Type":"ContainerStarted","Data":"67548c45041e58a772e0f4fdd153fa1077d58e0fc2046006b86a7652daed985e"} Jul 14 10:41:45.538092 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:45.537736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfhj/must-gather-tp6d5" event={"ID":"0757eec6-5cdc-4a09-adc7-25e91b4b8717","Type":"ContainerStarted","Data":"5ae4f19638f84b9edb51ce23202fcf5f21277e1b37a7ef3c53147014589af684"} Jul 14 10:41:45.554501 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:45.554410 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5rfhj/must-gather-tp6d5" podStartSLOduration=1.664739516 podStartE2EDuration="2.554393282s" totalImagesPullingTime="889.653766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:41:45.55307152 +0000 UTC m=+2475.834279642" watchObservedRunningTime="2026-07-14 10:41:45.554393282 +0000 UTC m=+2475.835601404" Jul 14 10:41:47.011868 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:47.011839 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xpr87_e31f1fe5-a4e5-431f-ab06-76962e254bc6/global-pull-secret-syncer/0.log" Jul 14 10:41:47.081512 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:47.081477 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-52qm2_cdbf1e40-9772-4b37-ad44-55d8fc58cc0a/konnectivity-agent/0.log" Jul 14 10:41:47.183276 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:47.183243 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-174.ec2.internal_92b85bf11686fc7c45eaff1c12525158/haproxy/0.log" Jul 14 10:41:52.194196 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:52.194145 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5zn7n_249cb629-9f48-4b34-872b-c0fca3eda4d8/kuadrant-console-plugin/0.log" Jul 14 10:41:52.463283 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:52.463205 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ssvkd_54890927-5de0-4ba8-89cd-c5c3676f991f/limitador/0.log" Jul 14 10:41:54.476980 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:54.476897 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8td6f_109f4a95-7e13-401f-8672-d1e510a5a845/kube-state-metrics/0.log" Jul 14 10:41:54.507456 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:54.507432 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8td6f_109f4a95-7e13-401f-8672-d1e510a5a845/kube-rbac-proxy-main/0.log" Jul 14 10:41:54.541465 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:54.541434 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8td6f_109f4a95-7e13-401f-8672-d1e510a5a845/kube-rbac-proxy-self/0.log" Jul 14 10:41:54.734497 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:54.734402 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-plm9f_b319cabb-d68c-40aa-83bf-7c7f7ac467a9/node-exporter/0.log" Jul 14 10:41:54.760489 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:54.760461 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-plm9f_b319cabb-d68c-40aa-83bf-7c7f7ac467a9/kube-rbac-proxy/0.log" Jul 14 10:41:54.786102 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:54.786067 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-plm9f_b319cabb-d68c-40aa-83bf-7c7f7ac467a9/init-textfile/0.log" Jul 14 10:41:54.993916 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:54.993838 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c7eb0df-beea-40ae-9450-385bf73ee4ff/prometheus/0.log" Jul 14 10:41:55.019566 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:55.019534 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c7eb0df-beea-40ae-9450-385bf73ee4ff/config-reloader/0.log" Jul 14 10:41:55.044796 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:55.044769 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c7eb0df-beea-40ae-9450-385bf73ee4ff/thanos-sidecar/0.log" Jul 14 10:41:55.068481 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:55.068459 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c7eb0df-beea-40ae-9450-385bf73ee4ff/kube-rbac-proxy-web/0.log" Jul 14 10:41:55.091064 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:55.091034 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c7eb0df-beea-40ae-9450-385bf73ee4ff/kube-rbac-proxy/0.log" Jul 14 10:41:55.113463 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:55.113436 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c7eb0df-beea-40ae-9450-385bf73ee4ff/kube-rbac-proxy-thanos/0.log" Jul 14 10:41:55.137157 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:55.137128 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c7eb0df-beea-40ae-9450-385bf73ee4ff/init-config-reloader/0.log" Jul 14 10:41:56.904097 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:56.904066 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986"] Jul 14 10:41:56.911606 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:56.911579 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:56.920092 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:56.920058 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986"] Jul 14 10:41:56.997004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:56.996671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-sys\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:56.997004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:56.996715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-proc\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:56.997004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:56.996764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xckpt\" (UniqueName: \"kubernetes.io/projected/bbd06bb2-0f49-4189-a891-2bf5964894d5-kube-api-access-xckpt\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:56.997004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:56.996817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-podres\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:56.997004 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:56.996894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-lib-modules\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.097928 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.097889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-podres\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.098218 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.098201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-lib-modules\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.098383 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.098369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-sys\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.098510 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.098485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-proc\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.098652 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.098522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xckpt\" (UniqueName: \"kubernetes.io/projected/bbd06bb2-0f49-4189-a891-2bf5964894d5-kube-api-access-xckpt\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.099015 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.098993 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-podres\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.099116 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.099098 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-proc\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.099185 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.099099 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-sys\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.099235 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.099198 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbd06bb2-0f49-4189-a891-2bf5964894d5-lib-modules\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.108649 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.108607 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xckpt\" (UniqueName: \"kubernetes.io/projected/bbd06bb2-0f49-4189-a891-2bf5964894d5-kube-api-access-xckpt\") pod \"perf-node-gather-daemonset-86986\" (UID: \"bbd06bb2-0f49-4189-a891-2bf5964894d5\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.225419 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.225329 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.419449 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.419412 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986"] Jul 14 10:41:57.612125 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.612086 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" event={"ID":"bbd06bb2-0f49-4189-a891-2bf5964894d5","Type":"ContainerStarted","Data":"84437e452a329a011e704c3f9a373e7a3bbdea758cadc8febbe051994efac0fe"} Jul 14 10:41:57.612297 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.612145 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" event={"ID":"bbd06bb2-0f49-4189-a891-2bf5964894d5","Type":"ContainerStarted","Data":"4c0c1971d650aa36c62628a4a06d6d6a7b8e10533b100541441e9f1a75a05c25"} Jul 14 10:41:57.612297 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.612211 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:41:57.631528 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.631477 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" podStartSLOduration=1.6314598679999999 podStartE2EDuration="1.631459868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:41:57.63005912 +0000 UTC m=+2487.911267253" watchObservedRunningTime="2026-07-14 10:41:57.631459868 +0000 UTC m=+2487.912667992" Jul 14 10:41:57.893950 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.893919 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-787545f464-rqv7g_3ba1af47-c987-427d-87a6-9be0a1d6d01d/console/0.log" Jul 14 10:41:57.938152 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:57.938121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-nzc7q_ca996fcc-80e5-45b2-9049-fa8ea75b1769/download-server/0.log" Jul 14 10:41:59.782979 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:59.782946 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n7cjs_1e1aaf0d-39c2-40de-aba0-cb8e92c789f2/dns/0.log" Jul 14 10:41:59.803936 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:59.803906 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n7cjs_1e1aaf0d-39c2-40de-aba0-cb8e92c789f2/kube-rbac-proxy/0.log" Jul 14 10:41:59.829912 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:41:59.829885 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59prv_66f7fe55-838d-4326-9739-d50cc4a3a5e4/dns-node-resolver/0.log" Jul 14 10:42:00.486488 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:00.486454 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-fb9857868-tx5bh_a7f68985-1af0-4c59-9b50-07038b8683ad/registry/0.log" Jul 14 10:42:00.538262 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:00.538231 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-84gh2_503f535e-db88-4ef7-a6ec-c2979b447832/node-ca/0.log" Jul 14 10:42:01.627517 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:01.627485 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66cfd9dd7c-9hj78_c44dce68-4bdf-4478-92e1-44604936aac3/kube-auth-proxy/0.log" Jul 14 10:42:02.524976 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:02.524944 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-885wv_b62573cb-3e3a-4a88-ae37-45e024be7eaa/serve-healthcheck-canary/0.log" Jul 14 10:42:03.187233 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:03.187206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-49llj_179d3e74-4f58-420f-b67e-0066dc913005/kube-rbac-proxy/0.log" Jul 14 10:42:03.210626 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:03.210598 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-49llj_179d3e74-4f58-420f-b67e-0066dc913005/exporter/0.log" Jul 14 10:42:03.235667 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:03.235634 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-49llj_179d3e74-4f58-420f-b67e-0066dc913005/extractor/0.log" Jul 14 10:42:03.629063 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:03.629034 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-86986" Jul 14 10:42:05.812400 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:05.812319 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6fthr_7ce08cf7-2fec-4a99-a91c-50d361abed7f/manager/0.log" Jul 14 10:42:06.280441 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:06.280404 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t_6ce7d66a-8939-4c2b-b213-4bb86bd0814f/manager/0.log" Jul 14 10:42:06.298251 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:06.298230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b96c8bfcf-jcw2t_6ce7d66a-8939-4c2b-b213-4bb86bd0814f/copy-manifests/0.log" Jul 14 10:42:07.412049 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:07.412005 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66cfd9dd7c-9hj78_c44dce68-4bdf-4478-92e1-44604936aac3/kube-auth-proxy/0.log" Jul 14 10:42:07.791015 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:07.790936 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-589999c949-bflhz_756962fc-82cb-475a-bfa0-63abc1b803c6/manager/0.log" Jul 14 10:42:08.925073 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:08.925036 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66cfd9dd7c-9hj78_c44dce68-4bdf-4478-92e1-44604936aac3/kube-auth-proxy/0.log" Jul 14 10:42:12.820033 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:12.819998 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tbvr9_742df99c-85ca-4497-b782-c7ff51d7738a/migrator/0.log" Jul 14 10:42:12.844411 ip-10-0-132-174 kubenswrapper[2565]: I0714 10:42:12.844385 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tbvr9_742df99c-85ca-4497-b782-c7ff51d7738a/graceful-termination/0.log"