Jul 20 19:22:30.379691 ip-10-0-135-59 systemd[1]: Starting Kubernetes Kubelet... Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.796135 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802223 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802235 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802241 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802245 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802250 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802254 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802260 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:30.857854 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802266 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802271 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802276 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802286 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802291 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802295 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802299 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802303 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802307 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802311 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802314 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802319 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802322 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802327 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802331 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802334 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802339 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802343 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802347 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802353 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:30.859992 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802357 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802363 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802368 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802373 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802390 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802396 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802400 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802405 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802409 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802413 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802417 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802422 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802428 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802433 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802437 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802442 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802446 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802450 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802454 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:30.862433 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802458 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802462 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802465 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802469 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802473 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802478 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802482 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802486 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802489 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802493 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802497 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802501 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802505 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802509 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802512 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802515 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802519 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802523 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802526 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802530 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:30.876240 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802534 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:30.867681 ip-10-0-135-59 systemd[1]: Started Kubernetes Kubelet. Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802538 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802541 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802548 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802552 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802557 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802561 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802564 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802568 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802572 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802575 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802579 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802583 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802587 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802591 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802596 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802601 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802605 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802609 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802613 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:30.878435 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802617 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802621 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802625 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802629 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802633 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802636 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802640 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802643 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802647 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802651 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802655 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802658 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.802662 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803621 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803629 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803634 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803638 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803642 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803649 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:30.879930 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803654 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803660 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803665 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803669 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803673 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803677 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803682 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803686 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803690 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803693 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803697 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803701 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803704 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803709 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803713 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803719 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803724 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803728 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803732 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:30.881166 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803735 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803739 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803743 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803746 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803750 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803754 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803758 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803762 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803766 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803770 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803773 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803777 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803781 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803785 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803789 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803792 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803796 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803800 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803805 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803808 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:30.883071 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803812 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803816 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803820 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803824 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803828 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803832 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803835 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803839 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803842 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803846 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803850 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803854 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803858 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803861 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803868 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803871 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803875 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803879 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803882 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803886 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:30.885401 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803890 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803894 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803898 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803903 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803907 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803910 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803914 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803918 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803922 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803927 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803931 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803934 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803937 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803941 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803945 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803949 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803953 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803956 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803959 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:30.886773 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803963 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803967 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803970 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803974 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803978 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803983 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803986 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803992 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803996 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.803999 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804003 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804006 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804011 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804014 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804019 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804536 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804545 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804551 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804554 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:30.887916 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804559 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804565 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804571 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804575 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804579 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804583 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804586 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804590 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804594 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804599 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804602 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804606 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804610 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804613 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804617 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804621 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804625 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804628 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804634 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:30.889227 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804637 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804643 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804647 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804650 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804654 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804658 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804661 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804665 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804669 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804673 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804677 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804680 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804684 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804688 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804693 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804696 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804700 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804703 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804707 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:30.890138 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804711 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804715 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804720 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804723 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804727 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804730 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804734 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804738 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804742 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804746 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804749 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804753 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804758 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804762 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804767 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804770 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804774 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804778 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804781 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:31.133802 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804785 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804789 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804793 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804796 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804800 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804804 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804810 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804815 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804819 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804823 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804827 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804831 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804836 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804839 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804843 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804847 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804850 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804854 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804859 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804862 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:31.153118 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804866 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804869 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804873 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804877 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804881 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804886 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804890 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804894 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804898 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804902 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804906 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804910 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804914 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804917 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804921 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804925 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804929 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.804933 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805017 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805026 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805034 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 19:22:31.153744 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805040 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805047 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805052 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805057 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805063 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805067 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805071 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805076 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805081 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805085 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805090 2561 flags.go:64] FLAG: --cgroup-root="" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805094 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805098 2561 flags.go:64] FLAG: --client-ca-file="" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805103 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805107 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805113 2561 flags.go:64] FLAG: --cluster-domain="" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805119 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805123 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805129 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805133 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805138 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805143 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805147 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 19:22:31.154403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805152 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805156 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805160 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805165 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805169 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805173 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805178 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805182 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805187 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805192 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805196 2561 flags.go:64] FLAG: --enable-server="true" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805200 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805207 2561 flags.go:64] FLAG: --event-burst="100" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805211 2561 flags.go:64] FLAG: --event-qps="50" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805216 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805220 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805225 2561 flags.go:64] FLAG: --eviction-hard="" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805230 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805234 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805238 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805243 2561 flags.go:64] FLAG: --eviction-soft="" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805247 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805251 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805255 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805259 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 19:22:31.155024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805266 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805270 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805276 2561 flags.go:64] FLAG: --feature-gates="" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805281 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805286 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805290 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805295 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805299 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805303 2561 flags.go:64] FLAG: --help="false" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805308 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805313 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805317 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805321 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805325 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805330 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805334 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805338 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805342 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805346 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805352 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805357 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805360 2561 flags.go:64] FLAG: --kube-reserved="" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805365 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805369 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 19:22:31.155737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805373 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805397 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805402 2561 flags.go:64] FLAG: --lock-file="" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805405 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805410 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805414 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805437 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805442 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805447 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805451 2561 flags.go:64] FLAG: --logging-format="text" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805457 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805462 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805466 2561 flags.go:64] FLAG: --manifest-url="" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805470 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805476 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805481 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805486 2561 flags.go:64] FLAG: --max-pods="110" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805490 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805494 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805498 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805503 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805507 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805511 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805516 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805525 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 19:22:31.156444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805529 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805534 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805538 2561 flags.go:64] FLAG: --pod-cidr="" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805543 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805550 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805554 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805559 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805563 2561 flags.go:64] FLAG: --port="10250" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805568 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805572 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02a367d20abd46d56" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805577 2561 flags.go:64] FLAG: --qos-reserved="" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805581 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805585 2561 flags.go:64] FLAG: --register-node="true" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805590 2561 flags.go:64] FLAG: --register-with-taints="" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805594 2561 flags.go:64] FLAG: --registry-burst="10" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805600 2561 flags.go:64] FLAG: --registry-qps="5" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805604 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805609 2561 flags.go:64] FLAG: --reserved-memory="" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805615 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805619 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805623 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805628 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805632 2561 flags.go:64] FLAG: --runonce="false" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805636 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805641 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 19:22:31.157185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805645 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805650 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805654 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805659 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805663 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805667 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805671 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805675 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805680 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805683 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805687 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805692 2561 flags.go:64] FLAG: --system-cgroups="" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805695 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805703 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805707 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805711 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805716 2561 flags.go:64] FLAG: --tls-min-version="" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805720 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805725 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805729 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805733 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805737 2561 flags.go:64] FLAG: --v="2" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805743 2561 flags.go:64] FLAG: --version="false" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805749 2561 flags.go:64] FLAG: --vmodule="" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805754 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 19:22:31.158004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.805761 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805950 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805956 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805960 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805965 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805970 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805975 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805979 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805983 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805987 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805990 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805994 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.805998 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806001 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806005 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806009 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806013 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806017 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806020 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806024 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:31.158782 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806028 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806032 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806037 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806040 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806044 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806048 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806052 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806057 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806061 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806066 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806069 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806075 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806082 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806086 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806090 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806093 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806098 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806102 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806105 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806109 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:31.159404 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806113 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806116 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806120 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806125 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806128 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806132 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806135 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806139 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806143 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806147 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806151 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806155 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806158 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806162 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806166 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806170 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806173 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806177 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806181 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806184 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:31.160070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806188 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806193 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806199 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806204 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806209 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806214 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806218 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806223 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806228 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806231 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806235 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806239 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806245 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806249 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806254 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806257 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806261 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806266 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806270 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:31.160701 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806274 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806277 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806281 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806285 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806289 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806293 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806298 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806302 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806305 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806309 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806313 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806317 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806321 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806325 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806330 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806334 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806338 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806343 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806347 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:31.161332 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806350 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.806354 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.806361 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.813825 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.813840 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.814826 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.814834 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814888 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814894 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814898 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814901 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814904 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814908 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814910 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814913 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:31.161970 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814916 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814919 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814922 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814925 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814928 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814931 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814934 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814936 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814939 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814942 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814945 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814947 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814950 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814959 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814963 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814966 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814968 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814971 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814974 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814977 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:31.162549 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814980 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814983 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814986 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814989 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814992 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814994 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814997 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.814999 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815002 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815005 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815008 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815010 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815013 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815016 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815018 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815021 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815023 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815026 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815029 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815032 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:31.163258 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815034 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815038 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815041 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815043 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815046 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815048 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815051 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815053 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815056 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815060 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815063 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815066 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815069 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815072 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815075 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815077 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815080 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815083 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815086 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:31.163941 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815090 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815093 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815098 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815101 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815106 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815109 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815112 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815114 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815117 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815120 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815123 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815125 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815128 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815131 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815133 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815137 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815141 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815143 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815146 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:31.164592 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815149 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815151 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815154 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815156 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815159 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815162 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815164 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815167 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815170 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815172 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815175 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815178 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815180 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.815185 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:22:31.165271 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815315 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815322 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815326 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815329 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815334 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815337 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815340 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815343 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815346 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815349 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815352 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815355 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815358 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815360 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815363 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815366 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815368 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815371 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815374 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815389 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:22:31.168125 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815394 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815398 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815401 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815404 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815406 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815409 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815412 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815414 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815419 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815422 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815425 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815428 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815431 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815435 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815438 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815441 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815445 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815448 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815451 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:22:31.168873 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815453 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815456 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815459 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815461 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815464 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815466 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815469 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815472 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815474 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815477 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815479 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815482 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815485 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815487 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815490 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815492 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815495 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815497 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815500 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815502 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:22:31.414069 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815505 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815507 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815510 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815513 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815516 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815518 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815522 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815525 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815528 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815531 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815534 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815537 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815539 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815542 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815544 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815547 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815551 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815555 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815558 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815561 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:22:31.415437 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815563 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815566 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815569 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815572 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815574 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815577 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815580 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815582 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815585 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815588 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815590 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815593 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815595 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815598 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815600 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815608 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815610 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815613 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815617 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:22:31.416070 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:30.815619 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.815625 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.815725 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.817938 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.819621 2561 server.go:1019] "Starting client certificate rotation" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.819726 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.819766 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.823197 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.824674 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.835226 2561 log.go:25] "Validated CRI v1 runtime API" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.837610 2561 log.go:25] "Validated CRI v1 image API" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.838408 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 19:22:31.416721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.841427 2561 fs.go:135] Filesystem UUIDs: map[5dfb866f-78df-4a9f-b1ec-9329b65eca60:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 feed60f2-d4bf-4797-8623-96efa19f9a4f:/dev/nvme0n1p3] Jul 20 19:22:31.417099 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.841441 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 19:22:31.417209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.846781 2561 manager.go:216] Machine: {Timestamp:2026-07-20 19:22:30.845539188 +0000 UTC m=+0.348859650 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100944 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f45df13a7a5975303981f8c564517 SystemUUID:ec2f45df-13a7-a597-5303-981f8c564517 BootID:3f1459c6-eb47-4430-864c-be940c5e582c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:da:07:b5:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:da:07:b5:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:cd:13:da:e1:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 19:22:31.417209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.846879 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 19:22:31.417209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.846952 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 19:22:31.417209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.849469 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 19:22:31.417209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.849493 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-59.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 19:22:31.417209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.850138 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 19:22:31.417209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.850148 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 19:22:31.417209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.850156 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.852501 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.853664 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.853817 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.856599 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.856724 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.856747 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.856756 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.856771 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.856780 2561 kubelet.go:398] "Adding apiserver pod source" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.856788 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.857073 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.857088 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.859550 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.861760 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.861795 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862837 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862853 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862859 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862865 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862873 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862879 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862887 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862893 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862899 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862904 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862913 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.862919 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.863610 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.863617 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.866808 2561 server.go:1268] "Started kubelet" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.866899 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.866981 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.867269 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-59.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.867347 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.867456 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.866911 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.869992 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 19:22:31.417517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.871559 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.873795 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-59.ec2.internal.18c415d3975213bb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-59.ec2.internal,UID:ip-10-0-135-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-59.ec2.internal,},FirstTimestamp:2026-07-20 19:22:30.866580411 +0000 UTC m=+0.369900872,LastTimestamp:2026-07-20 19:22:30.866580411 +0000 UTC m=+0.369900872,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-59.ec2.internal,}" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.875248 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.876280 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8czmp" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.881752 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.881764 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.881826 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.882361 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.882393 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.882400 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.882486 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.882496 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.882759 2561 factory.go:55] Registering systemd factory Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.882774 2561 factory.go:223] Registration of the systemd container factory successfully Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.883001 2561 factory.go:153] Registering CRI-O factory Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.883013 2561 factory.go:223] Registration of the crio container factory successfully Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.883059 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.883078 2561 factory.go:103] Registering Raw factory Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.883088 2561 manager.go:1196] Started watching for new ooms in manager Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.883537 2561 manager.go:349] Starting recovery of all containers Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.885278 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8czmp" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.892241 2561 manager.go:354] Recovery completed Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.896897 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.898623 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.898642 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.898652 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.898748 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.899810 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.899811 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.899867 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.899894 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.900492 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.900517 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.900529 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.901004 2561 policy_none.go:49] "None policy: Start" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.901017 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 19:22:31.418683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.901026 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.901873 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-59.ec2.internal\" not found" node="ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.902128 2561 policy_none.go:47] "Start" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.946918 2561 manager.go:337] "Starting Device Plugin manager" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.947086 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.947098 2561 server.go:87] "Starting device plugin registration server" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.947323 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.947338 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.947430 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.947504 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:30.947511 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.948049 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:30.948099 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.047749 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.048678 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.048704 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.048714 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.048739 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.055561 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.056747 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.056795 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.056819 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.056858 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.059120 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.076335 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.076353 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-59.ec2.internal\": node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.157708 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal"] Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.157781 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.159644 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.159674 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.159685 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.160839 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.160987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.161021 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.162026 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.162032 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.162050 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:31.419741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.162062 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.162076 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.162064 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.163431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.163452 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.164151 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.164170 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.164183 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.192011 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-59.ec2.internal\" not found" node="ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.196287 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-59.ec2.internal\" not found" node="ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.201630 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.283592 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de7388bb11102855ed9215e9a2981d75-config\") pod \"kube-apiserver-proxy-ip-10-0-135-59.ec2.internal\" (UID: \"de7388bb11102855ed9215e9a2981d75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.283615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dbf768402476644f7281ffb7e661ae6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"2dbf768402476644f7281ffb7e661ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.283635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dbf768402476644f7281ffb7e661ae6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"2dbf768402476644f7281ffb7e661ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.303070 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.383867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dbf768402476644f7281ffb7e661ae6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"2dbf768402476644f7281ffb7e661ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.383922 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dbf768402476644f7281ffb7e661ae6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"2dbf768402476644f7281ffb7e661ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.383963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dbf768402476644f7281ffb7e661ae6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"2dbf768402476644f7281ffb7e661ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.383989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de7388bb11102855ed9215e9a2981d75-config\") pod \"kube-apiserver-proxy-ip-10-0-135-59.ec2.internal\" (UID: \"de7388bb11102855ed9215e9a2981d75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.420832 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.384026 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de7388bb11102855ed9215e9a2981d75-config\") pod \"kube-apiserver-proxy-ip-10-0-135-59.ec2.internal\" (UID: \"de7388bb11102855ed9215e9a2981d75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.421399 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.384051 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dbf768402476644f7281ffb7e661ae6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"2dbf768402476644f7281ffb7e661ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.421399 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.404135 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.724492 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.495530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.724492 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.500112 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.724492 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.504295 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.724492 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.605808 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.724492 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.706907 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.807877 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.810363 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.819055 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.819166 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.819192 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.819208 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.858236 2561 apiserver.go:52] "Watching apiserver" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.877395 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.877810 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-7grm6","openshift-multus/multus-additional-cni-plugins-6w9b8","openshift-network-diagnostics/network-check-target-fkm5c","openshift-network-operator/iptables-alerter-c9rzt","kube-system/global-pull-secret-syncer-mwp22","kube-system/konnectivity-agent-blrqh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb","openshift-dns/node-resolver-rr8kq","openshift-multus/network-metrics-daemon-qdr9c","openshift-ovn-kubernetes/ovnkube-node-t5mhv","openshift-cluster-node-tuning-operator/tuned-lfhzx","openshift-image-registry/node-ca-xf6bb"] Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.879436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.881706 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.881817 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.881913 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.882112 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.882194 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.883595 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.883617 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.883635 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.883814 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.883903 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pnfwh\"" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.884536 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.884747 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9td5\"" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.884767 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.885323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.983737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887051 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.887140 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvmw\" (UniqueName: \"kubernetes.io/projected/e8d49b49-ee89-4945-a94f-d7c297c602af-kube-api-access-bmvmw\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-conf-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-multus-certs\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-kubelet\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be96d401-816a-4992-92e6-2b234cfb50c2-multus-daemon-config\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8d49b49-ee89-4945-a94f-d7c297c602af-iptables-alerter-script\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhkgn\" (UniqueName: \"kubernetes.io/projected/8f843349-92fe-4144-9d95-1513eb1fbf51-kube-api-access-qhkgn\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-cni-multus\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g49qb\" (UniqueName: \"kubernetes.io/projected/be96d401-816a-4992-92e6-2b234cfb50c2-kube-api-access-g49qb\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-cnibin\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.985350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-socket-dir-parent\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-system-cni-dir\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-os-release\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-cni-binary-copy\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8d49b49-ee89-4945-a94f-d7c297c602af-host-slash\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-system-cni-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-cni-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-cnibin\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-os-release\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be96d401-816a-4992-92e6-2b234cfb50c2-cni-binary-copy\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.887954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-hostroot\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-etc-kubernetes\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-k8s-cni-cncf-io\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-netns\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-cni-bin\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888150 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888179 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888279 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888316 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888779 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888853 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9nbz6\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.888943 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.889082 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 19:17:31 +0000 UTC" deadline="2028-02-01 14:29:05.655074948 +0000 UTC" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.889111 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13459h6m33.765965616s" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.889881 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.891173 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.891220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.891632 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.891703 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z9htf\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.892447 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.892458 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.892521 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.892568 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.892601 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.892682 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.892708 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.892708 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wg8m4\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.893768 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-csth2\"" Jul 20 19:22:31.986843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.893826 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.893927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.894020 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.895031 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.895411 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.896685 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal"] Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.896777 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.897708 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.897724 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.897735 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.897976 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cn7w2\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.898268 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.898299 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wfwhl\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.898385 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.898394 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.898490 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.898653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.899339 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.899429 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.899457 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.899500 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wvtpr\"" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.904918 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal"] Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.906322 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.923019 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxl52" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.930135 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxl52" Jul 20 19:22:31.987820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.983061 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/425540d6-9e74-4668-8ef0-4b2171da2f33-konnectivity-ca\") pod \"konnectivity-agent-blrqh\" (UID: \"425540d6-9e74-4668-8ef0-4b2171da2f33\") " pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6nvs\" (UniqueName: \"kubernetes.io/projected/92421977-fd0d-44fa-8044-24f942e188ff-kube-api-access-s6nvs\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-slash\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4db36442-dd48-4cb7-9423-4cdf2e72c494-tmp\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-cnibin\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-run-netns\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988839 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-cnibin\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-socket-dir-parent\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-os-release\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988978 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-socket-dir-parent\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.988977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-cni-binary-copy\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.989005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-systemd\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989077 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-os-release\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-ovn\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8f4d497-b750-433f-831d-5059f8e330ee-ovn-node-metrics-cert\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8d49b49-ee89-4945-a94f-d7c297c602af-host-slash\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-os-release\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989208 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be96d401-816a-4992-92e6-2b234cfb50c2-cni-binary-copy\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-hostroot\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989246 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8d49b49-ee89-4945-a94f-d7c297c602af-host-slash\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-etc-kubernetes\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-os-release\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989294 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-hostroot\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989305 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-etc-kubernetes\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.989952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-device-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-ovnkube-script-lib\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-k8s-cni-cncf-io\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-netns\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-cni-bin\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-k8s-cni-cncf-io\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-netns\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989523 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-systemd-units\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989536 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-cni-bin\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-ovnkube-config\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br56n\" (UniqueName: \"kubernetes.io/projected/e8f4d497-b750-433f-831d-5059f8e330ee-kube-api-access-br56n\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-multus-certs\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.991317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92421977-fd0d-44fa-8044-24f942e188ff-hosts-file\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989684 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-run-multus-certs\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-etc-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-kubernetes\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-run\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989790 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc444a4-b636-4ab5-b94f-64d04ac06517-host\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1dc444a4-b636-4ab5-b94f-64d04ac06517-serviceca\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-kubelet\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989852 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be96d401-816a-4992-92e6-2b234cfb50c2-cni-binary-copy\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989867 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-cni-binary-copy\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/425540d6-9e74-4668-8ef0-4b2171da2f33-agent-certs\") pod \"konnectivity-agent-blrqh\" (UID: \"425540d6-9e74-4668-8ef0-4b2171da2f33\") " pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989933 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-kubelet\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75mt\" (UniqueName: \"kubernetes.io/projected/347ef3ad-b233-4834-9c93-617b376eafd5-kube-api-access-g75mt\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-env-overrides\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.992432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989972 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.989991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pnph\" (UniqueName: \"kubernetes.io/projected/4db36442-dd48-4cb7-9423-4cdf2e72c494-kube-api-access-7pnph\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-kubelet-config\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8d49b49-ee89-4945-a94f-d7c297c602af-iptables-alerter-script\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-registration-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-log-socket\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-cni-netd\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysctl-d\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92421977-fd0d-44fa-8044-24f942e188ff-tmp-dir\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-cni-bin\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990299 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-modprobe-d\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.993251 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-sys\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990336 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-cni-multus\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g49qb\" (UniqueName: \"kubernetes.io/projected/be96d401-816a-4992-92e6-2b234cfb50c2-kube-api-access-g49qb\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-host\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-tuned\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-system-cni-dir\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990421 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-host-var-lib-cni-multus\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysconfig\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-var-lib-kubelet\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990486 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f843349-92fe-4144-9d95-1513eb1fbf51-system-cni-dir\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-node-log\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-system-cni-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990527 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8d49b49-ee89-4945-a94f-d7c297c602af-iptables-alerter-script\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.994152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-cni-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-cnibin\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990636 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-cni-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-socket-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990667 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-cnibin\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990669 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-system-cni-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-sys-fs\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysctl-conf\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-systemd\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvmw\" (UniqueName: \"kubernetes.io/projected/e8d49b49-ee89-4945-a94f-d7c297c602af-kube-api-access-bmvmw\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-conf-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-lib-modules\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:31.994967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg9np\" (UniqueName: \"kubernetes.io/projected/1dc444a4-b636-4ab5-b94f-64d04ac06517-kube-api-access-hg9np\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be96d401-816a-4992-92e6-2b234cfb50c2-multus-daemon-config\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhr2v\" (UniqueName: \"kubernetes.io/projected/e89fb44d-cd5a-411d-a830-97d005bda323-kube-api-access-vhr2v\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-var-lib-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.990985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.991007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-dbus\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.991021 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be96d401-816a-4992-92e6-2b234cfb50c2-multus-conf-dir\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.991042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhkgn\" (UniqueName: \"kubernetes.io/projected/8f843349-92fe-4144-9d95-1513eb1fbf51-kube-api-access-qhkgn\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.991090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-kubelet\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.991132 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f843349-92fe-4144-9d95-1513eb1fbf51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:31.996138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.991451 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be96d401-816a-4992-92e6-2b234cfb50c2-multus-daemon-config\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:31.999716 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.997931 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:31.999716 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.997953 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:31.999716 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.997968 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6wqms for pod openshift-network-diagnostics/network-check-target-fkm5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:31.999716 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:31.998063 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms podName:22bbf22a-575e-4659-99d6-81763438ebc0 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:32.498022882 +0000 UTC m=+2.001343348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6wqms" (UniqueName: "kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms") pod "network-check-target-fkm5c" (UID: "22bbf22a-575e-4659-99d6-81763438ebc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:31.999716 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:31.998117 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.001861 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhkgn\" (UniqueName: \"kubernetes.io/projected/8f843349-92fe-4144-9d95-1513eb1fbf51-kube-api-access-qhkgn\") pod \"multus-additional-cni-plugins-6w9b8\" (UID: \"8f843349-92fe-4144-9d95-1513eb1fbf51\") " pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.001885 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g49qb\" (UniqueName: \"kubernetes.io/projected/be96d401-816a-4992-92e6-2b234cfb50c2-kube-api-access-g49qb\") pod \"multus-7grm6\" (UID: \"be96d401-816a-4992-92e6-2b234cfb50c2\") " pod="openshift-multus/multus-7grm6" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.001898 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvmw\" (UniqueName: \"kubernetes.io/projected/e8d49b49-ee89-4945-a94f-d7c297c602af-kube-api-access-bmvmw\") pod \"iptables-alerter-c9rzt\" (UID: \"e8d49b49-ee89-4945-a94f-d7c297c602af\") " pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysconfig\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-var-lib-kubelet\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-node-log\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-socket-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-sys-fs\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091817 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-node-log\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091884 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-var-lib-kubelet\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysctl-conf\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091779 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysconfig\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216037 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091952 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-socket-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091972 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-systemd\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-lib-modules\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092030 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-systemd\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.092041 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysctl-conf\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.091917 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-sys-fs\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092151 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-lib-modules\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg9np\" (UniqueName: \"kubernetes.io/projected/1dc444a4-b636-4ab5-b94f-64d04ac06517-kube-api-access-hg9np\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhr2v\" (UniqueName: \"kubernetes.io/projected/e89fb44d-cd5a-411d-a830-97d005bda323-kube-api-access-vhr2v\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-var-lib-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.092300 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:32.592260945 +0000 UTC m=+2.095581412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092318 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-var-lib-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.216698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-dbus\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092403 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-kubelet\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092463 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-kubelet\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/425540d6-9e74-4668-8ef0-4b2171da2f33-konnectivity-ca\") pod \"konnectivity-agent-blrqh\" (UID: \"425540d6-9e74-4668-8ef0-4b2171da2f33\") " pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6nvs\" (UniqueName: \"kubernetes.io/projected/92421977-fd0d-44fa-8044-24f942e188ff-kube-api-access-s6nvs\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092533 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-dbus\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092563 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-slash\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092603 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-slash\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4db36442-dd48-4cb7-9423-4cdf2e72c494-tmp\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-run-netns\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092697 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092743 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-run-netns\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217338 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-systemd\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-ovn\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092801 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092849 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-ovn\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8f4d497-b750-433f-831d-5059f8e330ee-ovn-node-metrics-cert\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092850 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-run-systemd\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-device-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-ovnkube-script-lib\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-device-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.092983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.093063 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-systemd-units\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.093134 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret podName:c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd nodeName:}" failed. No retries permitted until 2026-07-20 19:22:32.593113427 +0000 UTC m=+2.096433891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret") pod "global-pull-secret-syncer-mwp22" (UID: "c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093108 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/425540d6-9e74-4668-8ef0-4b2171da2f33-konnectivity-ca\") pod \"konnectivity-agent-blrqh\" (UID: \"425540d6-9e74-4668-8ef0-4b2171da2f33\") " pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:32.217963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093153 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-systemd-units\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-ovnkube-config\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br56n\" (UniqueName: \"kubernetes.io/projected/e8f4d497-b750-433f-831d-5059f8e330ee-kube-api-access-br56n\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92421977-fd0d-44fa-8044-24f942e188ff-hosts-file\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-etc-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-kubernetes\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-run\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093379 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92421977-fd0d-44fa-8044-24f942e188ff-hosts-file\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc444a4-b636-4ab5-b94f-64d04ac06517-host\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1dc444a4-b636-4ab5-b94f-64d04ac06517-serviceca\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093468 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-kubernetes\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/425540d6-9e74-4668-8ef0-4b2171da2f33-agent-certs\") pod \"konnectivity-agent-blrqh\" (UID: \"425540d6-9e74-4668-8ef0-4b2171da2f33\") " pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093483 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-etc-openvswitch\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g75mt\" (UniqueName: \"kubernetes.io/projected/347ef3ad-b233-4834-9c93-617b376eafd5-kube-api-access-g75mt\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093547 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-run\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.218538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-env-overrides\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093573 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-ovnkube-script-lib\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pnph\" (UniqueName: \"kubernetes.io/projected/4db36442-dd48-4cb7-9423-4cdf2e72c494-kube-api-access-7pnph\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093576 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc444a4-b636-4ab5-b94f-64d04ac06517-host\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-kubelet-config\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-registration-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-log-socket\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-cni-netd\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysctl-d\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92421977-fd0d-44fa-8044-24f942e188ff-tmp-dir\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093857 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-registration-dir\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093877 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-ovnkube-config\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-cni-bin\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.093979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-cni-netd\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094014 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1dc444a4-b636-4ab5-b94f-64d04ac06517-serviceca\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094023 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-cni-bin\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094081 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094118 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-kubelet-config\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094119 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92421977-fd0d-44fa-8044-24f942e188ff-tmp-dir\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094195 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8f4d497-b750-433f-831d-5059f8e330ee-log-socket\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-modprobe-d\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094225 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-sysctl-d\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094227 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e89fb44d-cd5a-411d-a830-97d005bda323-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-sys\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-host\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094351 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8f4d497-b750-433f-831d-5059f8e330ee-env-overrides\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094370 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-host\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.219734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-sys\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-modprobe-d\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.094376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-tuned\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.095415 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4db36442-dd48-4cb7-9423-4cdf2e72c494-tmp\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.095780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8f4d497-b750-433f-831d-5059f8e330ee-ovn-node-metrics-cert\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.096302 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4db36442-dd48-4cb7-9423-4cdf2e72c494-etc-tuned\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.096927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/425540d6-9e74-4668-8ef0-4b2171da2f33-agent-certs\") pod \"konnectivity-agent-blrqh\" (UID: \"425540d6-9e74-4668-8ef0-4b2171da2f33\") " pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.101957 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhr2v\" (UniqueName: \"kubernetes.io/projected/e89fb44d-cd5a-411d-a830-97d005bda323-kube-api-access-vhr2v\") pod \"aws-ebs-csi-driver-node-xfhdb\" (UID: \"e89fb44d-cd5a-411d-a830-97d005bda323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.102022 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6nvs\" (UniqueName: \"kubernetes.io/projected/92421977-fd0d-44fa-8044-24f942e188ff-kube-api-access-s6nvs\") pod \"node-resolver-rr8kq\" (UID: \"92421977-fd0d-44fa-8044-24f942e188ff\") " pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.102124 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg9np\" (UniqueName: \"kubernetes.io/projected/1dc444a4-b636-4ab5-b94f-64d04ac06517-kube-api-access-hg9np\") pod \"node-ca-xf6bb\" (UID: \"1dc444a4-b636-4ab5-b94f-64d04ac06517\") " pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.102675 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pnph\" (UniqueName: \"kubernetes.io/projected/4db36442-dd48-4cb7-9423-4cdf2e72c494-kube-api-access-7pnph\") pod \"tuned-lfhzx\" (UID: \"4db36442-dd48-4cb7-9423-4cdf2e72c494\") " pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.103009 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75mt\" (UniqueName: \"kubernetes.io/projected/347ef3ad-b233-4834-9c93-617b376eafd5-kube-api-access-g75mt\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.103592 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br56n\" (UniqueName: \"kubernetes.io/projected/e8f4d497-b750-433f-831d-5059f8e330ee-kube-api-access-br56n\") pod \"ovnkube-node-t5mhv\" (UID: \"e8f4d497-b750-433f-831d-5059f8e330ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:32.110943 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7388bb11102855ed9215e9a2981d75.slice/crio-e6802ea20c9ab93a65680d70725ee5e17d65db2a6c4cbfcce286aaec9860d049 WatchSource:0}: Error finding container e6802ea20c9ab93a65680d70725ee5e17d65db2a6c4cbfcce286aaec9860d049: Status 404 returned error can't find the container with id e6802ea20c9ab93a65680d70725ee5e17d65db2a6c4cbfcce286aaec9860d049 Jul 20 19:22:32.220213 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:32.111141 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbf768402476644f7281ffb7e661ae6.slice/crio-4973dbb820304e7f13378cae49394852856cd354f00a122f3d9e6356d73f1dc6 WatchSource:0}: Error finding container 4973dbb820304e7f13378cae49394852856cd354f00a122f3d9e6356d73f1dc6: Status 404 returned error can't find the container with id 4973dbb820304e7f13378cae49394852856cd354f00a122f3d9e6356d73f1dc6 Jul 20 19:22:32.220771 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.116971 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:22:32.220771 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.162579 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:32.220771 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.216327 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7grm6" Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:32.225026 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe96d401_816a_4992_92e6_2b234cfb50c2.slice/crio-cb8c4905e1a9f7c99e807a80d8517b5f4e5bab67c08c9977ff946ec7394119bf WatchSource:0}: Error finding container cb8c4905e1a9f7c99e807a80d8517b5f4e5bab67c08c9977ff946ec7394119bf: Status 404 returned error can't find the container with id cb8c4905e1a9f7c99e807a80d8517b5f4e5bab67c08c9977ff946ec7394119bf Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.238502 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:32.245899 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f843349_92fe_4144_9d95_1513eb1fbf51.slice/crio-08e5fb26a6d96124d4142e85f4ef0c3d37a052f35b519c587afa174866029cde WatchSource:0}: Error finding container 08e5fb26a6d96124d4142e85f4ef0c3d37a052f35b519c587afa174866029cde: Status 404 returned error can't find the container with id 08e5fb26a6d96124d4142e85f4ef0c3d37a052f35b519c587afa174866029cde Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.256646 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c9rzt" Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.259314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:32.269992 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d49b49_ee89_4945_a94f_d7c297c602af.slice/crio-816b35990324b6a3d2c980cc93e7c9be8eab98b6fdbedcead2e0ad39657202e0 WatchSource:0}: Error finding container 816b35990324b6a3d2c980cc93e7c9be8eab98b6fdbedcead2e0ad39657202e0: Status 404 returned error can't find the container with id 816b35990324b6a3d2c980cc93e7c9be8eab98b6fdbedcead2e0ad39657202e0 Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.280198 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.307979 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rr8kq" Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:32.315162 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92421977_fd0d_44fa_8044_24f942e188ff.slice/crio-60f08059666e0f09cbdeb35a4b184236282b994b35684e3b29b19b321336562e WatchSource:0}: Error finding container 60f08059666e0f09cbdeb35a4b184236282b994b35684e3b29b19b321336562e: Status 404 returned error can't find the container with id 60f08059666e0f09cbdeb35a4b184236282b994b35684e3b29b19b321336562e Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.330182 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:22:32.336890 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f4d497_b750_433f_831d_5059f8e330ee.slice/crio-d2922a0dbccf75f1a901661124157c7d56be87903ead25be847056995563e7d9 WatchSource:0}: Error finding container d2922a0dbccf75f1a901661124157c7d56be87903ead25be847056995563e7d9: Status 404 returned error can't find the container with id d2922a0dbccf75f1a901661124157c7d56be87903ead25be847056995563e7d9 Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.346857 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xf6bb" Jul 20 19:22:32.419875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.347994 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.597246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.597299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.597334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.597416 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.597499 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.597516 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.597519 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:33.597503402 +0000 UTC m=+3.100823850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.597528 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6wqms for pod openshift-network-diagnostics/network-check-target-fkm5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.597458 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.597574 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms podName:22bbf22a-575e-4659-99d6-81763438ebc0 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:33.597560078 +0000 UTC m=+3.100880543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wqms" (UniqueName: "kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms") pod "network-check-target-fkm5c" (UID: "22bbf22a-575e-4659-99d6-81763438ebc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:32.663794 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:32.597602 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret podName:c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd nodeName:}" failed. No retries permitted until 2026-07-20 19:22:33.597586826 +0000 UTC m=+3.100907297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret") pod "global-pull-secret-syncer-mwp22" (UID: "c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:32.745029 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.744088 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:32.912054 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.898750 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:32.933360 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.931903 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:17:32 +0000 UTC" deadline="2028-03-23 12:17:43.77314236 +0000 UTC" Jul 20 19:22:32.933360 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:32.931944 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14680h55m10.841200748s" Jul 20 19:22:33.079312 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.073585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:33.079312 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.073728 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:33.079312 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.074245 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:33.079312 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.074373 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:33.079312 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.074455 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:33.079312 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.074561 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:33.142861 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.092423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" event={"ID":"8f843349-92fe-4144-9d95-1513eb1fbf51","Type":"ContainerStarted","Data":"08e5fb26a6d96124d4142e85f4ef0c3d37a052f35b519c587afa174866029cde"} Jul 20 19:22:33.142861 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.109817 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" event={"ID":"de7388bb11102855ed9215e9a2981d75","Type":"ContainerStarted","Data":"e6802ea20c9ab93a65680d70725ee5e17d65db2a6c4cbfcce286aaec9860d049"} Jul 20 19:22:33.142861 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.137426 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" event={"ID":"4db36442-dd48-4cb7-9423-4cdf2e72c494","Type":"ContainerStarted","Data":"b41c5c781f7f91edf90d6db41b30d97d2522193d687b26dc3f7bbc2ba267c4b2"} Jul 20 19:22:33.154234 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.152411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xf6bb" event={"ID":"1dc444a4-b636-4ab5-b94f-64d04ac06517","Type":"ContainerStarted","Data":"6eef6571b9f49f2469debe2f6cb5b7282b92d42ce72543eaddd4816df49479f1"} Jul 20 19:22:33.168013 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.163224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"d2922a0dbccf75f1a901661124157c7d56be87903ead25be847056995563e7d9"} Jul 20 19:22:33.173544 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.170496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rr8kq" event={"ID":"92421977-fd0d-44fa-8044-24f942e188ff","Type":"ContainerStarted","Data":"60f08059666e0f09cbdeb35a4b184236282b994b35684e3b29b19b321336562e"} Jul 20 19:22:33.232763 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.177557 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7grm6" event={"ID":"be96d401-816a-4992-92e6-2b234cfb50c2","Type":"ContainerStarted","Data":"cb8c4905e1a9f7c99e807a80d8517b5f4e5bab67c08c9977ff946ec7394119bf"} Jul 20 19:22:33.232763 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.199593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" event={"ID":"2dbf768402476644f7281ffb7e661ae6","Type":"ContainerStarted","Data":"4973dbb820304e7f13378cae49394852856cd354f00a122f3d9e6356d73f1dc6"} Jul 20 19:22:33.232763 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.205681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" event={"ID":"e89fb44d-cd5a-411d-a830-97d005bda323","Type":"ContainerStarted","Data":"eb2d76bec62328278198e51b3f2be9ec9ff5fe0a975cc55cdf9b8c4816731e3f"} Jul 20 19:22:33.232763 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.225676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-blrqh" event={"ID":"425540d6-9e74-4668-8ef0-4b2171da2f33","Type":"ContainerStarted","Data":"f4b4c5ee11125d7dbe282925e4a7c7db9fc5ed3279e174f34cf8ac7774c39339"} Jul 20 19:22:33.232763 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.231586 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c9rzt" event={"ID":"e8d49b49-ee89-4945-a94f-d7c297c602af","Type":"ContainerStarted","Data":"816b35990324b6a3d2c980cc93e7c9be8eab98b6fdbedcead2e0ad39657202e0"} Jul 20 19:22:33.605926 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.605838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:33.605926 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.605899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:33.606158 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.605958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:33.606158 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.606107 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:33.606257 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.606172 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:35.606150152 +0000 UTC m=+5.109470604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:33.606333 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.606270 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:33.606333 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.606285 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:33.606333 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.606298 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6wqms for pod openshift-network-diagnostics/network-check-target-fkm5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:33.606509 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.606343 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms podName:22bbf22a-575e-4659-99d6-81763438ebc0 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:35.606328465 +0000 UTC m=+5.109648915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wqms" (UniqueName: "kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms") pod "network-check-target-fkm5c" (UID: "22bbf22a-575e-4659-99d6-81763438ebc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:33.606509 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.606405 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:33.606509 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:33.606438 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret podName:c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd nodeName:}" failed. No retries permitted until 2026-07-20 19:22:35.606426278 +0000 UTC m=+5.109746729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret") pod "global-pull-secret-syncer-mwp22" (UID: "c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:33.933275 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.933125 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:17:32 +0000 UTC" deadline="2027-12-27 04:06:59.088081996 +0000 UTC" Jul 20 19:22:33.933275 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:33.933185 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12584h44m25.154900604s" Jul 20 19:22:34.504809 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:34.504700 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:22:35.058592 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:35.058560 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:35.058807 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.058779 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:35.059237 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:35.059216 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:35.059344 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.059323 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:35.059403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:35.059385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:35.059515 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.059494 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:35.624408 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:35.624006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:35.624408 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:35.624065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:35.624408 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:35.624123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:35.624408 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.624270 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:35.624408 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.624336 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:39.624315366 +0000 UTC m=+9.127635819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:35.625074 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.624809 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:35.625074 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.624830 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:35.625074 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.624842 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6wqms for pod openshift-network-diagnostics/network-check-target-fkm5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:35.625074 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.624892 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms podName:22bbf22a-575e-4659-99d6-81763438ebc0 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:39.624873696 +0000 UTC m=+9.128194147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wqms" (UniqueName: "kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms") pod "network-check-target-fkm5c" (UID: "22bbf22a-575e-4659-99d6-81763438ebc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:35.625074 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.624983 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:35.625074 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:35.625024 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret podName:c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd nodeName:}" failed. No retries permitted until 2026-07-20 19:22:39.625009783 +0000 UTC m=+9.128330232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret") pod "global-pull-secret-syncer-mwp22" (UID: "c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:37.059566 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:37.058663 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:37.059566 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:37.058805 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:37.059566 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:37.059228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:37.059566 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:37.059330 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:37.059566 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:37.059407 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:37.059566 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:37.059527 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:39.057766 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:39.057699 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:39.058215 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:39.057705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:39.058215 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.057866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:39.058215 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:39.057903 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:39.058215 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.058003 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:39.058215 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.058086 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:39.659601 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:39.659569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:39.659751 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:39.659633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:39.659751 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:39.659671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:39.659856 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.659815 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:39.659904 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.659874 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret podName:c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd nodeName:}" failed. No retries permitted until 2026-07-20 19:22:47.659854597 +0000 UTC m=+17.163175061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret") pod "global-pull-secret-syncer-mwp22" (UID: "c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:39.660123 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.660103 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:39.660176 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.660124 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:39.660224 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.660195 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:47.660175119 +0000 UTC m=+17.163495569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:39.660224 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.660130 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:39.660224 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.660215 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6wqms for pod openshift-network-diagnostics/network-check-target-fkm5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:39.660332 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:39.660255 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms podName:22bbf22a-575e-4659-99d6-81763438ebc0 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:47.660243002 +0000 UTC m=+17.163563472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wqms" (UniqueName: "kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms") pod "network-check-target-fkm5c" (UID: "22bbf22a-575e-4659-99d6-81763438ebc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:41.062409 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:41.062102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:41.062409 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:41.062135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:41.062409 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:41.062272 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:41.062918 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:41.062813 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:41.062918 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:41.062895 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:41.063021 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:41.062990 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:43.057254 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:43.057219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:43.057744 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:43.057221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:43.057744 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:43.057340 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:43.057744 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:43.057346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:43.057744 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:43.057458 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:43.057744 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:43.057546 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:45.060226 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:45.060194 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:45.060226 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:45.060224 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:45.060646 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:45.060228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:45.060646 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:45.060325 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:45.060646 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:45.060408 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:45.060646 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:45.060468 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:47.059812 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:47.059784 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:47.059812 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:47.059804 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:47.060320 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:47.059781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:47.060320 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.059890 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:47.060320 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.059984 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:47.060320 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.060068 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:47.719543 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:47.719322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:47.719761 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:47.719571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:47.719761 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:47.719598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:47.719761 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.719501 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:47.719761 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.719669 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:03.719648225 +0000 UTC m=+33.222968681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:22:47.719761 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.719709 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:22:47.719761 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.719718 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:47.719761 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.719725 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:22:47.719761 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.719737 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6wqms for pod openshift-network-diagnostics/network-check-target-fkm5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:47.720088 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.719787 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret podName:c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd nodeName:}" failed. No retries permitted until 2026-07-20 19:23:03.719759874 +0000 UTC m=+33.223080338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret") pod "global-pull-secret-syncer-mwp22" (UID: "c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:22:47.720088 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:47.719803 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms podName:22bbf22a-575e-4659-99d6-81763438ebc0 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:03.719794463 +0000 UTC m=+33.223114909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wqms" (UniqueName: "kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms") pod "network-check-target-fkm5c" (UID: "22bbf22a-575e-4659-99d6-81763438ebc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:22:49.057920 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:49.057886 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:49.058373 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:49.057930 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:49.058373 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:49.057896 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:49.058373 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:49.058023 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:49.058373 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:49.058102 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:49.058373 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:49.058221 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:51.058812 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:51.058780 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:51.059256 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:51.058886 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:51.059256 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:51.058900 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:51.059256 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:51.058936 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:51.059256 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:51.059031 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:51.059256 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:51.059147 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:53.058025 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.057942 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:53.058457 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:53.058089 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:53.058561 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.058540 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:53.058662 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:53.058634 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:53.059198 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.058944 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:53.059198 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:53.059052 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:53.275961 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.275884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" event={"ID":"de7388bb11102855ed9215e9a2981d75","Type":"ContainerStarted","Data":"1198bb52b2dab9e5426ee308957239751490d9754afa698d3e21a63489ae526f"} Jul 20 19:22:53.277212 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.277187 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" event={"ID":"4db36442-dd48-4cb7-9423-4cdf2e72c494","Type":"ContainerStarted","Data":"473d1fd9719780f385f11cee87ca9dca325d39cb80b63df4827871be94551fbe"} Jul 20 19:22:53.278581 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.278560 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7grm6" event={"ID":"be96d401-816a-4992-92e6-2b234cfb50c2","Type":"ContainerStarted","Data":"f9941a72684b226bf977d363bcb41d52045532f3ca0067db7f58f0dac279c312"} Jul 20 19:22:53.310293 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.310253 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" podStartSLOduration=21.31023934 podStartE2EDuration="21.31023934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:53.293176058 +0000 UTC m=+22.796496528" watchObservedRunningTime="2026-07-20 19:22:53.31023934 +0000 UTC m=+22.813559809" Jul 20 19:22:53.310670 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.310642 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lfhzx" podStartSLOduration=1.8888194029999998 podStartE2EDuration="22.310634154s" totalImagesPullingTime="20.421814751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:53.310174762 +0000 UTC m=+22.813495231" watchObservedRunningTime="2026-07-20 19:22:53.310634154 +0000 UTC m=+22.813954623" Jul 20 19:22:53.328741 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:53.328690 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7grm6" podStartSLOduration=1.569617544 podStartE2EDuration="22.328674275s" totalImagesPullingTime="20.759056731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:53.328149573 +0000 UTC m=+22.831470047" watchObservedRunningTime="2026-07-20 19:22:53.328674275 +0000 UTC m=+22.831994744" Jul 20 19:22:54.282371 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.281970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" event={"ID":"e89fb44d-cd5a-411d-a830-97d005bda323","Type":"ContainerStarted","Data":"8512a3c6535b2f9de2f261f4109fedba9294bc73f1ba00d4978d7b5b90417134"} Jul 20 19:22:54.283550 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.283528 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-blrqh" event={"ID":"425540d6-9e74-4668-8ef0-4b2171da2f33","Type":"ContainerStarted","Data":"03f4e193e7b0ee00945e099243562ce4802880eb0f291b325013cb70c77d67c2"} Jul 20 19:22:54.284936 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.284918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c9rzt" event={"ID":"e8d49b49-ee89-4945-a94f-d7c297c602af","Type":"ContainerStarted","Data":"0ffe9ec9e86590055b6dd76a9c94eb075162dedb73afaa3efd4afbb4265eb4a2"} Jul 20 19:22:54.286241 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.286219 2561 generic.go:356] "Generic (PLEG): container finished" podID="8f843349-92fe-4144-9d95-1513eb1fbf51" containerID="1ca70ebadb14f62fb8f48e666fcccbf60b82be73b5985d805f9d875c61f98604" exitCode=0 Jul 20 19:22:54.286320 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.286298 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" event={"ID":"8f843349-92fe-4144-9d95-1513eb1fbf51","Type":"ContainerDied","Data":"1ca70ebadb14f62fb8f48e666fcccbf60b82be73b5985d805f9d875c61f98604"} Jul 20 19:22:54.287638 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.287567 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xf6bb" event={"ID":"1dc444a4-b636-4ab5-b94f-64d04ac06517","Type":"ContainerStarted","Data":"9162c10d57b01660279b69a32640f55cf677a8f23c509bcb20279b0609301388"} Jul 20 19:22:54.290257 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.290241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:22:54.290546 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.290528 2561 generic.go:356] "Generic (PLEG): container finished" podID="e8f4d497-b750-433f-831d-5059f8e330ee" containerID="31d3114cc3c6110f3ca7d77756e7bdfd90673b1fea1ac66d4c41deb0b45bd79e" exitCode=1 Jul 20 19:22:54.290608 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.290593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"f7ff0993edbe49a332cc332c3f3546142d26fbd41789c839c31bfaaba7795280"} Jul 20 19:22:54.290659 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.290647 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"bbc111120365b88a4409ea1a6141e131f94eca833f8e3f8822d2de015c59ce14"} Jul 20 19:22:54.290704 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.290689 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"f20978ef5dff24cd6cdc73cf2769793232fdfa1c3ca1c7c5278b3ff02960817c"} Jul 20 19:22:54.290745 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.290724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerDied","Data":"31d3114cc3c6110f3ca7d77756e7bdfd90673b1fea1ac66d4c41deb0b45bd79e"} Jul 20 19:22:54.290799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.290765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"8f3f2f644df3cb6c53b617bc49bbde2817ffe5240c44d63223bb5f3d486ee83c"} Jul 20 19:22:54.291979 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.291957 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rr8kq" event={"ID":"92421977-fd0d-44fa-8044-24f942e188ff","Type":"ContainerStarted","Data":"6f49762c8732274a2a882f8356d9ee4708876a0aeee6cdae26c4f671e715a635"} Jul 20 19:22:54.293672 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.293652 2561 generic.go:356] "Generic (PLEG): container finished" podID="2dbf768402476644f7281ffb7e661ae6" containerID="9439bc564490f769098b64959f264b17cda68a01b1e5b5ab58243e37b4334d56" exitCode=0 Jul 20 19:22:54.293767 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.293676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" event={"ID":"2dbf768402476644f7281ffb7e661ae6","Type":"ContainerDied","Data":"9439bc564490f769098b64959f264b17cda68a01b1e5b5ab58243e37b4334d56"} Jul 20 19:22:54.298882 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.298829 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-blrqh" podStartSLOduration=7.013738467 podStartE2EDuration="23.298815357s" totalImagesPullingTime="16.28507689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:54.298247104 +0000 UTC m=+23.801567595" watchObservedRunningTime="2026-07-20 19:22:54.298815357 +0000 UTC m=+23.802135825" Jul 20 19:22:54.313143 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.313109 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rr8kq" podStartSLOduration=2.842514045 podStartE2EDuration="23.313097754s" totalImagesPullingTime="20.470583709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:54.312997459 +0000 UTC m=+23.816317928" watchObservedRunningTime="2026-07-20 19:22:54.313097754 +0000 UTC m=+23.816418223" Jul 20 19:22:54.331568 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.331476 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xf6bb" podStartSLOduration=7.136922054 podStartE2EDuration="23.331464271s" totalImagesPullingTime="16.194542217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:54.330975893 +0000 UTC m=+23.834296387" watchObservedRunningTime="2026-07-20 19:22:54.331464271 +0000 UTC m=+23.834784740" Jul 20 19:22:54.384478 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.384428 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c9rzt" podStartSLOduration=2.875042378 podStartE2EDuration="23.384406785s" totalImagesPullingTime="20.509364407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:54.38359928 +0000 UTC m=+23.886919748" watchObservedRunningTime="2026-07-20 19:22:54.384406785 +0000 UTC m=+23.887727254" Jul 20 19:22:54.522327 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.522296 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:54.601751 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.601669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:54.659392 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.659350 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:54.750451 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.750424 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:54.751016 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:54.750999 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:55.057429 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.057399 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:55.057670 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.057399 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:55.057670 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.057449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:55.057670 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:55.057537 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:55.057670 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:55.057635 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:55.057845 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:55.057723 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:55.211934 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.211881 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 19:22:55.299118 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.299093 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:22:55.299599 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.299516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"cb05e9b74a9088cd4768824f97142f462a724d516931779f6fc8373542e5b4fa"} Jul 20 19:22:55.301408 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.301340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" event={"ID":"2dbf768402476644f7281ffb7e661ae6","Type":"ContainerStarted","Data":"7890cb040f8fb2883c28a0cb02ef1b0f3a18e6cd7d8d7048fcac0dcaa7f651fa"} Jul 20 19:22:55.303423 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.303397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" event={"ID":"e89fb44d-cd5a-411d-a830-97d005bda323","Type":"ContainerStarted","Data":"c1b15aee66a21a1806f23e2704519962b1b3b7e5848e24b5fa2dffa87600d498"} Jul 20 19:22:55.303776 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.303757 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:55.304192 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.304176 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-blrqh" Jul 20 19:22:55.317217 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.317147 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" podStartSLOduration=23.317135227 podStartE2EDuration="23.317135227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:55.316767973 +0000 UTC m=+24.820088466" watchObservedRunningTime="2026-07-20 19:22:55.317135227 +0000 UTC m=+24.820455695" Jul 20 19:22:55.379608 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.379581 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:55.964396 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.964283 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:22:55.211902244Z","UUID":"990d9cf6-a804-4f43-8f3d-ab6fa0509532","Handler":null,"Name":"","Endpoint":""} Jul 20 19:22:55.966024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.966003 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 19:22:55.966182 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:55.966051 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 19:22:57.057685 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:57.057653 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:57.058132 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:57.057656 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:57.058132 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:57.057773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:57.058132 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:57.057774 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:57.058132 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:57.057866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:57.058132 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:57.057945 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:57.310961 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:57.310893 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:22:57.311359 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:57.311332 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"049ffd42506a8f0ad1fc07851c36418c7f0e521ef6a63b9f4bafd1a2bb31e954"} Jul 20 19:22:57.313649 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:57.313627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" event={"ID":"e89fb44d-cd5a-411d-a830-97d005bda323","Type":"ContainerStarted","Data":"e3e1944a1c48aa9623d76bd245d5628aa6dcc40f2f784395b7aeaeec5c0defd8"} Jul 20 19:22:57.334370 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:57.334329 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfhdb" podStartSLOduration=3.640660541 podStartE2EDuration="26.33431644s" totalImagesPullingTime="22.693655899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:57.334044908 +0000 UTC m=+26.837365361" watchObservedRunningTime="2026-07-20 19:22:57.33431644 +0000 UTC m=+26.837636909" Jul 20 19:22:59.058086 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.057886 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:22:59.058871 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.057897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:22:59.058871 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:59.058162 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:22:59.058871 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.057950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:22:59.058871 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:59.058236 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:22:59.058871 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:22:59.058319 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:22:59.175398 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.175324 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:59.231390 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.231355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:22:59.321210 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.321002 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:22:59.321585 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.321566 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"fa2a3f4e3c6b42a9ddca6f7197284130c01c67959441f09755a394203581fa7b"} Jul 20 19:22:59.321831 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.321802 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:59.321978 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.321962 2561 scope.go:117] "RemoveContainer" containerID="31d3114cc3c6110f3ca7d77756e7bdfd90673b1fea1ac66d4c41deb0b45bd79e" Jul 20 19:22:59.323555 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.323536 2561 generic.go:356] "Generic (PLEG): container finished" podID="8f843349-92fe-4144-9d95-1513eb1fbf51" containerID="05ac2aa9fa0b3fde5c9a5d66cd45ef34564996f8026dfdee2b38e5e121da8b72" exitCode=0 Jul 20 19:22:59.323637 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.323568 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" event={"ID":"8f843349-92fe-4144-9d95-1513eb1fbf51","Type":"ContainerDied","Data":"05ac2aa9fa0b3fde5c9a5d66cd45ef34564996f8026dfdee2b38e5e121da8b72"} Jul 20 19:22:59.338430 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.338409 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:22:59.395604 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:22:59.395584 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:23:00.330917 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.330890 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:23:00.331485 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.331364 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" event={"ID":"e8f4d497-b750-433f-831d-5059f8e330ee","Type":"ContainerStarted","Data":"a8af83c5d9ed580a4e78e6f979bcfe79fdcbec7ce9f9e4a5b8bf5f4dda78c50c"} Jul 20 19:23:00.331770 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.331747 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:23:00.348744 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.348725 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:23:00.366963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.366918 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" podStartSLOduration=8.285716387 podStartE2EDuration="29.366904327s" totalImagesPullingTime="21.08118794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:00.366670924 +0000 UTC m=+29.869991393" watchObservedRunningTime="2026-07-20 19:23:00.366904327 +0000 UTC m=+29.870224813" Jul 20 19:23:00.500697 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.500669 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mwp22"] Jul 20 19:23:00.500850 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.500792 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:00.500920 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:00.500900 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:23:00.504293 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.504267 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qdr9c"] Jul 20 19:23:00.504411 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.504394 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:23:00.504526 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:00.504504 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:23:00.504950 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.504931 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fkm5c"] Jul 20 19:23:00.505019 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:00.505008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:00.505097 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:00.505082 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:23:01.335693 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:01.335657 2561 generic.go:356] "Generic (PLEG): container finished" podID="8f843349-92fe-4144-9d95-1513eb1fbf51" containerID="4a90be650a28f4455e4b5deff82731aee2626a83c850bf80bf09ba4943c781df" exitCode=0 Jul 20 19:23:01.336097 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:01.335744 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" event={"ID":"8f843349-92fe-4144-9d95-1513eb1fbf51","Type":"ContainerDied","Data":"4a90be650a28f4455e4b5deff82731aee2626a83c850bf80bf09ba4943c781df"} Jul 20 19:23:02.057245 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:02.057214 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:23:02.057425 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:02.057325 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:23:02.057425 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:02.057229 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:02.057425 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:02.057220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:02.057425 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:02.057413 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:23:02.057610 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:02.057495 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:23:03.343144 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:03.342975 2561 generic.go:356] "Generic (PLEG): container finished" podID="8f843349-92fe-4144-9d95-1513eb1fbf51" containerID="543657a2cb480de37a3d65ed1b6d5527b3088e13f86b40a33110f4c7a563dcdd" exitCode=0 Jul 20 19:23:03.343483 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:03.343054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" event={"ID":"8f843349-92fe-4144-9d95-1513eb1fbf51","Type":"ContainerDied","Data":"543657a2cb480de37a3d65ed1b6d5527b3088e13f86b40a33110f4c7a563dcdd"} Jul 20 19:23:03.741411 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:03.741361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:03.741601 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:03.741423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:03.741601 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:03.741475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:23:03.741601 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:03.741527 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:23:03.741601 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:03.741575 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:23:03.741601 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:03.741590 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret podName:c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd nodeName:}" failed. No retries permitted until 2026-07-20 19:23:35.741573417 +0000 UTC m=+65.244893867 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret") pod "global-pull-secret-syncer-mwp22" (UID: "c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:23:03.741601 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:03.741590 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:23:03.741601 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:03.741606 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:23:03.741853 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:03.741616 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6wqms for pod openshift-network-diagnostics/network-check-target-fkm5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:23:03.741853 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:03.741619 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:35.741604626 +0000 UTC m=+65.244925073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:23:03.741853 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:03.741649 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms podName:22bbf22a-575e-4659-99d6-81763438ebc0 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:35.741639478 +0000 UTC m=+65.244959926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wqms" (UniqueName: "kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms") pod "network-check-target-fkm5c" (UID: "22bbf22a-575e-4659-99d6-81763438ebc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:23:04.058027 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:04.057952 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:23:04.058195 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:04.058079 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:04.058195 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:04.058092 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:04.058195 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:04.058085 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:23:04.058195 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:04.058178 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:23:04.058409 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:04.058271 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:23:06.057799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:06.057767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:06.057799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:06.057785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:23:06.058433 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:06.057767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:06.058433 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:06.057884 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwp22" podUID="c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd" Jul 20 19:23:06.058433 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:06.057980 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fkm5c" podUID="22bbf22a-575e-4659-99d6-81763438ebc0" Jul 20 19:23:06.058433 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:06.058074 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:23:07.274519 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.274492 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeReady" Jul 20 19:23:07.274949 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.274636 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 19:23:07.319806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.319776 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gx9kq"] Jul 20 19:23:07.332070 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.332045 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-52l2f"] Jul 20 19:23:07.332258 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.332159 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.335207 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.335125 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bsgbb\"" Jul 20 19:23:07.335530 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.335489 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 19:23:07.337039 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.335630 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 19:23:07.354236 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.354219 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gx9kq"] Jul 20 19:23:07.354324 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.354247 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-52l2f"] Jul 20 19:23:07.354324 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.354316 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-52l2f" Jul 20 19:23:07.357080 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.357063 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 19:23:07.357779 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.357759 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-46bg7\"" Jul 20 19:23:07.357866 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.357790 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 19:23:07.358736 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.358717 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 19:23:07.391427 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.391403 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:07.467581 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.467560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dcf41659-6793-4414-bf04-d1f36705dd5b-config-volume\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.467694 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.467594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76v9f\" (UniqueName: \"kubernetes.io/projected/d49e6096-7f16-441f-9604-cd0e7e67452d-kube-api-access-76v9f\") pod \"ingress-canary-52l2f\" (UID: \"d49e6096-7f16-441f-9604-cd0e7e67452d\") " pod="openshift-ingress-canary/ingress-canary-52l2f" Jul 20 19:23:07.467694 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.467626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.467694 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.467680 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcf41659-6793-4414-bf04-d1f36705dd5b-tmp-dir\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.467820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.467754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d49e6096-7f16-441f-9604-cd0e7e67452d-cert\") pod \"ingress-canary-52l2f\" (UID: \"d49e6096-7f16-441f-9604-cd0e7e67452d\") " pod="openshift-ingress-canary/ingress-canary-52l2f" Jul 20 19:23:07.467820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.467777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7jtq\" (UniqueName: \"kubernetes.io/projected/dcf41659-6793-4414-bf04-d1f36705dd5b-kube-api-access-f7jtq\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.492149 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.492130 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:07.568467 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.568416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76v9f\" (UniqueName: \"kubernetes.io/projected/d49e6096-7f16-441f-9604-cd0e7e67452d-kube-api-access-76v9f\") pod \"ingress-canary-52l2f\" (UID: \"d49e6096-7f16-441f-9604-cd0e7e67452d\") " pod="openshift-ingress-canary/ingress-canary-52l2f" Jul 20 19:23:07.568467 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.568457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.568608 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.568475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcf41659-6793-4414-bf04-d1f36705dd5b-tmp-dir\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.568608 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.568497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d49e6096-7f16-441f-9604-cd0e7e67452d-cert\") pod \"ingress-canary-52l2f\" (UID: \"d49e6096-7f16-441f-9604-cd0e7e67452d\") " pod="openshift-ingress-canary/ingress-canary-52l2f" Jul 20 19:23:07.568608 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.568514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7jtq\" (UniqueName: \"kubernetes.io/projected/dcf41659-6793-4414-bf04-d1f36705dd5b-kube-api-access-f7jtq\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.568608 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.568553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dcf41659-6793-4414-bf04-d1f36705dd5b-config-volume\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.568608 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:07.568560 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:07.568783 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:07.568629 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:23:08.068607196 +0000 UTC m=+37.571927645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:23:07.568783 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.568746 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcf41659-6793-4414-bf04-d1f36705dd5b-tmp-dir\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.569254 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.569238 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dcf41659-6793-4414-bf04-d1f36705dd5b-config-volume\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.572857 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.572838 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d49e6096-7f16-441f-9604-cd0e7e67452d-cert\") pod \"ingress-canary-52l2f\" (UID: \"d49e6096-7f16-441f-9604-cd0e7e67452d\") " pod="openshift-ingress-canary/ingress-canary-52l2f" Jul 20 19:23:07.577690 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.577669 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7jtq\" (UniqueName: \"kubernetes.io/projected/dcf41659-6793-4414-bf04-d1f36705dd5b-kube-api-access-f7jtq\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:07.578028 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.578012 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76v9f\" (UniqueName: \"kubernetes.io/projected/d49e6096-7f16-441f-9604-cd0e7e67452d-kube-api-access-76v9f\") pod \"ingress-canary-52l2f\" (UID: \"d49e6096-7f16-441f-9604-cd0e7e67452d\") " pod="openshift-ingress-canary/ingress-canary-52l2f" Jul 20 19:23:07.662086 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.662065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-52l2f" Jul 20 19:23:07.869063 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:07.868819 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-52l2f"] Jul 20 19:23:07.871667 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:23:07.871640 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49e6096_7f16_441f_9604_cd0e7e67452d.slice/crio-d6e514439221a5cf0a7aff871ca41cc36fa57b13717c60230f619b7d6ed7ce71 WatchSource:0}: Error finding container d6e514439221a5cf0a7aff871ca41cc36fa57b13717c60230f619b7d6ed7ce71: Status 404 returned error can't find the container with id d6e514439221a5cf0a7aff871ca41cc36fa57b13717c60230f619b7d6ed7ce71 Jul 20 19:23:08.057131 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.057100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:23:08.057131 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.057129 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:08.057282 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.057131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:08.060734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.060708 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:23:08.060862 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.060749 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:23:08.060862 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.060783 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:23:08.060862 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.060790 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:23:08.061025 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.061010 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ctrm\"" Jul 20 19:23:08.061126 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.061108 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gzsbm\"" Jul 20 19:23:08.072272 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.072254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:08.072368 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:08.072355 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:08.072433 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:08.072427 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:23:09.072413906 +0000 UTC m=+38.575734366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:23:08.356656 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.356620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-52l2f" event={"ID":"d49e6096-7f16-441f-9604-cd0e7e67452d","Type":"ContainerStarted","Data":"d6e514439221a5cf0a7aff871ca41cc36fa57b13717c60230f619b7d6ed7ce71"} Jul 20 19:23:08.359667 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.359636 2561 generic.go:356] "Generic (PLEG): container finished" podID="8f843349-92fe-4144-9d95-1513eb1fbf51" containerID="ebc208101c81371a422acdbf7bc026c5eaf3d3025ac5541983ed5b78bcdd6e13" exitCode=0 Jul 20 19:23:08.359799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.359692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" event={"ID":"8f843349-92fe-4144-9d95-1513eb1fbf51","Type":"ContainerDied","Data":"ebc208101c81371a422acdbf7bc026c5eaf3d3025ac5541983ed5b78bcdd6e13"} Jul 20 19:23:08.471706 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.471674 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:08.534085 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:08.534053 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:09.079255 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:09.079220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:09.079424 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:09.079399 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:09.079480 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:09.079466 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:23:11.079442968 +0000 UTC m=+40.582763417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:23:09.366587 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:09.366503 2561 generic.go:356] "Generic (PLEG): container finished" podID="8f843349-92fe-4144-9d95-1513eb1fbf51" containerID="52a24b3d7932396a8705f0f21de1c36deee40bece06d1b5d026272103de5a20d" exitCode=0 Jul 20 19:23:09.366968 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:09.366578 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" event={"ID":"8f843349-92fe-4144-9d95-1513eb1fbf51","Type":"ContainerDied","Data":"52a24b3d7932396a8705f0f21de1c36deee40bece06d1b5d026272103de5a20d"} Jul 20 19:23:09.911695 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:09.911664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:09.969212 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:09.969171 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:10.370398 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:10.370221 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-52l2f" event={"ID":"d49e6096-7f16-441f-9604-cd0e7e67452d","Type":"ContainerStarted","Data":"0b33b51ba072187c83f3a79115f7271a25d2593d8b68e3a7260f072dd49cde00"} Jul 20 19:23:10.373453 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:10.373372 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" event={"ID":"8f843349-92fe-4144-9d95-1513eb1fbf51","Type":"ContainerStarted","Data":"cd387b5e7685b1077f133d1abecca95727c826419ff5378b8d73495985b78b17"} Jul 20 19:23:10.390101 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:10.390057 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-52l2f" podStartSLOduration=1.214986893 podStartE2EDuration="3.390034598s" totalImagesPullingTime="2.175047705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:10.388978472 +0000 UTC m=+39.892298955" watchObservedRunningTime="2026-07-20 19:23:10.390034598 +0000 UTC m=+39.893355066" Jul 20 19:23:10.414881 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:10.414835 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6w9b8" podStartSLOduration=7.717326505 podStartE2EDuration="39.414819202s" totalImagesPullingTime="31.697492697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:10.413419611 +0000 UTC m=+39.916740291" watchObservedRunningTime="2026-07-20 19:23:10.414819202 +0000 UTC m=+39.918139670" Jul 20 19:23:10.438799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:10.438767 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:10.538489 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:10.538458 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:10.638245 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:10.638169 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:11.095156 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:11.095118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:11.095292 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:11.095220 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:11.095342 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:11.095294 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:23:15.095280071 +0000 UTC m=+44.598600518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:23:12.202670 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:12.202642 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:12.258239 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:12.258218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:15.118618 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:15.118586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:15.118985 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:15.118724 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:15.118985 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:15.118786 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:23:23.1187689 +0000 UTC m=+52.622089362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:23:23.176538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:23.176500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:23.176977 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:23.176607 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:23.176977 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:23.176668 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:23:39.176653754 +0000 UTC m=+68.679974200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:23:29.890898 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:29.890845 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:29.991613 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:29.991583 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:32.123436 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.123399 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp"] Jul 20 19:23:32.126375 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.126353 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" Jul 20 19:23:32.129124 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.129108 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 19:23:32.130703 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.130684 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 19:23:32.130703 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.130692 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 20 19:23:32.130840 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.130684 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 19:23:32.130840 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.130779 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5pdtj\"" Jul 20 19:23:32.134670 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.134650 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp"] Jul 20 19:23:32.138355 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.138334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjlpq\" (UniqueName: \"kubernetes.io/projected/bdf15223-745d-4831-9909-e5916c85b939-kube-api-access-vjlpq\") pod \"managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp\" (UID: \"bdf15223-745d-4831-9909-e5916c85b939\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" Jul 20 19:23:32.138455 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.138364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdf15223-745d-4831-9909-e5916c85b939-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp\" (UID: \"bdf15223-745d-4831-9909-e5916c85b939\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" Jul 20 19:23:32.239469 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.239432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjlpq\" (UniqueName: \"kubernetes.io/projected/bdf15223-745d-4831-9909-e5916c85b939-kube-api-access-vjlpq\") pod \"managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp\" (UID: \"bdf15223-745d-4831-9909-e5916c85b939\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" Jul 20 19:23:32.239469 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.239475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdf15223-745d-4831-9909-e5916c85b939-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp\" (UID: \"bdf15223-745d-4831-9909-e5916c85b939\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" Jul 20 19:23:32.243483 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.243453 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdf15223-745d-4831-9909-e5916c85b939-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp\" (UID: \"bdf15223-745d-4831-9909-e5916c85b939\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" Jul 20 19:23:32.248565 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.248537 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjlpq\" (UniqueName: \"kubernetes.io/projected/bdf15223-745d-4831-9909-e5916c85b939-kube-api-access-vjlpq\") pod \"managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp\" (UID: \"bdf15223-745d-4831-9909-e5916c85b939\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" Jul 20 19:23:32.348094 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.348072 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5mhv" Jul 20 19:23:32.448127 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.448065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" Jul 20 19:23:32.466293 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.466266 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:32.522679 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.522642 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:32.564666 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.564636 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp"] Jul 20 19:23:32.567792 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:23:32.567768 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdf15223_745d_4831_9909_e5916c85b939.slice/crio-27cf13d57731cc51294c53073d8d455a962c2e99e7e649a1c2c354fd43455b33 WatchSource:0}: Error finding container 27cf13d57731cc51294c53073d8d455a962c2e99e7e649a1c2c354fd43455b33: Status 404 returned error can't find the container with id 27cf13d57731cc51294c53073d8d455a962c2e99e7e649a1c2c354fd43455b33 Jul 20 19:23:32.590927 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:32.590897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:23:33.423837 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:33.423803 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" event={"ID":"bdf15223-745d-4831-9909-e5916c85b939","Type":"ContainerStarted","Data":"27cf13d57731cc51294c53073d8d455a962c2e99e7e649a1c2c354fd43455b33"} Jul 20 19:23:35.430681 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.430649 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" event={"ID":"bdf15223-745d-4831-9909-e5916c85b939","Type":"ContainerStarted","Data":"530514fa6ea7adc9392420315e98b2cd854e014a66ce43f4c0d620f1651158b1"} Jul 20 19:23:35.447565 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.447519 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" podStartSLOduration=0.721466283 podStartE2EDuration="3.447506012s" totalImagesPullingTime="2.726039729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:35.446472178 +0000 UTC m=+64.949792684" watchObservedRunningTime="2026-07-20 19:23:35.447506012 +0000 UTC m=+64.950826481" Jul 20 19:23:35.763724 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.763697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:35.763875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.763735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:35.763875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.763766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:23:35.766760 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.766737 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:23:35.766870 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.766770 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:23:35.766870 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.766804 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:23:35.774900 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:35.774883 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 19:23:35.774962 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:35.774952 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:24:39.774931796 +0000 UTC m=+129.278252245 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : secret "metrics-daemon-secret" not found Jul 20 19:23:35.776975 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.776951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd-original-pull-secret\") pod \"global-pull-secret-syncer-mwp22\" (UID: \"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd\") " pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:35.777524 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.777508 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:23:35.787668 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.787648 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wqms\" (UniqueName: \"kubernetes.io/projected/22bbf22a-575e-4659-99d6-81763438ebc0-kube-api-access-6wqms\") pod \"network-check-target-fkm5c\" (UID: \"22bbf22a-575e-4659-99d6-81763438ebc0\") " pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:35.975696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.975672 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ctrm\"" Jul 20 19:23:35.976641 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.976629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwp22" Jul 20 19:23:35.983348 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:35.983323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:36.102797 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:36.102771 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mwp22"] Jul 20 19:23:36.106207 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:23:36.106184 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60c77c9_d83c_4dfe_aa6f_c5ee823a9fbd.slice/crio-bccb5cb72b7a9cde9bedc5451e2d2c318b1f4e999067fb73af245201afbd92ed WatchSource:0}: Error finding container bccb5cb72b7a9cde9bedc5451e2d2c318b1f4e999067fb73af245201afbd92ed: Status 404 returned error can't find the container with id bccb5cb72b7a9cde9bedc5451e2d2c318b1f4e999067fb73af245201afbd92ed Jul 20 19:23:36.118371 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:36.118349 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fkm5c"] Jul 20 19:23:36.121355 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:23:36.121332 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bbf22a_575e_4659_99d6_81763438ebc0.slice/crio-27bcde0450afe5e8ea8ea2d122d91aeb44ae684f5ac67a31cfaff690a8daf015 WatchSource:0}: Error finding container 27bcde0450afe5e8ea8ea2d122d91aeb44ae684f5ac67a31cfaff690a8daf015: Status 404 returned error can't find the container with id 27bcde0450afe5e8ea8ea2d122d91aeb44ae684f5ac67a31cfaff690a8daf015 Jul 20 19:23:36.434240 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:36.434163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fkm5c" event={"ID":"22bbf22a-575e-4659-99d6-81763438ebc0","Type":"ContainerStarted","Data":"27bcde0450afe5e8ea8ea2d122d91aeb44ae684f5ac67a31cfaff690a8daf015"} Jul 20 19:23:36.435129 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:36.435110 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mwp22" event={"ID":"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd","Type":"ContainerStarted","Data":"bccb5cb72b7a9cde9bedc5451e2d2c318b1f4e999067fb73af245201afbd92ed"} Jul 20 19:23:39.188927 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:39.188895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:23:39.189331 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:39.189031 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:23:39.189331 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:23:39.189090 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:24:11.189071958 +0000 UTC m=+100.692392405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:23:41.450414 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:41.450365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fkm5c" event={"ID":"22bbf22a-575e-4659-99d6-81763438ebc0","Type":"ContainerStarted","Data":"27d15800e802260a336a89a86bd46b16902786610ec410dcad0c744eed0cf53f"} Jul 20 19:23:41.450825 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:41.450450 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:23:41.451750 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:41.451727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mwp22" event={"ID":"c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd","Type":"ContainerStarted","Data":"c7b18f45ca90b13562e1e75eb367ba458398fab9241a11096e0a4690f446cf58"} Jul 20 19:23:41.468700 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:41.468654 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fkm5c" podStartSLOduration=65.812495831 podStartE2EDuration="1m10.468641967s" totalImagesPullingTime="4.656146136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:41.467770555 +0000 UTC m=+70.971091026" watchObservedRunningTime="2026-07-20 19:23:41.468641967 +0000 UTC m=+70.971962440" Jul 20 19:23:41.483058 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:41.483020 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mwp22" podStartSLOduration=65.800989216 podStartE2EDuration="1m10.483008867s" totalImagesPullingTime="4.682019651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:41.482362016 +0000 UTC m=+70.985682485" watchObservedRunningTime="2026-07-20 19:23:41.483008867 +0000 UTC m=+70.986329336" Jul 20 19:23:48.616667 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:23:48.616627 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:24:11.200200 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:24:11.200164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:24:11.200678 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:24:11.200324 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:24:11.200678 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:24:11.200410 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:25:15.200364329 +0000 UTC m=+164.703684789 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:24:12.457401 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:24:12.457350 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fkm5c" Jul 20 19:24:39.791124 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:24:39.791083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:24:39.791609 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:24:39.791233 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 19:24:39.791609 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:24:39.791314 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:41.791296582 +0000 UTC m=+251.294617032 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : secret "metrics-daemon-secret" not found Jul 20 19:25:10.344195 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:25:10.344113 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gx9kq" podUID="dcf41659-6793-4414-bf04-d1f36705dd5b" Jul 20 19:25:10.662840 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:25:10.662756 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gx9kq" Jul 20 19:25:11.066708 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:25:11.066675 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:25:15.227234 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:25:15.227187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:25:15.227651 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:25:15.227350 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:25:15.227651 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:25:15.227434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls podName:dcf41659-6793-4414-bf04-d1f36705dd5b nodeName:}" failed. No retries permitted until 2026-07-20 19:27:17.227415609 +0000 UTC m=+286.730736056 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls") pod "dns-default-gx9kq" (UID: "dcf41659-6793-4414-bf04-d1f36705dd5b") : secret "dns-default-metrics-tls" not found Jul 20 19:25:23.057318 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:25:23.057233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:25:35.720915 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:25:35.720883 2561 generic.go:356] "Generic (PLEG): container finished" podID="bdf15223-745d-4831-9909-e5916c85b939" containerID="530514fa6ea7adc9392420315e98b2cd854e014a66ce43f4c0d620f1651158b1" exitCode=255 Jul 20 19:25:35.721274 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:25:35.720952 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" event={"ID":"bdf15223-745d-4831-9909-e5916c85b939","Type":"ContainerDied","Data":"530514fa6ea7adc9392420315e98b2cd854e014a66ce43f4c0d620f1651158b1"} Jul 20 19:25:35.726441 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:25:35.726422 2561 scope.go:117] "RemoveContainer" containerID="530514fa6ea7adc9392420315e98b2cd854e014a66ce43f4c0d620f1651158b1" Jul 20 19:25:36.725731 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:25:36.725700 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dd45b58-xg7kp" event={"ID":"bdf15223-745d-4831-9909-e5916c85b939","Type":"ContainerStarted","Data":"819f266d0123ae967f6cc3cdc04fac885b83398e63b1077d597d802328ef9857"} Jul 20 19:25:51.092718 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:25:51.092691 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:31.438413 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.438367 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69d7f454b9-9t5f7"] Jul 20 19:26:31.440028 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.440013 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.443552 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.443529 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 19:26:31.443679 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.443581 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 19:26:31.443982 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.443968 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lct99\"" Jul 20 19:26:31.446495 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.446427 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 19:26:31.455400 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.454930 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 19:26:31.458685 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.458663 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69d7f454b9-9t5f7"] Jul 20 19:26:31.462588 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.462570 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hqdlw"] Jul 20 19:26:31.464330 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.464315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.466772 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.466756 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 19:26:31.467473 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.467450 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 19:26:31.467564 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.467453 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 19:26:31.467896 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.467858 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 19:26:31.468252 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.468238 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2cmhc\"" Jul 20 19:26:31.473183 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.473168 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 19:26:31.482222 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.482203 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hqdlw"] Jul 20 19:26:31.495205 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-installation-pull-secrets\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.495307 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5s6k\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-kube-api-access-x5s6k\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.495307 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.495307 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-bound-sa-token\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.495307 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-certificates\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.495307 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0382762c-47aa-476c-9c34-e9b401f3f4f2-snapshots\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.495589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-image-registry-private-configuration\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.495589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-ca-trust-extracted\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.495589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7kst\" (UniqueName: \"kubernetes.io/projected/0382762c-47aa-476c-9c34-e9b401f3f4f2-kube-api-access-g7kst\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.495589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0382762c-47aa-476c-9c34-e9b401f3f4f2-service-ca-bundle\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.495589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0382762c-47aa-476c-9c34-e9b401f3f4f2-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.495589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0382762c-47aa-476c-9c34-e9b401f3f4f2-serving-cert\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.495589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-trusted-ca\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.495589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.495526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0382762c-47aa-476c-9c34-e9b401f3f4f2-tmp\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.536139 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.536114 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz"] Jul 20 19:26:31.538438 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.538419 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ltrfw"] Jul 20 19:26:31.538595 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.538564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:31.540017 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.539999 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.541468 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.541443 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 20 19:26:31.541557 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.541449 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:26:31.541557 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.541482 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gvsll\"" Jul 20 19:26:31.541643 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.541569 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 20 19:26:31.545028 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.545012 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zlmc9\"" Jul 20 19:26:31.545748 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.545724 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 19:26:31.545950 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.545934 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:26:31.546207 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.546187 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 19:26:31.552707 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.552689 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 19:26:31.552929 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.552916 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 19:26:31.560697 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.560677 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ltrfw"] Jul 20 19:26:31.565586 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.565565 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz"] Jul 20 19:26:31.596595 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-bound-sa-token\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.596595 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0382762c-47aa-476c-9c34-e9b401f3f4f2-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.596751 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0382762c-47aa-476c-9c34-e9b401f3f4f2-serving-cert\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.596751 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-certificates\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.596751 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0382762c-47aa-476c-9c34-e9b401f3f4f2-snapshots\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.596888 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0382762c-47aa-476c-9c34-e9b401f3f4f2-service-ca-bundle\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.596888 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-trusted-ca\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.596973 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z28xl\" (UniqueName: \"kubernetes.io/projected/15173b39-b89f-4d49-a947-ecdf4a9ec863-kube-api-access-z28xl\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:31.596973 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.597071 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.596990 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-config\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.597071 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-ca-trust-extracted\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.597071 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7kst\" (UniqueName: \"kubernetes.io/projected/0382762c-47aa-476c-9c34-e9b401f3f4f2-kube-api-access-g7kst\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.597229 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-serving-cert\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.597229 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:31.597096 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:26:31.597229 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:31.597114 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69d7f454b9-9t5f7: secret "image-registry-tls" not found Jul 20 19:26:31.597229 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:31.597176 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls podName:f96b7e93-9184-4239-baf1-2bfe04c0cc5d nodeName:}" failed. No retries permitted until 2026-07-20 19:26:32.097155 +0000 UTC m=+241.600475470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls") pod "image-registry-69d7f454b9-9t5f7" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d") : secret "image-registry-tls" not found Jul 20 19:26:31.597449 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597230 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-certificates\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.597449 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597326 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0382762c-47aa-476c-9c34-e9b401f3f4f2-service-ca-bundle\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.597449 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597099 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-image-registry-private-configuration\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.597449 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-trusted-ca\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.597647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0382762c-47aa-476c-9c34-e9b401f3f4f2-tmp\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.597647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597465 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0382762c-47aa-476c-9c34-e9b401f3f4f2-snapshots\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.597647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gj6h\" (UniqueName: \"kubernetes.io/projected/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-kube-api-access-2gj6h\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.597647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-installation-pull-secrets\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.597647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597532 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-ca-trust-extracted\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.597647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5s6k\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-kube-api-access-x5s6k\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.597647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:31.598053 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597650 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0382762c-47aa-476c-9c34-e9b401f3f4f2-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.598053 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.597709 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0382762c-47aa-476c-9c34-e9b401f3f4f2-tmp\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.598211 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.598194 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-trusted-ca\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.599303 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.599284 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0382762c-47aa-476c-9c34-e9b401f3f4f2-serving-cert\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.599614 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.599598 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-image-registry-private-configuration\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.599721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.599706 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-installation-pull-secrets\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.610565 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.610538 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5s6k\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-kube-api-access-x5s6k\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.610672 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.610647 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-bound-sa-token\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:31.610795 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.610776 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7kst\" (UniqueName: \"kubernetes.io/projected/0382762c-47aa-476c-9c34-e9b401f3f4f2-kube-api-access-g7kst\") pod \"insights-operator-555d9d7885-hqdlw\" (UID: \"0382762c-47aa-476c-9c34-e9b401f3f4f2\") " pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.697929 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.697842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:31.697929 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.697909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-trusted-ca\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.698122 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.697943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z28xl\" (UniqueName: \"kubernetes.io/projected/15173b39-b89f-4d49-a947-ecdf4a9ec863-kube-api-access-z28xl\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:31.698122 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.697971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-config\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.698122 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:31.697989 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:26:31.698122 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.697997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-serving-cert\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.698122 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.698032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gj6h\" (UniqueName: \"kubernetes.io/projected/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-kube-api-access-2gj6h\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.698122 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:31.698060 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls podName:15173b39-b89f-4d49-a947-ecdf4a9ec863 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:32.198039781 +0000 UTC m=+241.701360227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqbtz" (UID: "15173b39-b89f-4d49-a947-ecdf4a9ec863") : secret "samples-operator-tls" not found Jul 20 19:26:31.698715 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.698694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-config\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.698921 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.698905 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-trusted-ca\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.700273 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.700253 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-serving-cert\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.708207 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.708183 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gj6h\" (UniqueName: \"kubernetes.io/projected/4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e-kube-api-access-2gj6h\") pod \"console-operator-565b7b569d-ltrfw\" (UID: \"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e\") " pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.708282 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.708216 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:31.708329 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.708281 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z28xl\" (UniqueName: \"kubernetes.io/projected/15173b39-b89f-4d49-a947-ecdf4a9ec863-kube-api-access-z28xl\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:31.773459 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.773437 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-hqdlw" Jul 20 19:26:31.811309 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.811257 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:31.853755 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.853727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:31.896247 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.896218 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hqdlw"] Jul 20 19:26:31.899630 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:26:31.899511 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0382762c_47aa_476c_9c34_e9b401f3f4f2.slice/crio-9c79135be020ec8484f5dbb0b3a6afac009f1e34f68f82db53d4f53c0555585f WatchSource:0}: Error finding container 9c79135be020ec8484f5dbb0b3a6afac009f1e34f68f82db53d4f53c0555585f: Status 404 returned error can't find the container with id 9c79135be020ec8484f5dbb0b3a6afac009f1e34f68f82db53d4f53c0555585f Jul 20 19:26:31.979945 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:31.979919 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ltrfw"] Jul 20 19:26:31.982727 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:26:31.982701 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4729d6fa_e1ad_4cb4_81cb_f4f117b0f97e.slice/crio-fea164ac6592eff535603f8beab1b9fb8ae7b867174b7469ed8803e5f2fef534 WatchSource:0}: Error finding container fea164ac6592eff535603f8beab1b9fb8ae7b867174b7469ed8803e5f2fef534: Status 404 returned error can't find the container with id fea164ac6592eff535603f8beab1b9fb8ae7b867174b7469ed8803e5f2fef534 Jul 20 19:26:32.101633 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:32.101605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:32.101790 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:32.101738 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:26:32.101790 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:32.101758 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69d7f454b9-9t5f7: secret "image-registry-tls" not found Jul 20 19:26:32.101913 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:32.101838 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls podName:f96b7e93-9184-4239-baf1-2bfe04c0cc5d nodeName:}" failed. No retries permitted until 2026-07-20 19:26:33.101820413 +0000 UTC m=+242.605140883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls") pod "image-registry-69d7f454b9-9t5f7" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d") : secret "image-registry-tls" not found Jul 20 19:26:32.202818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:32.202790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:32.202960 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:32.202931 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:26:32.203020 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:32.202992 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls podName:15173b39-b89f-4d49-a947-ecdf4a9ec863 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:33.202975729 +0000 UTC m=+242.706296180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqbtz" (UID: "15173b39-b89f-4d49-a947-ecdf4a9ec863") : secret "samples-operator-tls" not found Jul 20 19:26:32.885241 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:32.885204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hqdlw" event={"ID":"0382762c-47aa-476c-9c34-e9b401f3f4f2","Type":"ContainerStarted","Data":"9c79135be020ec8484f5dbb0b3a6afac009f1e34f68f82db53d4f53c0555585f"} Jul 20 19:26:32.886668 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:32.886616 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" event={"ID":"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e","Type":"ContainerStarted","Data":"fea164ac6592eff535603f8beab1b9fb8ae7b867174b7469ed8803e5f2fef534"} Jul 20 19:26:33.109846 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:33.109813 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:33.110040 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:33.109945 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:26:33.110040 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:33.109962 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69d7f454b9-9t5f7: secret "image-registry-tls" not found Jul 20 19:26:33.110040 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:33.110024 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls podName:f96b7e93-9184-4239-baf1-2bfe04c0cc5d nodeName:}" failed. No retries permitted until 2026-07-20 19:26:35.110004438 +0000 UTC m=+244.613324899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls") pod "image-registry-69d7f454b9-9t5f7" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d") : secret "image-registry-tls" not found Jul 20 19:26:33.211090 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:33.211008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:33.211246 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:33.211182 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:26:33.211312 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:33.211258 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls podName:15173b39-b89f-4d49-a947-ecdf4a9ec863 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:35.211236208 +0000 UTC m=+244.714556669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqbtz" (UID: "15173b39-b89f-4d49-a947-ecdf4a9ec863") : secret "samples-operator-tls" not found Jul 20 19:26:33.849397 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:33.849329 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:33.970928 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:33.970888 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:34.898276 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:34.898250 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/0.log" Jul 20 19:26:34.898499 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:34.898288 2561 generic.go:356] "Generic (PLEG): container finished" podID="4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e" containerID="ad7c6c72ef787bd28f64a0eafd8700e38f31fa46f493993ae5981a9ccc6db065" exitCode=255 Jul 20 19:26:34.898499 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:34.898322 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" event={"ID":"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e","Type":"ContainerDied","Data":"ad7c6c72ef787bd28f64a0eafd8700e38f31fa46f493993ae5981a9ccc6db065"} Jul 20 19:26:34.898675 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:34.898653 2561 scope.go:117] "RemoveContainer" containerID="ad7c6c72ef787bd28f64a0eafd8700e38f31fa46f493993ae5981a9ccc6db065" Jul 20 19:26:34.899848 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:34.899820 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hqdlw" event={"ID":"0382762c-47aa-476c-9c34-e9b401f3f4f2","Type":"ContainerStarted","Data":"a72a2bac5f0d0ef4c5990e7aad754a17f5192fe981dbda96718a6ae93dff3e8e"} Jul 20 19:26:34.948228 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:34.948183 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-hqdlw" podStartSLOduration=1.602759898 podStartE2EDuration="3.948167852s" totalImagesPullingTime="2.345407954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:34.947933984 +0000 UTC m=+244.451254480" watchObservedRunningTime="2026-07-20 19:26:34.948167852 +0000 UTC m=+244.451488320" Jul 20 19:26:35.126327 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:35.126291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:35.126735 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:35.126412 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:26:35.126735 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:35.126424 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69d7f454b9-9t5f7: secret "image-registry-tls" not found Jul 20 19:26:35.126735 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:35.126473 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls podName:f96b7e93-9184-4239-baf1-2bfe04c0cc5d nodeName:}" failed. No retries permitted until 2026-07-20 19:26:39.126456693 +0000 UTC m=+248.629777140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls") pod "image-registry-69d7f454b9-9t5f7" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d") : secret "image-registry-tls" not found Jul 20 19:26:35.227630 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:35.227601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:35.227792 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:35.227771 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:26:35.227861 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:35.227852 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls podName:15173b39-b89f-4d49-a947-ecdf4a9ec863 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:39.227831121 +0000 UTC m=+248.731151580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqbtz" (UID: "15173b39-b89f-4d49-a947-ecdf4a9ec863") : secret "samples-operator-tls" not found Jul 20 19:26:35.904391 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:35.904348 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:26:35.904779 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:35.904763 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/0.log" Jul 20 19:26:35.904862 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:35.904800 2561 generic.go:356] "Generic (PLEG): container finished" podID="4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e" containerID="5114ceaaab466444480efc7ba0e5dadd40433b1031d7e0cfa78b18b3e00058df" exitCode=255 Jul 20 19:26:35.904913 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:35.904890 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" event={"ID":"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e","Type":"ContainerDied","Data":"5114ceaaab466444480efc7ba0e5dadd40433b1031d7e0cfa78b18b3e00058df"} Jul 20 19:26:35.904968 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:35.904957 2561 scope.go:117] "RemoveContainer" containerID="ad7c6c72ef787bd28f64a0eafd8700e38f31fa46f493993ae5981a9ccc6db065" Jul 20 19:26:35.905151 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:35.905136 2561 scope.go:117] "RemoveContainer" containerID="5114ceaaab466444480efc7ba0e5dadd40433b1031d7e0cfa78b18b3e00058df" Jul 20 19:26:35.905331 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:35.905309 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ltrfw_openshift-console-operator(4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e)\"" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" podUID="4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e" Jul 20 19:26:36.333195 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.333164 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:36.387585 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.387553 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hkjk6"] Jul 20 19:26:36.390358 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.390336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.395245 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.395218 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 19:26:36.395352 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.395273 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6cgzv\"" Jul 20 19:26:36.397016 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.396990 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 19:26:36.407394 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.407359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hkjk6"] Jul 20 19:26:36.439185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.439162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97beb4dc-665c-4796-85db-c0c87496ca78-crio-socket\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.439295 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.439191 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97beb4dc-665c-4796-85db-c0c87496ca78-data-volume\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.439295 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.439213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.439409 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.439297 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97beb4dc-665c-4796-85db-c0c87496ca78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.439409 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.439341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74j4n\" (UniqueName: \"kubernetes.io/projected/97beb4dc-665c-4796-85db-c0c87496ca78-kube-api-access-74j4n\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.446940 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.446916 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:36.540236 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.540207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97beb4dc-665c-4796-85db-c0c87496ca78-crio-socket\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.540236 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.540237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97beb4dc-665c-4796-85db-c0c87496ca78-data-volume\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.540491 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.540257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.540491 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.540279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97beb4dc-665c-4796-85db-c0c87496ca78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.540491 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.540316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74j4n\" (UniqueName: \"kubernetes.io/projected/97beb4dc-665c-4796-85db-c0c87496ca78-kube-api-access-74j4n\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.540491 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.540346 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97beb4dc-665c-4796-85db-c0c87496ca78-crio-socket\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.540491 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:36.540375 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 19:26:36.540491 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:36.540421 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:36.540491 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:36.540463 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97beb4dc-665c-4796-85db-c0c87496ca78-kube-rbac-proxy-cm podName:97beb4dc-665c-4796-85db-c0c87496ca78 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:37.0404442 +0000 UTC m=+246.543764679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97beb4dc-665c-4796-85db-c0c87496ca78-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkjk6" (UID: "97beb4dc-665c-4796-85db-c0c87496ca78") : configmap "kube-rbac-proxy" not found Jul 20 19:26:36.540491 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:36.540482 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls podName:97beb4dc-665c-4796-85db-c0c87496ca78 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:37.04047312 +0000 UTC m=+246.543793571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkjk6" (UID: "97beb4dc-665c-4796-85db-c0c87496ca78") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:36.540767 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.540568 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97beb4dc-665c-4796-85db-c0c87496ca78-data-volume\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.554224 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.554200 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74j4n\" (UniqueName: \"kubernetes.io/projected/97beb4dc-665c-4796-85db-c0c87496ca78-kube-api-access-74j4n\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:36.584600 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.584532 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:36.913105 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.913031 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:26:36.913373 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:36.913355 2561 scope.go:117] "RemoveContainer" containerID="5114ceaaab466444480efc7ba0e5dadd40433b1031d7e0cfa78b18b3e00058df" Jul 20 19:26:36.913565 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:36.913546 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ltrfw_openshift-console-operator(4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e)\"" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" podUID="4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e" Jul 20 19:26:37.044895 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.044863 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:37.044895 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.044897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97beb4dc-665c-4796-85db-c0c87496ca78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:37.045090 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:37.045012 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:37.045090 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:37.045079 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls podName:97beb4dc-665c-4796-85db-c0c87496ca78 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:38.045062355 +0000 UTC m=+247.548382801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkjk6" (UID: "97beb4dc-665c-4796-85db-c0c87496ca78") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:37.045362 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.045346 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97beb4dc-665c-4796-85db-c0c87496ca78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:37.059040 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.059010 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:37.168260 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.168188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:37.269732 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.269706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:37.293032 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.293004 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k"] Jul 20 19:26:37.295083 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.295069 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" Jul 20 19:26:37.298286 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.298261 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 19:26:37.298551 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.298538 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wxd9p\"" Jul 20 19:26:37.299159 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.299142 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 19:26:37.318179 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.318158 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k"] Jul 20 19:26:37.348424 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.348375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bq8d\" (UniqueName: \"kubernetes.io/projected/9ead26b6-5a2e-4472-806d-6433eee94243-kube-api-access-7bq8d\") pod \"migrator-7cc9c7ffd7-ldf9k\" (UID: \"9ead26b6-5a2e-4472-806d-6433eee94243\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" Jul 20 19:26:37.448850 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.448768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bq8d\" (UniqueName: \"kubernetes.io/projected/9ead26b6-5a2e-4472-806d-6433eee94243-kube-api-access-7bq8d\") pod \"migrator-7cc9c7ffd7-ldf9k\" (UID: \"9ead26b6-5a2e-4472-806d-6433eee94243\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" Jul 20 19:26:37.453527 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.453506 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:37.457494 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.457475 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bq8d\" (UniqueName: \"kubernetes.io/projected/9ead26b6-5a2e-4472-806d-6433eee94243-kube-api-access-7bq8d\") pod \"migrator-7cc9c7ffd7-ldf9k\" (UID: \"9ead26b6-5a2e-4472-806d-6433eee94243\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" Jul 20 19:26:37.527091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.527037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:37.604013 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.603987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" Jul 20 19:26:37.722819 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.722791 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k"] Jul 20 19:26:37.725614 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:26:37.725593 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ead26b6_5a2e_4472_806d_6433eee94243.slice/crio-bb4939b57588cdbdd2384d482366f45cb65d300093d9fcbebb3c229a2f5fdeae WatchSource:0}: Error finding container bb4939b57588cdbdd2384d482366f45cb65d300093d9fcbebb3c229a2f5fdeae: Status 404 returned error can't find the container with id bb4939b57588cdbdd2384d482366f45cb65d300093d9fcbebb3c229a2f5fdeae Jul 20 19:26:37.916884 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:37.916848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" event={"ID":"9ead26b6-5a2e-4472-806d-6433eee94243","Type":"ContainerStarted","Data":"bb4939b57588cdbdd2384d482366f45cb65d300093d9fcbebb3c229a2f5fdeae"} Jul 20 19:26:38.053843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:38.053765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:38.053985 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:38.053917 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:38.053985 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:38.053977 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls podName:97beb4dc-665c-4796-85db-c0c87496ca78 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:40.0539612 +0000 UTC m=+249.557281651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkjk6" (UID: "97beb4dc-665c-4796-85db-c0c87496ca78") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:38.371798 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:38.371732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rr8kq_92421977-fd0d-44fa-8044-24f942e188ff/dns-node-resolver/0.log" Jul 20 19:26:38.903555 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:38.903507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:38.983803 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:38.983773 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:39.160999 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:39.160917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:39.161147 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:39.161077 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:26:39.161147 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:39.161095 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69d7f454b9-9t5f7: secret "image-registry-tls" not found Jul 20 19:26:39.161147 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:39.161148 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls podName:f96b7e93-9184-4239-baf1-2bfe04c0cc5d nodeName:}" failed. No retries permitted until 2026-07-20 19:26:47.161132999 +0000 UTC m=+256.664453446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls") pod "image-registry-69d7f454b9-9t5f7" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d") : secret "image-registry-tls" not found Jul 20 19:26:39.261909 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:39.261886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:39.262039 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:39.262021 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:26:39.262090 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:39.262080 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls podName:15173b39-b89f-4d49-a947-ecdf4a9ec863 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:47.262065854 +0000 UTC m=+256.765386304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rqbtz" (UID: "15173b39-b89f-4d49-a947-ecdf4a9ec863") : secret "samples-operator-tls" not found Jul 20 19:26:39.574424 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:39.574400 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xf6bb_1dc444a4-b636-4ab5-b94f-64d04ac06517/node-ca/0.log" Jul 20 19:26:39.924358 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:39.924280 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" event={"ID":"9ead26b6-5a2e-4472-806d-6433eee94243","Type":"ContainerStarted","Data":"f7dc43d80a7c33b0732a5984e9e3fcbd0d72cb9e7d19ace0b46d259f47841d5c"} Jul 20 19:26:39.924358 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:39.924337 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" event={"ID":"9ead26b6-5a2e-4472-806d-6433eee94243","Type":"ContainerStarted","Data":"b6936c136adc33914c4ef2b8f023a801632e83a86eb141aaaf212ff0c0b04865"} Jul 20 19:26:39.972849 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:39.972825 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-52l2f_d49e6096-7f16-441f-9604-cd0e7e67452d/serve-healthcheck-canary/0.log" Jul 20 19:26:40.068609 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:40.068573 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:40.068764 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:40.068692 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:40.068764 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:40.068743 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls podName:97beb4dc-665c-4796-85db-c0c87496ca78 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:44.068729029 +0000 UTC m=+253.572049479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkjk6" (UID: "97beb4dc-665c-4796-85db-c0c87496ca78") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:40.129663 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:40.129615 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:40.591556 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:40.591524 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:40.744866 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:40.744831 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:40.828196 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:40.828164 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:40.917241 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:40.917132 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:41.017055 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:41.017023 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:41.538187 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:41.538153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:41.854191 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:41.854120 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:41.854191 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:41.854163 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:41.854575 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:41.854495 2561 scope.go:117] "RemoveContainer" containerID="5114ceaaab466444480efc7ba0e5dadd40433b1031d7e0cfa78b18b3e00058df" Jul 20 19:26:41.854677 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:41.854656 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ltrfw_openshift-console-operator(4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e)\"" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" podUID="4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e" Jul 20 19:26:41.882159 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:41.882138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:26:41.882334 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:41.882300 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 19:26:41.882494 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:41.882376 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs podName:347ef3ad-b233-4834-9c93-617b376eafd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:43.882355988 +0000 UTC m=+373.385676452 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs") pod "network-metrics-daemon-qdr9c" (UID: "347ef3ad-b233-4834-9c93-617b376eafd5") : secret "metrics-daemon-secret" not found Jul 20 19:26:42.245817 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:42.245788 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:42.445553 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:42.445521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:42.642340 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:42.642262 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:43.022573 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:43.022528 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:43.235753 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:43.235712 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:43.336816 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:43.336729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:43.623154 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:43.623074 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:44.082895 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:44.082867 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:44.097219 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:44.097198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:44.097356 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:44.097342 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:26:44.097422 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:26:44.097412 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls podName:97beb4dc-665c-4796-85db-c0c87496ca78 nodeName:}" failed. No retries permitted until 2026-07-20 19:26:52.09739773 +0000 UTC m=+261.600718178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkjk6" (UID: "97beb4dc-665c-4796-85db-c0c87496ca78") : secret "insights-runtime-extractor-tls" not found Jul 20 19:26:44.422765 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:44.422692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:44.522605 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:44.522580 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:44.626968 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:44.626942 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:44.822347 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:44.822324 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:45.016898 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:45.016866 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:45.639636 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:45.639605 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:46.055035 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:46.055008 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:46.456227 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:46.456158 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:46.667175 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:46.667144 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:47.160360 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.160331 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:47.223747 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.223720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:47.225975 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.225957 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"image-registry-69d7f454b9-9t5f7\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:47.266224 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.266199 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:47.324576 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.324553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:47.326728 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.326706 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15173b39-b89f-4d49-a947-ecdf4a9ec863-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rqbtz\" (UID: \"15173b39-b89f-4d49-a947-ecdf4a9ec863\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:47.348624 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.348600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:47.447518 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.447494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" Jul 20 19:26:47.475461 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.475373 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ldf9k" podStartSLOduration=8.969152616 podStartE2EDuration="10.475339955s" totalImagesPullingTime="1.506187339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:39.957548546 +0000 UTC m=+249.460869035" watchObservedRunningTime="2026-07-20 19:26:47.475339955 +0000 UTC m=+256.978660424" Jul 20 19:26:47.476190 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.476163 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69d7f454b9-9t5f7"] Jul 20 19:26:47.478621 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:26:47.478599 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96b7e93_9184_4239_baf1_2bfe04c0cc5d.slice/crio-fae3d9594ca23918cca64332b2126db901bfcc16acef83ccf969dfaa08460710 WatchSource:0}: Error finding container fae3d9594ca23918cca64332b2126db901bfcc16acef83ccf969dfaa08460710: Status 404 returned error can't find the container with id fae3d9594ca23918cca64332b2126db901bfcc16acef83ccf969dfaa08460710 Jul 20 19:26:47.571746 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.571720 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz"] Jul 20 19:26:47.842478 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.842441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:47.946290 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.946255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" event={"ID":"15173b39-b89f-4d49-a947-ecdf4a9ec863","Type":"ContainerStarted","Data":"dc01d2e2732f91e5ae351da001e9de30db21f447946ae621bfa7b47491f44e5d"} Jul 20 19:26:47.947683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.947660 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" event={"ID":"f96b7e93-9184-4239-baf1-2bfe04c0cc5d","Type":"ContainerStarted","Data":"6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7"} Jul 20 19:26:47.947794 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.947696 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" event={"ID":"f96b7e93-9184-4239-baf1-2bfe04c0cc5d","Type":"ContainerStarted","Data":"fae3d9594ca23918cca64332b2126db901bfcc16acef83ccf969dfaa08460710"} Jul 20 19:26:47.947794 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.947781 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:26:47.974167 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:47.974123 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" podStartSLOduration=16.974110303 podStartE2EDuration="16.974110303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:47.974014103 +0000 UTC m=+257.477334572" watchObservedRunningTime="2026-07-20 19:26:47.974110303 +0000 UTC m=+257.477430773" Jul 20 19:26:48.032543 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:48.032523 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:48.237739 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:48.237711 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:48.421489 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:48.421444 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:49.432183 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:49.432103 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:49.767789 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:49.767736 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:49.928980 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:49.928943 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:49.955063 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:49.954991 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" event={"ID":"15173b39-b89f-4d49-a947-ecdf4a9ec863","Type":"ContainerStarted","Data":"58e55f6fe45371d11b0e28a7c79db79f715f3d72eab95555356e4439c74e048d"} Jul 20 19:26:49.955063 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:49.955044 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" event={"ID":"15173b39-b89f-4d49-a947-ecdf4a9ec863","Type":"ContainerStarted","Data":"de4a51cae0db05bb76833862997840c7639cfc9e01cb3400cf72639b91f8de41"} Jul 20 19:26:49.980059 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:49.980009 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rqbtz" podStartSLOduration=16.963464038 podStartE2EDuration="18.979995153s" totalImagesPullingTime="2.016531115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:49.979680162 +0000 UTC m=+259.483000634" watchObservedRunningTime="2026-07-20 19:26:49.979995153 +0000 UTC m=+259.483315626" Jul 20 19:26:50.021402 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:50.021358 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:50.225792 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:50.225763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:50.513401 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:50.513306 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:51.021800 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:51.021757 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:51.269350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:51.269314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:52.163283 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:52.163250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:52.165451 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:52.165427 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97beb4dc-665c-4796-85db-c0c87496ca78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkjk6\" (UID: \"97beb4dc-665c-4796-85db-c0c87496ca78\") " pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:52.299228 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:52.299174 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hkjk6" Jul 20 19:26:52.358066 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:52.358036 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:52.423835 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:52.423762 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hkjk6"] Jul 20 19:26:52.426914 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:26:52.426888 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97beb4dc_665c_4796_85db_c0c87496ca78.slice/crio-5c72472f9c6e6b9a49dac144d0a4895bc7d8abc3275124c449ba850c57ac437e WatchSource:0}: Error finding container 5c72472f9c6e6b9a49dac144d0a4895bc7d8abc3275124c449ba850c57ac437e: Status 404 returned error can't find the container with id 5c72472f9c6e6b9a49dac144d0a4895bc7d8abc3275124c449ba850c57ac437e Jul 20 19:26:52.965761 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:52.965687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkjk6" event={"ID":"97beb4dc-665c-4796-85db-c0c87496ca78","Type":"ContainerStarted","Data":"5c72472f9c6e6b9a49dac144d0a4895bc7d8abc3275124c449ba850c57ac437e"} Jul 20 19:26:54.058280 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:54.058250 2561 scope.go:117] "RemoveContainer" containerID="5114ceaaab466444480efc7ba0e5dadd40433b1031d7e0cfa78b18b3e00058df" Jul 20 19:26:54.849240 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:54.849208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:54.949240 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:54.949188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:54.975575 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:54.975545 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:26:54.975733 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:54.975607 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" event={"ID":"4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e","Type":"ContainerStarted","Data":"5f16dad24c3e07859d1621bf16944c0fb02429270956f9e3a943e16747c2d3aa"} Jul 20 19:26:54.975972 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:54.975920 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:54.981873 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:54.981844 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" Jul 20 19:26:55.000942 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:55.000886 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-ltrfw" podStartSLOduration=21.736720425 podStartE2EDuration="24.000866294s" totalImagesPullingTime="2.264145869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:54.998843921 +0000 UTC m=+264.502164391" watchObservedRunningTime="2026-07-20 19:26:55.000866294 +0000 UTC m=+264.504186777" Jul 20 19:26:55.028948 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:55.028912 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:55.157086 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:55.156995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:55.527087 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:55.527052 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:55.606519 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:55.606481 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:55.933154 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:55.933068 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:56.158050 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:56.157970 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:56.259191 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:56.259160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:56.358587 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:56.358553 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:56.646214 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:56.646142 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:56.780091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:56.780055 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:56.856559 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:56.856529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:56.924004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:56.923920 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:57.991342 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:57.991260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkjk6" event={"ID":"97beb4dc-665c-4796-85db-c0c87496ca78","Type":"ContainerStarted","Data":"4132fb8dc96a137ba8dc14dded339018b0cd078257ba9539552cd9522fbe2a78"} Jul 20 19:26:58.227952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:58.227887 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:26:58.296231 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:26:58.296166 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:01.002490 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:01.002459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkjk6" event={"ID":"97beb4dc-665c-4796-85db-c0c87496ca78","Type":"ContainerStarted","Data":"2a2ee14b52163dcb491b06016081566d7b2d8931d9a6738402158fe38d365a26"} Jul 20 19:27:04.196778 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.196750 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69d7f454b9-9t5f7"] Jul 20 19:27:04.201938 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.201884 2561 patch_prober.go:28] interesting pod/image-registry-69d7f454b9-9t5f7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 19:27:04.202079 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.201965 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" podUID="f96b7e93-9184-4239-baf1-2bfe04c0cc5d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:27:04.209885 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.209858 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-mrkwh"] Jul 20 19:27:04.237617 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.237180 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-mrkwh"] Jul 20 19:27:04.237617 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.237306 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-mrkwh" Jul 20 19:27:04.240159 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.240124 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 19:27:04.240592 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.240570 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-q4cz7\"" Jul 20 19:27:04.240726 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.240570 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 19:27:04.322173 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.322146 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cf7d9dd99-4shqt"] Jul 20 19:27:04.322478 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.322444 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:04.326705 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.326686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.351865 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.351842 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf7d9dd99-4shqt"] Jul 20 19:27:04.363720 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.363700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g82zj\" (UniqueName: \"kubernetes.io/projected/28ddee51-0515-4171-a1d3-27f72947552c-kube-api-access-g82zj\") pod \"downloads-5bc67dcd46-mrkwh\" (UID: \"28ddee51-0515-4171-a1d3-27f72947552c\") " pod="openshift-console/downloads-5bc67dcd46-mrkwh" Jul 20 19:27:04.441152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.441112 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:04.464723 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464703 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcvln\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-kube-api-access-tcvln\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.464806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-image-registry-private-configuration\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.464806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g82zj\" (UniqueName: \"kubernetes.io/projected/28ddee51-0515-4171-a1d3-27f72947552c-kube-api-access-g82zj\") pod \"downloads-5bc67dcd46-mrkwh\" (UID: \"28ddee51-0515-4171-a1d3-27f72947552c\") " pod="openshift-console/downloads-5bc67dcd46-mrkwh" Jul 20 19:27:04.464806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-installation-pull-secrets\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.464918 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-bound-sa-token\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.464918 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-ca-trust-extracted\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.464918 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-trusted-ca\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.465055 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-registry-tls\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.465055 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.464971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-registry-certificates\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.481299 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.481283 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g82zj\" (UniqueName: \"kubernetes.io/projected/28ddee51-0515-4171-a1d3-27f72947552c-kube-api-access-g82zj\") pod \"downloads-5bc67dcd46-mrkwh\" (UID: \"28ddee51-0515-4171-a1d3-27f72947552c\") " pod="openshift-console/downloads-5bc67dcd46-mrkwh" Jul 20 19:27:04.549032 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.549006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-mrkwh" Jul 20 19:27:04.566087 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcvln\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-kube-api-access-tcvln\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.566190 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-image-registry-private-configuration\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.566190 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-installation-pull-secrets\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.566294 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-bound-sa-token\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.566294 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-ca-trust-extracted\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.566294 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-trusted-ca\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.566294 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-registry-tls\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.566516 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-registry-certificates\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.566700 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.566680 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-ca-trust-extracted\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.567163 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.567139 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-registry-certificates\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.567163 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.567150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-trusted-ca\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.569011 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.568990 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-image-registry-private-configuration\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.569224 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.569201 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-installation-pull-secrets\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.569314 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.569280 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-registry-tls\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.572081 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.572058 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:04.590766 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.590741 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-bound-sa-token\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.591853 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.591834 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcvln\" (UniqueName: \"kubernetes.io/projected/4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94-kube-api-access-tcvln\") pod \"image-registry-6cf7d9dd99-4shqt\" (UID: \"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94\") " pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.635698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.635670 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:04.685312 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.685200 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-mrkwh"] Jul 20 19:27:04.775447 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.775417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:04.788318 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.788293 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf7d9dd99-4shqt"] Jul 20 19:27:04.791235 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:27:04.791212 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4a44ac_84d0_46ff_8f09_c3a4dfa8ef94.slice/crio-2da161f3e7a78ad8882c38837a60b0cdde7faec08312b8538e463f4b9591eb8c WatchSource:0}: Error finding container 2da161f3e7a78ad8882c38837a60b0cdde7faec08312b8538e463f4b9591eb8c: Status 404 returned error can't find the container with id 2da161f3e7a78ad8882c38837a60b0cdde7faec08312b8538e463f4b9591eb8c Jul 20 19:27:04.874714 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:04.874679 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:05.018905 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:05.018866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkjk6" event={"ID":"97beb4dc-665c-4796-85db-c0c87496ca78","Type":"ContainerStarted","Data":"1e69b5a659ea3858895463472c62b8185763a4ec0471179f0f374b45829ff60f"} Jul 20 19:27:05.020152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:05.020128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-mrkwh" event={"ID":"28ddee51-0515-4171-a1d3-27f72947552c","Type":"ContainerStarted","Data":"75e3cfec8eef58792a6fb0d8232f19b940dc0fc1aa8b16104fd62129cb347b34"} Jul 20 19:27:05.021580 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:05.021555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" event={"ID":"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94","Type":"ContainerStarted","Data":"cb4cf5d745612f1b6202ce2349b1ae0a10d770e7965ae660343a445592f5181a"} Jul 20 19:27:05.021692 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:05.021596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" event={"ID":"4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94","Type":"ContainerStarted","Data":"2da161f3e7a78ad8882c38837a60b0cdde7faec08312b8538e463f4b9591eb8c"} Jul 20 19:27:05.021692 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:05.021675 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:05.039804 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:05.039757 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hkjk6" podStartSLOduration=17.130315343 podStartE2EDuration="29.03974166s" totalImagesPullingTime="11.909426317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:26:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:05.039490039 +0000 UTC m=+274.542810500" watchObservedRunningTime="2026-07-20 19:27:05.03974166 +0000 UTC m=+274.543062129" Jul 20 19:27:05.063514 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:05.063202 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" podStartSLOduration=1.063182688 podStartE2EDuration="1.063182688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:05.060696898 +0000 UTC m=+274.564017368" watchObservedRunningTime="2026-07-20 19:27:05.063182688 +0000 UTC m=+274.566503158" Jul 20 19:27:07.157178 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:07.157141 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:07.258346 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:07.258315 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:07.460404 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:07.460309 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:07.535282 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:07.535234 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:08.176538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:08.176502 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:09.761130 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:09.761096 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:09.860135 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:09.860102 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:11.481016 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:11.480983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:11.580003 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:11.579968 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:11.643506 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:11.643477 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:13.664102 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:27:13.664064 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gx9kq" podUID="dcf41659-6793-4414-bf04-d1f36705dd5b" Jul 20 19:27:13.737997 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:13.737963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:14.051911 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:14.051880 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gx9kq" Jul 20 19:27:14.201238 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:14.201206 2561 patch_prober.go:28] interesting pod/image-registry-69d7f454b9-9t5f7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 19:27:14.201403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:14.201274 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" podUID="f96b7e93-9184-4239-baf1-2bfe04c0cc5d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:27:15.354896 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:15.354858 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:15.615696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:15.615592 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:17.272218 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:17.272177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:27:17.274713 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:17.274691 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dcf41659-6793-4414-bf04-d1f36705dd5b-metrics-tls\") pod \"dns-default-gx9kq\" (UID: \"dcf41659-6793-4414-bf04-d1f36705dd5b\") " pod="openshift-dns/dns-default-gx9kq" Jul 20 19:27:17.355820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:17.355789 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bsgbb\"" Jul 20 19:27:17.363264 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:17.363240 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gx9kq" Jul 20 19:27:17.668035 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:17.667944 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:17.916046 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:17.916012 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:18.020964 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.020930 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vcx89"] Jul 20 19:27:18.024525 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.024503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.030686 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.030659 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 19:27:18.030998 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.030915 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 19:27:18.032098 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.031784 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sg4tx\"" Jul 20 19:27:18.032098 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.031823 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 19:27:18.032098 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.031899 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 19:27:18.032098 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.031939 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 19:27:18.032098 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.031955 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 19:27:18.041398 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.041356 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-vl2wq"] Jul 20 19:27:18.045007 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.044989 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.050768 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.050749 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 20 19:27:18.057058 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.057036 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w2jrr\"" Jul 20 19:27:18.057058 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.057056 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 20 19:27:18.057344 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.057330 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 20 19:27:18.063604 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.063583 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-vl2wq"] Jul 20 19:27:18.069883 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.069857 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:18.173350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.173308 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:18.179047 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-tls\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179176 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslrr\" (UniqueName: \"kubernetes.io/projected/fe5397c2-554a-400d-8247-ed16bee7482b-kube-api-access-cslrr\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.179176 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-textfile\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179176 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-sys\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179176 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179176 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.179359 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.179359 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-root\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179359 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe5397c2-554a-400d-8247-ed16bee7482b-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.179359 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-metrics-client-ca\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179523 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.179523 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179396 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrs5d\" (UniqueName: \"kubernetes.io/projected/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-kube-api-access-mrs5d\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179523 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179523 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-wtmp\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.179523 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.179519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fe5397c2-554a-400d-8247-ed16bee7482b-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.273786 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.273703 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:18.280737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.280709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-sys\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.280862 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.280757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.280862 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.280816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.280980 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.280864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.280980 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.280897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-root\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.280980 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.280925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe5397c2-554a-400d-8247-ed16bee7482b-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.280980 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.280954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-metrics-client-ca\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281171 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.280924 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-sys\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281171 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281004 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-root\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281171 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.281171 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrs5d\" (UniqueName: \"kubernetes.io/projected/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-kube-api-access-mrs5d\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281171 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-wtmp\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fe5397c2-554a-400d-8247-ed16bee7482b-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.281426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-tls\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslrr\" (UniqueName: \"kubernetes.io/projected/fe5397c2-554a-400d-8247-ed16bee7482b-kube-api-access-cslrr\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.281426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-textfile\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281664 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281461 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-wtmp\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281664 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.281664 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281646 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe5397c2-554a-400d-8247-ed16bee7482b-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.281822 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281671 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-textfile\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.281878 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281865 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-metrics-client-ca\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.282013 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.281978 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fe5397c2-554a-400d-8247-ed16bee7482b-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.282232 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.282188 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.283873 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.283830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.284068 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.284048 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.284235 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.284214 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe5397c2-554a-400d-8247-ed16bee7482b-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.284294 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.284238 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-node-exporter-tls\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.316209 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.316186 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrs5d\" (UniqueName: \"kubernetes.io/projected/574698ea-00e6-4932-a5a7-6a0bce0ad0b8-kube-api-access-mrs5d\") pod \"node-exporter-vcx89\" (UID: \"574698ea-00e6-4932-a5a7-6a0bce0ad0b8\") " pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.319472 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.319441 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslrr\" (UniqueName: \"kubernetes.io/projected/fe5397c2-554a-400d-8247-ed16bee7482b-kube-api-access-cslrr\") pod \"kube-state-metrics-56c5594674-vl2wq\" (UID: \"fe5397c2-554a-400d-8247-ed16bee7482b\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.335337 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.335315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vcx89" Jul 20 19:27:18.354693 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.354674 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" Jul 20 19:27:18.484029 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.483994 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:18.588446 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.588301 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:18.943814 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:18.943700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:19.065767 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.065729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:19.068049 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.068022 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:27:19.072086 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.072066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.076137 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076117 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 19:27:19.076310 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076241 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 19:27:19.076310 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076251 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 19:27:19.076522 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076182 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 19:27:19.076522 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076209 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 19:27:19.076522 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076125 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 19:27:19.076712 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076693 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 19:27:19.076817 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076764 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 19:27:19.076875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j94xz\"" Jul 20 19:27:19.076875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.076841 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 19:27:19.089111 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.089089 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:27:19.189868 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.189830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190062 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.189901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfvzh\" (UniqueName: \"kubernetes.io/projected/1c6beb84-639a-48f0-9369-6fe7b238c248-kube-api-access-pfvzh\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190062 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190022 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190062 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c6beb84-639a-48f0-9369-6fe7b238c248-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c6beb84-639a-48f0-9369-6fe7b238c248-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c6beb84-639a-48f0-9369-6fe7b238c248-config-out\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190511 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-web-config\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190511 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190511 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c6beb84-639a-48f0-9369-6fe7b238c248-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190511 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c6beb84-639a-48f0-9369-6fe7b238c248-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.190511 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.190357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.291523 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.291486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.291994 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.291548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfvzh\" (UniqueName: \"kubernetes.io/projected/1c6beb84-639a-48f0-9369-6fe7b238c248-kube-api-access-pfvzh\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.291994 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.291618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.291994 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.291643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c6beb84-639a-48f0-9369-6fe7b238c248-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.291994 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.291673 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.291994 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.291710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.291994 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.291738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c6beb84-639a-48f0-9369-6fe7b238c248-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.292409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c6beb84-639a-48f0-9369-6fe7b238c248-config-out\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.292445 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c6beb84-639a-48f0-9369-6fe7b238c248-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.292459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-web-config\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.292516 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.292559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c6beb84-639a-48f0-9369-6fe7b238c248-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.292589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c6beb84-639a-48f0-9369-6fe7b238c248-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.293045 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c6beb84-639a-48f0-9369-6fe7b238c248-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293569 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.293368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c6beb84-639a-48f0-9369-6fe7b238c248-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.293569 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.293512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.294646 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.294620 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.295654 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.295245 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.295654 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.295622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c6beb84-639a-48f0-9369-6fe7b238c248-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.295654 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.295624 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.296349 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.296266 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.296349 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.296301 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:19.296673 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.296646 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.296778 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.296669 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.297207 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.297187 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c6beb84-639a-48f0-9369-6fe7b238c248-config-out\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.297277 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.297192 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c6beb84-639a-48f0-9369-6fe7b238c248-web-config\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.301757 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.301736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfvzh\" (UniqueName: \"kubernetes.io/projected/1c6beb84-639a-48f0-9369-6fe7b238c248-kube-api-access-pfvzh\") pod \"alertmanager-main-0\" (UID: \"1c6beb84-639a-48f0-9369-6fe7b238c248\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:19.373530 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.373500 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:19.383534 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:19.383510 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:27:20.732996 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:20.732965 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:20.812131 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:20.812100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:20.959164 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:20.959123 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:21.049976 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:21.049890 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:21.120936 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:21.120905 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:21.190557 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:21.190523 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:21.930591 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:21.930557 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:22.025022 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.024949 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:22.519719 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.519682 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-669b987f7b-x4qbz"] Jul 20 19:27:22.522159 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.522136 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.526024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.525757 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 20 19:27:22.526512 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.526488 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-77gf6\"" Jul 20 19:27:22.530298 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.530275 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b9mnpjq2oari7\"" Jul 20 19:27:22.530582 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.530279 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 20 19:27:22.530677 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.530476 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 19:27:22.530771 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.530566 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 20 19:27:22.540838 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.540812 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669b987f7b-x4qbz"] Jul 20 19:27:22.621103 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.621071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-secret-metrics-server-tls\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.621250 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.621127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-client-ca-bundle\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.621250 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.621154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh5f8\" (UniqueName: \"kubernetes.io/projected/02cbd8ef-0d84-4156-9599-2a6db487a80f-kube-api-access-nh5f8\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.621363 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.621306 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cbd8ef-0d84-4156-9599-2a6db487a80f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.621363 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.621348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02cbd8ef-0d84-4156-9599-2a6db487a80f-audit-log\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.621480 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.621375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02cbd8ef-0d84-4156-9599-2a6db487a80f-metrics-server-audit-profiles\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.621528 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.621476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-secret-metrics-server-client-certs\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.703105 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.703070 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:22.722223 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.722193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-secret-metrics-server-client-certs\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.722431 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.722258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-secret-metrics-server-tls\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.722431 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.722307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-client-ca-bundle\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.722534 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.722435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh5f8\" (UniqueName: \"kubernetes.io/projected/02cbd8ef-0d84-4156-9599-2a6db487a80f-kube-api-access-nh5f8\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.722586 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.722527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cbd8ef-0d84-4156-9599-2a6db487a80f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.722586 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.722571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02cbd8ef-0d84-4156-9599-2a6db487a80f-audit-log\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.722678 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.722596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02cbd8ef-0d84-4156-9599-2a6db487a80f-metrics-server-audit-profiles\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.723181 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.723080 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02cbd8ef-0d84-4156-9599-2a6db487a80f-audit-log\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.723297 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.723282 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cbd8ef-0d84-4156-9599-2a6db487a80f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.723948 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.723922 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02cbd8ef-0d84-4156-9599-2a6db487a80f-metrics-server-audit-profiles\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.725177 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.725132 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-secret-metrics-server-client-certs\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.725523 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.725322 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-client-ca-bundle\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.725523 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.725458 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02cbd8ef-0d84-4156-9599-2a6db487a80f-secret-metrics-server-tls\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.734344 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.734323 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh5f8\" (UniqueName: \"kubernetes.io/projected/02cbd8ef-0d84-4156-9599-2a6db487a80f-kube-api-access-nh5f8\") pod \"metrics-server-669b987f7b-x4qbz\" (UID: \"02cbd8ef-0d84-4156-9599-2a6db487a80f\") " pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.786348 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.786273 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:22.834556 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.834526 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:22.913429 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:22.913402 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:23.482569 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:27:23.482538 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574698ea_00e6_4932_a5a7_6a0bce0ad0b8.slice/crio-0c37d24559be48981994e62204838bbad91d3329910b26bb13ea98c9051d55ee WatchSource:0}: Error finding container 0c37d24559be48981994e62204838bbad91d3329910b26bb13ea98c9051d55ee: Status 404 returned error can't find the container with id 0c37d24559be48981994e62204838bbad91d3329910b26bb13ea98c9051d55ee Jul 20 19:27:23.635178 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:23.635052 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669b987f7b-x4qbz"] Jul 20 19:27:23.640045 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:27:23.640002 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cbd8ef_0d84_4156_9599_2a6db487a80f.slice/crio-4a268b46ff107b17089b7d1c4d1da28fa3e6d4cf6c902dd29b21b17dd368a6bd WatchSource:0}: Error finding container 4a268b46ff107b17089b7d1c4d1da28fa3e6d4cf6c902dd29b21b17dd368a6bd: Status 404 returned error can't find the container with id 4a268b46ff107b17089b7d1c4d1da28fa3e6d4cf6c902dd29b21b17dd368a6bd Jul 20 19:27:23.667033 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:23.667006 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-vl2wq"] Jul 20 19:27:23.668967 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:27:23.668937 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5397c2_554a_400d_8247_ed16bee7482b.slice/crio-8c8c07f255fa7ddced299e3bcec034a14a208e7573cd62fc3044a376d78ce335 WatchSource:0}: Error finding container 8c8c07f255fa7ddced299e3bcec034a14a208e7573cd62fc3044a376d78ce335: Status 404 returned error can't find the container with id 8c8c07f255fa7ddced299e3bcec034a14a208e7573cd62fc3044a376d78ce335 Jul 20 19:27:23.703074 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:23.703044 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:27:23.705736 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:27:23.705714 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6beb84_639a_48f0_9369_6fe7b238c248.slice/crio-3b29c48aefee29dfbdc00cd2246d36b99dcf32c26e1ca2316e5c2efbe248d5fa WatchSource:0}: Error finding container 3b29c48aefee29dfbdc00cd2246d36b99dcf32c26e1ca2316e5c2efbe248d5fa: Status 404 returned error can't find the container with id 3b29c48aefee29dfbdc00cd2246d36b99dcf32c26e1ca2316e5c2efbe248d5fa Jul 20 19:27:23.865673 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:23.865402 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gx9kq"] Jul 20 19:27:23.868219 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:27:23.868174 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf41659_6793_4414_bf04_d1f36705dd5b.slice/crio-099e4749d71296ffffc5ede6d755a3ede05a1ca8c4bd67d167c5c03038f856dc WatchSource:0}: Error finding container 099e4749d71296ffffc5ede6d755a3ede05a1ca8c4bd67d167c5c03038f856dc: Status 404 returned error can't find the container with id 099e4749d71296ffffc5ede6d755a3ede05a1ca8c4bd67d167c5c03038f856dc Jul 20 19:27:24.091512 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.091442 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-mrkwh" event={"ID":"28ddee51-0515-4171-a1d3-27f72947552c","Type":"ContainerStarted","Data":"f15466b57e04bc90eca76ec357a202a03e98545600f6ae0e4063f272cd0fe027"} Jul 20 19:27:24.092034 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.091965 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-mrkwh" Jul 20 19:27:24.094020 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.093988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c6beb84-639a-48f0-9369-6fe7b238c248","Type":"ContainerStarted","Data":"3b29c48aefee29dfbdc00cd2246d36b99dcf32c26e1ca2316e5c2efbe248d5fa"} Jul 20 19:27:24.095542 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.095516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" event={"ID":"02cbd8ef-0d84-4156-9599-2a6db487a80f","Type":"ContainerStarted","Data":"4a268b46ff107b17089b7d1c4d1da28fa3e6d4cf6c902dd29b21b17dd368a6bd"} Jul 20 19:27:24.096942 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.096914 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gx9kq" event={"ID":"dcf41659-6793-4414-bf04-d1f36705dd5b","Type":"ContainerStarted","Data":"099e4749d71296ffffc5ede6d755a3ede05a1ca8c4bd67d167c5c03038f856dc"} Jul 20 19:27:24.098364 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.098339 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" event={"ID":"fe5397c2-554a-400d-8247-ed16bee7482b","Type":"ContainerStarted","Data":"8c8c07f255fa7ddced299e3bcec034a14a208e7573cd62fc3044a376d78ce335"} Jul 20 19:27:24.099846 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.099820 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcx89" event={"ID":"574698ea-00e6-4932-a5a7-6a0bce0ad0b8","Type":"ContainerStarted","Data":"0c37d24559be48981994e62204838bbad91d3329910b26bb13ea98c9051d55ee"} Jul 20 19:27:24.107281 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.107240 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-mrkwh" Jul 20 19:27:24.116216 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.116130 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-mrkwh" podStartSLOduration=1.231395276 podStartE2EDuration="20.116112123s" totalImagesPullingTime="18.884716847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:24.114652328 +0000 UTC m=+293.617972822" watchObservedRunningTime="2026-07-20 19:27:24.116112123 +0000 UTC m=+293.619432593" Jul 20 19:27:24.205811 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.205780 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:27:24.304342 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:24.304307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:26.031293 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:26.030452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cf7d9dd99-4shqt" Jul 20 19:27:26.058560 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:27:26.058175 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qdr9c" podUID="347ef3ad-b233-4834-9c93-617b376eafd5" Jul 20 19:27:26.197469 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:26.197435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:26.465905 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:26.465831 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:27.840437 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:27.840397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:27.936616 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:27.936587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:28.121971 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:28.120657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" event={"ID":"02cbd8ef-0d84-4156-9599-2a6db487a80f","Type":"ContainerStarted","Data":"ca235bb84d9d9ebcb08db5461f3d224b6422cf7a84ca65c648f1ee1543398bad"} Jul 20 19:27:28.122554 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:28.122527 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcx89" event={"ID":"574698ea-00e6-4932-a5a7-6a0bce0ad0b8","Type":"ContainerStarted","Data":"0fcc40d306b435850dd3ccf52bf58ed835aab7f3bda6ffe6971b1a98cc8131ec"} Jul 20 19:27:28.180760 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:28.180715 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:28.289206 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:28.288895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:29.128315 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.128275 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gx9kq" event={"ID":"dcf41659-6793-4414-bf04-d1f36705dd5b","Type":"ContainerStarted","Data":"bcc761656fcbb358edbe96237cbbc92839704a52689de06383cad42bc9f1c3a7"} Jul 20 19:27:29.128830 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.128345 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gx9kq" event={"ID":"dcf41659-6793-4414-bf04-d1f36705dd5b","Type":"ContainerStarted","Data":"3030c982ab77cffbae896a926dc56b3268667be3c60bae604ba9257dc6664acb"} Jul 20 19:27:29.128830 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.128426 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gx9kq" Jul 20 19:27:29.130870 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.130843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" event={"ID":"fe5397c2-554a-400d-8247-ed16bee7482b","Type":"ContainerStarted","Data":"fc81d07c9147b01c3b2e503b6db5465fc7cd81be3638c286369dde01cd6abb4c"} Jul 20 19:27:29.131005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.130894 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" event={"ID":"fe5397c2-554a-400d-8247-ed16bee7482b","Type":"ContainerStarted","Data":"287be6afb3b91791bc06a1a20aa205b0bcd16da4f9c5babfb07b9bab8fe5606e"} Jul 20 19:27:29.131005 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.130932 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" event={"ID":"fe5397c2-554a-400d-8247-ed16bee7482b","Type":"ContainerStarted","Data":"9f9e58371c1bbb7599566d5a428a4af07ce9e11080b5db80cfb805d885d78258"} Jul 20 19:27:29.132712 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.132684 2561 generic.go:356] "Generic (PLEG): container finished" podID="574698ea-00e6-4932-a5a7-6a0bce0ad0b8" containerID="0fcc40d306b435850dd3ccf52bf58ed835aab7f3bda6ffe6971b1a98cc8131ec" exitCode=0 Jul 20 19:27:29.132849 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.132748 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcx89" event={"ID":"574698ea-00e6-4932-a5a7-6a0bce0ad0b8","Type":"ContainerDied","Data":"0fcc40d306b435850dd3ccf52bf58ed835aab7f3bda6ffe6971b1a98cc8131ec"} Jul 20 19:27:29.134664 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.134643 2561 generic.go:356] "Generic (PLEG): container finished" podID="1c6beb84-639a-48f0-9369-6fe7b238c248" containerID="c5a80347cba275653d377278d6d9628f5e0b00d537541d1b4be752de0942fcfe" exitCode=0 Jul 20 19:27:29.134886 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.134683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c6beb84-639a-48f0-9369-6fe7b238c248","Type":"ContainerDied","Data":"c5a80347cba275653d377278d6d9628f5e0b00d537541d1b4be752de0942fcfe"} Jul 20 19:27:29.151088 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.151047 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gx9kq" podStartSLOduration=257.772971453 podStartE2EDuration="4m22.151032421s" totalImagesPullingTime="4.378060968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:29.150216996 +0000 UTC m=+298.653537492" watchObservedRunningTime="2026-07-20 19:27:29.151032421 +0000 UTC m=+298.654352890" Jul 20 19:27:29.221060 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.221007 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" podStartSLOduration=2.9085616229999998 podStartE2EDuration="7.220985304s" totalImagesPullingTime="4.312423681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:29.19533562 +0000 UTC m=+298.698656091" watchObservedRunningTime="2026-07-20 19:27:29.220985304 +0000 UTC m=+298.724305773" Jul 20 19:27:29.221060 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.221040 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" podUID="f96b7e93-9184-4239-baf1-2bfe04c0cc5d" containerName="registry" containerID="cri-o://6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7" gracePeriod=30 Jul 20 19:27:29.222068 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.222025 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-vl2wq" podStartSLOduration=7.93749315 podStartE2EDuration="12.222013535s" totalImagesPullingTime="4.284520385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:29.219986409 +0000 UTC m=+298.723306890" watchObservedRunningTime="2026-07-20 19:27:29.222013535 +0000 UTC m=+298.725334005" Jul 20 19:27:29.527138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.527115 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:27:29.598635 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.598603 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-bound-sa-token\") pod \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " Jul 20 19:27:29.598806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.598655 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") pod \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " Jul 20 19:27:29.598806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.598687 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-trusted-ca\") pod \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " Jul 20 19:27:29.598806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.598721 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-certificates\") pod \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " Jul 20 19:27:29.599114 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.599031 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-ca-trust-extracted\") pod \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " Jul 20 19:27:29.599114 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.599092 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f96b7e93-9184-4239-baf1-2bfe04c0cc5d" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:27:29.599245 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.599102 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-image-registry-private-configuration\") pod \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " Jul 20 19:27:29.599245 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.599130 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f96b7e93-9184-4239-baf1-2bfe04c0cc5d" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:27:29.599245 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.599183 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-installation-pull-secrets\") pod \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " Jul 20 19:27:29.599245 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.599220 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5s6k\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-kube-api-access-x5s6k\") pod \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\" (UID: \"f96b7e93-9184-4239-baf1-2bfe04c0cc5d\") " Jul 20 19:27:29.599749 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.599526 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-certificates\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:27:29.599749 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.599549 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-trusted-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:27:29.601968 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.601919 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f96b7e93-9184-4239-baf1-2bfe04c0cc5d" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:27:29.601968 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.601958 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f96b7e93-9184-4239-baf1-2bfe04c0cc5d" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:27:29.602220 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.602194 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f96b7e93-9184-4239-baf1-2bfe04c0cc5d" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:27:29.602951 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.602928 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f96b7e93-9184-4239-baf1-2bfe04c0cc5d" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:27:29.603406 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.603355 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-kube-api-access-x5s6k" (OuterVolumeSpecName: "kube-api-access-x5s6k") pod "f96b7e93-9184-4239-baf1-2bfe04c0cc5d" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d"). InnerVolumeSpecName "kube-api-access-x5s6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:27:29.608791 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.608757 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f96b7e93-9184-4239-baf1-2bfe04c0cc5d" (UID: "f96b7e93-9184-4239-baf1-2bfe04c0cc5d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:27:29.700827 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.700793 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-ca-trust-extracted\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:27:29.700827 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.700829 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-image-registry-private-configuration\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:27:29.701050 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.700846 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-installation-pull-secrets\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:27:29.701050 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.700860 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5s6k\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-kube-api-access-x5s6k\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:27:29.701050 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.700874 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-bound-sa-token\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:27:29.701050 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:29.700885 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f96b7e93-9184-4239-baf1-2bfe04c0cc5d-registry-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:27:30.141555 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.141514 2561 generic.go:356] "Generic (PLEG): container finished" podID="f96b7e93-9184-4239-baf1-2bfe04c0cc5d" containerID="6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7" exitCode=0 Jul 20 19:27:30.142128 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.141569 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" Jul 20 19:27:30.142128 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.141612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" event={"ID":"f96b7e93-9184-4239-baf1-2bfe04c0cc5d","Type":"ContainerDied","Data":"6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7"} Jul 20 19:27:30.142128 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.141683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69d7f454b9-9t5f7" event={"ID":"f96b7e93-9184-4239-baf1-2bfe04c0cc5d","Type":"ContainerDied","Data":"fae3d9594ca23918cca64332b2126db901bfcc16acef83ccf969dfaa08460710"} Jul 20 19:27:30.142128 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.141717 2561 scope.go:117] "RemoveContainer" containerID="6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7" Jul 20 19:27:30.144520 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.144426 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcx89" event={"ID":"574698ea-00e6-4932-a5a7-6a0bce0ad0b8","Type":"ContainerStarted","Data":"6f4c26241a8a4af111cb63937802d0262555497f95edb3c4eae66250b44bbc24"} Jul 20 19:27:30.144520 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.144484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcx89" event={"ID":"574698ea-00e6-4932-a5a7-6a0bce0ad0b8","Type":"ContainerStarted","Data":"dae18abcf4878b7722e7d5eb944e5e933990be50cce082beb58684fddbdf8af4"} Jul 20 19:27:30.153197 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.153171 2561 scope.go:117] "RemoveContainer" containerID="6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7" Jul 20 19:27:30.153696 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:27:30.153662 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7\": container with ID starting with 6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7 not found: ID does not exist" containerID="6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7" Jul 20 19:27:30.153799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.153716 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7"} err="failed to get container status \"6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7\": rpc error: code = NotFound desc = could not find container \"6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7\": container with ID starting with 6f8ed3adf16a00601fa2cb0867c539867876cb42b925a0db63541968efcb4da7 not found: ID does not exist" Jul 20 19:27:30.181666 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.181615 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vcx89" podStartSLOduration=8.583846248 podStartE2EDuration="13.181598922s" totalImagesPullingTime="4.468446173s" totalInitContainerRuntime="129.306501ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:30.177790801 +0000 UTC m=+299.681111311" watchObservedRunningTime="2026-07-20 19:27:30.181598922 +0000 UTC m=+299.684919391" Jul 20 19:27:30.199165 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.199138 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69d7f454b9-9t5f7"] Jul 20 19:27:30.204838 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:30.204801 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69d7f454b9-9t5f7"] Jul 20 19:27:31.064922 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:31.064865 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f96b7e93-9184-4239-baf1-2bfe04c0cc5d" path="/var/lib/kubelet/pods/f96b7e93-9184-4239-baf1-2bfe04c0cc5d/volumes" Jul 20 19:27:31.342755 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:31.342732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:27:31.343182 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:31.342732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:27:31.348320 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:31.348299 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:27:31.348478 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:31.348366 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:27:31.356213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:31.356195 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 19:27:32.158269 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:32.158235 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c6beb84-639a-48f0-9369-6fe7b238c248","Type":"ContainerStarted","Data":"1144e2e34acf1a172ac1e413af28b7034470d1b2ad9750034bdb5e63fa99ab4a"} Jul 20 19:27:32.158426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:32.158349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c6beb84-639a-48f0-9369-6fe7b238c248","Type":"ContainerStarted","Data":"15d5b54a75b1927983c876af1284bad5b0ad7049fcc34a13d528216998c43ef5"} Jul 20 19:27:32.158426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:32.158407 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c6beb84-639a-48f0-9369-6fe7b238c248","Type":"ContainerStarted","Data":"b88451eb3686e204cc830f4ab736f5afce686436d4dad74a85b1b998d6359aa4"} Jul 20 19:27:32.396815 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:32.396793 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:27:33.060512 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:33.060480 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:33.160025 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:33.159991 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:33.166794 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:33.166765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c6beb84-639a-48f0-9369-6fe7b238c248","Type":"ContainerStarted","Data":"4bfd49f1431c4a9fb1fcedf93f7e2e65d6a8809dde0a586452b7c7b539fb4aa0"} Jul 20 19:27:33.166936 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:33.166832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c6beb84-639a-48f0-9369-6fe7b238c248","Type":"ContainerStarted","Data":"2745477ada5e4524c93a4d1d34963284a5a5e9032c553c26fab917cd62afa696"} Jul 20 19:27:34.178369 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:34.178301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c6beb84-639a-48f0-9369-6fe7b238c248","Type":"ContainerStarted","Data":"e452437e6a0ea9946b551143c492d989477e04d7f46dd28165d6e5d67f850563"} Jul 20 19:27:34.207946 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:34.207889 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.825313886 podStartE2EDuration="15.207869853s" totalImagesPullingTime="8.359751273s" totalInitContainerRuntime="22.804694ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:34.20698635 +0000 UTC m=+303.710306837" watchObservedRunningTime="2026-07-20 19:27:34.207869853 +0000 UTC m=+303.711190323" Jul 20 19:27:35.645789 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:35.645755 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:35.731013 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:35.730982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:36.869576 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:36.869531 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:36.963155 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:36.963125 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:39.057207 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:39.057174 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:27:39.146561 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:39.146531 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gx9kq" Jul 20 19:27:42.133176 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:42.133138 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:42.196569 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:42.196534 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:42.835366 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:42.835336 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:42.835575 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:42.835414 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:27:43.214765 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:43.214689 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:43.315211 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:43.315134 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:48.294305 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:48.294275 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:48.364556 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:48.364514 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:58.281376 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:58.281343 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:27:58.357771 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:27:58.357740 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:02.840956 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:02.840915 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:28:02.844648 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:02.844619 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-669b987f7b-x4qbz" Jul 20 19:28:06.290538 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:06.290501 2561 generic.go:356] "Generic (PLEG): container finished" podID="0382762c-47aa-476c-9c34-e9b401f3f4f2" containerID="a72a2bac5f0d0ef4c5990e7aad754a17f5192fe981dbda96718a6ae93dff3e8e" exitCode=0 Jul 20 19:28:06.290918 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:06.290576 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hqdlw" event={"ID":"0382762c-47aa-476c-9c34-e9b401f3f4f2","Type":"ContainerDied","Data":"a72a2bac5f0d0ef4c5990e7aad754a17f5192fe981dbda96718a6ae93dff3e8e"} Jul 20 19:28:06.290966 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:06.290923 2561 scope.go:117] "RemoveContainer" containerID="a72a2bac5f0d0ef4c5990e7aad754a17f5192fe981dbda96718a6ae93dff3e8e" Jul 20 19:28:07.296369 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:07.296339 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hqdlw" event={"ID":"0382762c-47aa-476c-9c34-e9b401f3f4f2","Type":"ContainerStarted","Data":"27ed18c635d538d0d1f2e70fc658e0c3161612e506c728e99e701745a9c64bd3"} Jul 20 19:28:27.282901 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:27.282830 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:27.346680 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:27.346648 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:37.310760 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:37.310725 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:37.972942 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:37.972909 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:42.443277 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.443248 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65c8896d4f-r5ht6"] Jul 20 19:28:42.443663 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.443564 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96b7e93-9184-4239-baf1-2bfe04c0cc5d" containerName="registry" Jul 20 19:28:42.443663 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.443575 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96b7e93-9184-4239-baf1-2bfe04c0cc5d" containerName="registry" Jul 20 19:28:42.443663 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.443637 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f96b7e93-9184-4239-baf1-2bfe04c0cc5d" containerName="registry" Jul 20 19:28:42.446329 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.446314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.451349 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.451324 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 20 19:28:42.451349 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.451345 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 20 19:28:42.451574 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.451354 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 20 19:28:42.451766 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.451744 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 20 19:28:42.452739 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.452718 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 20 19:28:42.452859 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.452728 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nzkhc\"" Jul 20 19:28:42.459858 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.459841 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 20 19:28:42.470834 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.470815 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65c8896d4f-r5ht6"] Jul 20 19:28:42.530528 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.530502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-serving-certs-ca-bundle\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.530685 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.530532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-secret-telemeter-client\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.530685 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.530564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-federate-client-tls\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.530685 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.530580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-metrics-client-ca\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.530806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.530681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dn7n\" (UniqueName: \"kubernetes.io/projected/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-kube-api-access-7dn7n\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.530806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.530716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-telemeter-client-tls\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.530806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.530740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.530806 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.530761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.631767 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.631743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dn7n\" (UniqueName: \"kubernetes.io/projected/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-kube-api-access-7dn7n\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.631883 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.631779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-telemeter-client-tls\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.631883 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.631801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.631996 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.631973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.632059 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.632042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-serving-certs-ca-bundle\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.632170 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.632153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-secret-telemeter-client\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.632229 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.632193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-federate-client-tls\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.632229 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.632217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-metrics-client-ca\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.632821 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.632795 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-serving-certs-ca-bundle\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.632997 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.632974 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-metrics-client-ca\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.633114 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.633098 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.634952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.634928 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.635027 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.635011 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-secret-telemeter-client\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.635440 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.635418 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-telemeter-client-tls\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.635535 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.635462 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-federate-client-tls\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.640746 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.640726 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dn7n\" (UniqueName: \"kubernetes.io/projected/58ec8fd3-3166-4dd9-9ee4-86be97d0370c-kube-api-access-7dn7n\") pod \"telemeter-client-65c8896d4f-r5ht6\" (UID: \"58ec8fd3-3166-4dd9-9ee4-86be97d0370c\") " pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.756069 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.756031 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" Jul 20 19:28:42.890872 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.890847 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65c8896d4f-r5ht6"] Jul 20 19:28:42.893489 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:28:42.893455 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ec8fd3_3166_4dd9_9ee4_86be97d0370c.slice/crio-8bc8d9d2bbb235c06028d67c7ba974772981f60b4669e267098ee7c1bb23c096 WatchSource:0}: Error finding container 8bc8d9d2bbb235c06028d67c7ba974772981f60b4669e267098ee7c1bb23c096: Status 404 returned error can't find the container with id 8bc8d9d2bbb235c06028d67c7ba974772981f60b4669e267098ee7c1bb23c096 Jul 20 19:28:42.921443 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:42.921416 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:43.022508 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:43.022441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:43.438156 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:43.438076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" event={"ID":"58ec8fd3-3166-4dd9-9ee4-86be97d0370c","Type":"ContainerStarted","Data":"8bc8d9d2bbb235c06028d67c7ba974772981f60b4669e267098ee7c1bb23c096"} Jul 20 19:28:43.944934 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:43.944899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:28:43.947172 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:43.947155 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347ef3ad-b233-4834-9c93-617b376eafd5-metrics-certs\") pod \"network-metrics-daemon-qdr9c\" (UID: \"347ef3ad-b233-4834-9c93-617b376eafd5\") " pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:28:44.161000 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:44.160970 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gzsbm\"" Jul 20 19:28:44.168406 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:44.168372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdr9c" Jul 20 19:28:44.300942 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:44.300910 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qdr9c"] Jul 20 19:28:44.688294 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:28:44.688266 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347ef3ad_b233_4834_9c93_617b376eafd5.slice/crio-cf81c7db569e9d6faa128e08895251d1ee20fdec8ba6b4b10921d1d741fb7c7c WatchSource:0}: Error finding container cf81c7db569e9d6faa128e08895251d1ee20fdec8ba6b4b10921d1d741fb7c7c: Status 404 returned error can't find the container with id cf81c7db569e9d6faa128e08895251d1ee20fdec8ba6b4b10921d1d741fb7c7c Jul 20 19:28:45.450154 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:45.450115 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" event={"ID":"58ec8fd3-3166-4dd9-9ee4-86be97d0370c","Type":"ContainerStarted","Data":"6f600b5ac3f850f5f5e8f4246a02d8ac99c1729e867e9c8356ec12cfaa693126"} Jul 20 19:28:45.450633 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:45.450178 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" event={"ID":"58ec8fd3-3166-4dd9-9ee4-86be97d0370c","Type":"ContainerStarted","Data":"36f13cf42d8ca0c3d7f892b26e51b9af4f0f14e42da35ab538b97476c1ca0cd5"} Jul 20 19:28:45.450633 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:45.450216 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" event={"ID":"58ec8fd3-3166-4dd9-9ee4-86be97d0370c","Type":"ContainerStarted","Data":"fd9425995f3987323574c6c24c7cd1b4e28f60be9ccfd57f30d1d137572338d3"} Jul 20 19:28:45.451550 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:45.451525 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdr9c" event={"ID":"347ef3ad-b233-4834-9c93-617b376eafd5","Type":"ContainerStarted","Data":"cf81c7db569e9d6faa128e08895251d1ee20fdec8ba6b4b10921d1d741fb7c7c"} Jul 20 19:28:45.478180 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:45.478127 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65c8896d4f-r5ht6" podStartSLOduration=1.655300889 podStartE2EDuration="3.478105446s" totalImagesPullingTime="1.822804557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:45.477572469 +0000 UTC m=+374.980892955" watchObservedRunningTime="2026-07-20 19:28:45.478105446 +0000 UTC m=+374.981425897" Jul 20 19:28:46.234725 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:46.234690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:46.305081 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:46.305051 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:46.456852 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:46.456821 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdr9c" event={"ID":"347ef3ad-b233-4834-9c93-617b376eafd5","Type":"ContainerStarted","Data":"f4345498cf0c6e00a5c85d78fd5e576adbb164db8278ea2580d37099de0f786f"} Jul 20 19:28:46.457234 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:46.456874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdr9c" event={"ID":"347ef3ad-b233-4834-9c93-617b376eafd5","Type":"ContainerStarted","Data":"fd87204a3a5932f9ab1874fd7ee6129c5e8a9e20db821ff2fe9d76e43a6cf668"} Jul 20 19:28:46.474833 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:46.474788 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qdr9c" podStartSLOduration=374.582636795 podStartE2EDuration="6m15.474773974s" totalImagesPullingTime="892.137179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:46.47376546 +0000 UTC m=+375.977085929" watchObservedRunningTime="2026-07-20 19:28:46.474773974 +0000 UTC m=+375.978094445" Jul 20 19:28:46.588951 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:46.588870 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:46.696249 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:46.696223 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:52.544099 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:52.544057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:52.647865 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:52.647827 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:55.091760 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:55.091723 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:55.157457 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:55.157426 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:55.872520 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:55.872482 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:55.971908 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:55.971873 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:28:56.853336 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:28:56.853299 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:04.521655 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:04.521607 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:04.622002 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:04.621966 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:06.049828 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:06.049793 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:06.111864 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:06.111829 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:06.172183 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:06.172144 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:13.235318 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:13.235282 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:13.334468 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:13.334426 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:13.434597 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:13.434560 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:37.536369 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:37.536333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:37.601930 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:37.601895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:46.966531 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:46.966499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:47.099095 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:47.099064 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:29:48.084543 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.084508 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg"] Jul 20 19:29:48.087987 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.087966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.091979 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.091959 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-28vqj\"" Jul 20 19:29:48.093038 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.093020 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 19:29:48.093138 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.093050 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 19:29:48.103770 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.103748 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg"] Jul 20 19:29:48.162789 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.162761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcghf\" (UniqueName: \"kubernetes.io/projected/bd22d9d8-9583-4f83-b853-2083b35c0a24-kube-api-access-pcghf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.162911 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.162805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.162911 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.162894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.264155 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.264109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcghf\" (UniqueName: \"kubernetes.io/projected/bd22d9d8-9583-4f83-b853-2083b35c0a24-kube-api-access-pcghf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.264155 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.264165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.264349 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.264200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.264687 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.264666 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.264735 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.264676 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.272882 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.272851 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcghf\" (UniqueName: \"kubernetes.io/projected/bd22d9d8-9583-4f83-b853-2083b35c0a24-kube-api-access-pcghf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.397216 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.397135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:29:48.523302 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.523278 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg"] Jul 20 19:29:48.525747 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:29:48.525716 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd22d9d8_9583_4f83_b853_2083b35c0a24.slice/crio-608480bd52d0346ceef78a9e668a45275fd2345dcbedd0ff406e6e75ab12f01e WatchSource:0}: Error finding container 608480bd52d0346ceef78a9e668a45275fd2345dcbedd0ff406e6e75ab12f01e: Status 404 returned error can't find the container with id 608480bd52d0346ceef78a9e668a45275fd2345dcbedd0ff406e6e75ab12f01e Jul 20 19:29:48.696415 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:48.696316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" event={"ID":"bd22d9d8-9583-4f83-b853-2083b35c0a24","Type":"ContainerStarted","Data":"608480bd52d0346ceef78a9e668a45275fd2345dcbedd0ff406e6e75ab12f01e"} Jul 20 19:29:54.721867 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:54.721832 2561 generic.go:356] "Generic (PLEG): container finished" podID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerID="a96cbb759246f755c4500b516e9ceac69c623dabdaf49b17aa3dd65bc2f5bd09" exitCode=0 Jul 20 19:29:54.722261 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:54.721920 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" event={"ID":"bd22d9d8-9583-4f83-b853-2083b35c0a24","Type":"ContainerDied","Data":"a96cbb759246f755c4500b516e9ceac69c623dabdaf49b17aa3dd65bc2f5bd09"} Jul 20 19:29:56.731882 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:56.731852 2561 generic.go:356] "Generic (PLEG): container finished" podID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerID="840154f9a7ef9d18d0b34b755380a16912c3f7ed22ef03157e3fa8ae3c3e5da7" exitCode=0 Jul 20 19:29:56.732222 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:29:56.731934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" event={"ID":"bd22d9d8-9583-4f83-b853-2083b35c0a24","Type":"ContainerDied","Data":"840154f9a7ef9d18d0b34b755380a16912c3f7ed22ef03157e3fa8ae3c3e5da7"} Jul 20 19:30:03.767861 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:03.767828 2561 generic.go:356] "Generic (PLEG): container finished" podID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerID="bd283842ba53300d1d6f71fc3ad86c3482d4fc7a7db71cad4b1a9799e6d0fd2b" exitCode=0 Jul 20 19:30:03.768265 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:03.767917 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" event={"ID":"bd22d9d8-9583-4f83-b853-2083b35c0a24","Type":"ContainerDied","Data":"bd283842ba53300d1d6f71fc3ad86c3482d4fc7a7db71cad4b1a9799e6d0fd2b"} Jul 20 19:30:04.898637 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:04.898614 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:30:05.016549 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.016518 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcghf\" (UniqueName: \"kubernetes.io/projected/bd22d9d8-9583-4f83-b853-2083b35c0a24-kube-api-access-pcghf\") pod \"bd22d9d8-9583-4f83-b853-2083b35c0a24\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " Jul 20 19:30:05.016703 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.016576 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-util\") pod \"bd22d9d8-9583-4f83-b853-2083b35c0a24\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " Jul 20 19:30:05.016703 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.016616 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-bundle\") pod \"bd22d9d8-9583-4f83-b853-2083b35c0a24\" (UID: \"bd22d9d8-9583-4f83-b853-2083b35c0a24\") " Jul 20 19:30:05.017269 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.017240 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-bundle" (OuterVolumeSpecName: "bundle") pod "bd22d9d8-9583-4f83-b853-2083b35c0a24" (UID: "bd22d9d8-9583-4f83-b853-2083b35c0a24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:30:05.018701 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.018675 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd22d9d8-9583-4f83-b853-2083b35c0a24-kube-api-access-pcghf" (OuterVolumeSpecName: "kube-api-access-pcghf") pod "bd22d9d8-9583-4f83-b853-2083b35c0a24" (UID: "bd22d9d8-9583-4f83-b853-2083b35c0a24"). InnerVolumeSpecName "kube-api-access-pcghf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:30:05.020602 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.020583 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-util" (OuterVolumeSpecName: "util") pod "bd22d9d8-9583-4f83-b853-2083b35c0a24" (UID: "bd22d9d8-9583-4f83-b853-2083b35c0a24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:30:05.117211 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.117182 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-util\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:05.117314 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.117220 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd22d9d8-9583-4f83-b853-2083b35c0a24-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:05.117314 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.117242 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcghf\" (UniqueName: \"kubernetes.io/projected/bd22d9d8-9583-4f83-b853-2083b35c0a24-kube-api-access-pcghf\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:05.783492 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.783463 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" Jul 20 19:30:05.783492 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.783476 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b7jtg" event={"ID":"bd22d9d8-9583-4f83-b853-2083b35c0a24","Type":"ContainerDied","Data":"608480bd52d0346ceef78a9e668a45275fd2345dcbedd0ff406e6e75ab12f01e"} Jul 20 19:30:05.783692 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:05.783514 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="608480bd52d0346ceef78a9e668a45275fd2345dcbedd0ff406e6e75ab12f01e" Jul 20 19:30:09.113261 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:09.113227 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:10.051554 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:10.051514 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:13.133182 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:13.133147 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:13.372668 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:13.372638 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:16.782474 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.782441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:16.830229 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.830197 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7"] Jul 20 19:30:16.830543 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.830530 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerName="extract" Jul 20 19:30:16.830596 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.830545 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerName="extract" Jul 20 19:30:16.830596 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.830553 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerName="pull" Jul 20 19:30:16.830596 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.830558 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerName="pull" Jul 20 19:30:16.830596 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.830568 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerName="util" Jul 20 19:30:16.830596 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.830574 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerName="util" Jul 20 19:30:16.830740 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.830622 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd22d9d8-9583-4f83-b853-2083b35c0a24" containerName="extract" Jul 20 19:30:16.872305 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.872280 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7"] Jul 20 19:30:16.872446 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.872370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:16.877504 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.877484 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 19:30:16.877671 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.877657 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 19:30:16.877742 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.877678 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-28vqj\"" Jul 20 19:30:16.936142 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:16.936100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:17.011050 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.011017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdt87\" (UniqueName: \"kubernetes.io/projected/33b85b9d-0344-4bbf-95c3-a2ee25c15062-kube-api-access-pdt87\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.011205 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.011065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.011205 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.011097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.112352 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.112284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdt87\" (UniqueName: \"kubernetes.io/projected/33b85b9d-0344-4bbf-95c3-a2ee25c15062-kube-api-access-pdt87\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.112352 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.112324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.112546 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.112354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.112667 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.112648 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.112729 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.112702 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.146979 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.146956 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdt87\" (UniqueName: \"kubernetes.io/projected/33b85b9d-0344-4bbf-95c3-a2ee25c15062-kube-api-access-pdt87\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.181824 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.181804 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:17.260945 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.260892 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bx2qz"] Jul 20 19:30:17.264012 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.263991 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:17.268119 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.268097 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 19:30:17.268247 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.268158 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 19:30:17.268247 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.268097 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tjxd4\"" Jul 20 19:30:17.285651 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.285627 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bx2qz"] Jul 20 19:30:17.360530 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:30:17.360503 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b85b9d_0344_4bbf_95c3_a2ee25c15062.slice/crio-ea05c1e13e798f99c2ada587f9b27be51498f2840c380cc6e8de7676780ba5d7 WatchSource:0}: Error finding container ea05c1e13e798f99c2ada587f9b27be51498f2840c380cc6e8de7676780ba5d7: Status 404 returned error can't find the container with id ea05c1e13e798f99c2ada587f9b27be51498f2840c380cc6e8de7676780ba5d7 Jul 20 19:30:17.361471 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.361278 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7"] Jul 20 19:30:17.414540 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.414520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324a91ef-fe5c-454a-a26a-cae0df4ccbc6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bx2qz\" (UID: \"324a91ef-fe5c-454a-a26a-cae0df4ccbc6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:17.414636 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.414555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpjts\" (UniqueName: \"kubernetes.io/projected/324a91ef-fe5c-454a-a26a-cae0df4ccbc6-kube-api-access-qpjts\") pod \"cert-manager-webhook-6486ffd997-bx2qz\" (UID: \"324a91ef-fe5c-454a-a26a-cae0df4ccbc6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:17.515603 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.515571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324a91ef-fe5c-454a-a26a-cae0df4ccbc6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bx2qz\" (UID: \"324a91ef-fe5c-454a-a26a-cae0df4ccbc6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:17.515737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.515618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpjts\" (UniqueName: \"kubernetes.io/projected/324a91ef-fe5c-454a-a26a-cae0df4ccbc6-kube-api-access-qpjts\") pod \"cert-manager-webhook-6486ffd997-bx2qz\" (UID: \"324a91ef-fe5c-454a-a26a-cae0df4ccbc6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:17.525461 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.525434 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324a91ef-fe5c-454a-a26a-cae0df4ccbc6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bx2qz\" (UID: \"324a91ef-fe5c-454a-a26a-cae0df4ccbc6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:17.525638 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.525618 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpjts\" (UniqueName: \"kubernetes.io/projected/324a91ef-fe5c-454a-a26a-cae0df4ccbc6-kube-api-access-qpjts\") pod \"cert-manager-webhook-6486ffd997-bx2qz\" (UID: \"324a91ef-fe5c-454a-a26a-cae0df4ccbc6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:17.573528 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.573505 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:17.707475 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.707453 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bx2qz"] Jul 20 19:30:17.709797 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:30:17.709770 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod324a91ef_fe5c_454a_a26a_cae0df4ccbc6.slice/crio-a70c77c7fd34b770d9333f53be90516bcbdd95a94045441e32ccb3b6a25f1350 WatchSource:0}: Error finding container a70c77c7fd34b770d9333f53be90516bcbdd95a94045441e32ccb3b6a25f1350: Status 404 returned error can't find the container with id a70c77c7fd34b770d9333f53be90516bcbdd95a94045441e32ccb3b6a25f1350 Jul 20 19:30:17.832072 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.832041 2561 generic.go:356] "Generic (PLEG): container finished" podID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerID="3aa0e202927d130a8d3168b509bbbcd7beec26b5be8052431d5aafdc02ab94d8" exitCode=0 Jul 20 19:30:17.832475 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.832126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" event={"ID":"33b85b9d-0344-4bbf-95c3-a2ee25c15062","Type":"ContainerDied","Data":"3aa0e202927d130a8d3168b509bbbcd7beec26b5be8052431d5aafdc02ab94d8"} Jul 20 19:30:17.832475 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.832190 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" event={"ID":"33b85b9d-0344-4bbf-95c3-a2ee25c15062","Type":"ContainerStarted","Data":"ea05c1e13e798f99c2ada587f9b27be51498f2840c380cc6e8de7676780ba5d7"} Jul 20 19:30:17.833350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:17.833328 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" event={"ID":"324a91ef-fe5c-454a-a26a-cae0df4ccbc6","Type":"ContainerStarted","Data":"a70c77c7fd34b770d9333f53be90516bcbdd95a94045441e32ccb3b6a25f1350"} Jul 20 19:30:18.645012 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:18.644981 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:18.809168 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:18.809127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:18.910341 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:18.910129 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:19.056590 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.056489 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-whs2n"] Jul 20 19:30:19.059533 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.059058 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" Jul 20 19:30:19.062658 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.062634 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-99cdc\"" Jul 20 19:30:19.071711 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.071687 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-whs2n"] Jul 20 19:30:19.231988 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.231957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjzff\" (UniqueName: \"kubernetes.io/projected/4a4cd6f1-a3c8-48b4-9563-e83462e93d7f-kube-api-access-gjzff\") pod \"cert-manager-cainjector-559cdd8c87-whs2n\" (UID: \"4a4cd6f1-a3c8-48b4-9563-e83462e93d7f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" Jul 20 19:30:19.232162 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.231995 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a4cd6f1-a3c8-48b4-9563-e83462e93d7f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-whs2n\" (UID: \"4a4cd6f1-a3c8-48b4-9563-e83462e93d7f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" Jul 20 19:30:19.332865 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.332826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjzff\" (UniqueName: \"kubernetes.io/projected/4a4cd6f1-a3c8-48b4-9563-e83462e93d7f-kube-api-access-gjzff\") pod \"cert-manager-cainjector-559cdd8c87-whs2n\" (UID: \"4a4cd6f1-a3c8-48b4-9563-e83462e93d7f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" Jul 20 19:30:19.333038 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.332889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a4cd6f1-a3c8-48b4-9563-e83462e93d7f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-whs2n\" (UID: \"4a4cd6f1-a3c8-48b4-9563-e83462e93d7f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" Jul 20 19:30:19.342072 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.342042 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a4cd6f1-a3c8-48b4-9563-e83462e93d7f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-whs2n\" (UID: \"4a4cd6f1-a3c8-48b4-9563-e83462e93d7f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" Jul 20 19:30:19.342220 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.342165 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjzff\" (UniqueName: \"kubernetes.io/projected/4a4cd6f1-a3c8-48b4-9563-e83462e93d7f-kube-api-access-gjzff\") pod \"cert-manager-cainjector-559cdd8c87-whs2n\" (UID: \"4a4cd6f1-a3c8-48b4-9563-e83462e93d7f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" Jul 20 19:30:19.372051 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:19.372029 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" Jul 20 19:30:20.954442 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:20.954405 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-whs2n"] Jul 20 19:30:20.957037 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:30:20.957009 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a4cd6f1_a3c8_48b4_9563_e83462e93d7f.slice/crio-b1fa70476a4b873b1ecc1d837053141259161a758869ff5e520575314da24503 WatchSource:0}: Error finding container b1fa70476a4b873b1ecc1d837053141259161a758869ff5e520575314da24503: Status 404 returned error can't find the container with id b1fa70476a4b873b1ecc1d837053141259161a758869ff5e520575314da24503 Jul 20 19:30:21.856067 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:21.856034 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" event={"ID":"4a4cd6f1-a3c8-48b4-9563-e83462e93d7f","Type":"ContainerStarted","Data":"039575d34fcf4399b9a77756c52c961a89b8eebb0641eb486df493dfb231593e"} Jul 20 19:30:21.856067 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:21.856078 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" event={"ID":"4a4cd6f1-a3c8-48b4-9563-e83462e93d7f","Type":"ContainerStarted","Data":"b1fa70476a4b873b1ecc1d837053141259161a758869ff5e520575314da24503"} Jul 20 19:30:21.858017 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:21.857979 2561 generic.go:356] "Generic (PLEG): container finished" podID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerID="dedef6a00a2ab1d69a1f28265da7d9ca87d3ab6509a3e6dd23e7ba3f29da9ed0" exitCode=0 Jul 20 19:30:21.858135 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:21.858051 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" event={"ID":"33b85b9d-0344-4bbf-95c3-a2ee25c15062","Type":"ContainerDied","Data":"dedef6a00a2ab1d69a1f28265da7d9ca87d3ab6509a3e6dd23e7ba3f29da9ed0"} Jul 20 19:30:21.859581 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:21.859558 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" event={"ID":"324a91ef-fe5c-454a-a26a-cae0df4ccbc6","Type":"ContainerStarted","Data":"abea6783e53df3d893c93f158349ed4452fc924096024cf24f3a8cd7cb35c444"} Jul 20 19:30:21.859707 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:21.859670 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:21.924933 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:21.924886 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-whs2n" podStartSLOduration=2.924870239 podStartE2EDuration="2.924870239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:30:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:30:21.889722898 +0000 UTC m=+471.393043365" watchObservedRunningTime="2026-07-20 19:30:21.924870239 +0000 UTC m=+471.428190716" Jul 20 19:30:21.950780 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:21.950733 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" podStartSLOduration=1.845179918 podStartE2EDuration="4.950716201s" totalImagesPullingTime="3.105536283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:30:21.949170348 +0000 UTC m=+471.452490839" watchObservedRunningTime="2026-07-20 19:30:21.950716201 +0000 UTC m=+471.454036667" Jul 20 19:30:22.865433 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:22.865399 2561 generic.go:356] "Generic (PLEG): container finished" podID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerID="e108fd9ced2101b6099ec61a2c058de5edffe68fb2d6b321021597da439fc698" exitCode=0 Jul 20 19:30:22.865824 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:22.865484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" event={"ID":"33b85b9d-0344-4bbf-95c3-a2ee25c15062","Type":"ContainerDied","Data":"e108fd9ced2101b6099ec61a2c058de5edffe68fb2d6b321021597da439fc698"} Jul 20 19:30:23.995581 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:23.995557 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:24.170673 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.170593 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdt87\" (UniqueName: \"kubernetes.io/projected/33b85b9d-0344-4bbf-95c3-a2ee25c15062-kube-api-access-pdt87\") pod \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " Jul 20 19:30:24.170673 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.170666 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-util\") pod \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " Jul 20 19:30:24.170883 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.170730 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-bundle\") pod \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\" (UID: \"33b85b9d-0344-4bbf-95c3-a2ee25c15062\") " Jul 20 19:30:24.171107 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.171081 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-bundle" (OuterVolumeSpecName: "bundle") pod "33b85b9d-0344-4bbf-95c3-a2ee25c15062" (UID: "33b85b9d-0344-4bbf-95c3-a2ee25c15062"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:30:24.172701 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.172674 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b85b9d-0344-4bbf-95c3-a2ee25c15062-kube-api-access-pdt87" (OuterVolumeSpecName: "kube-api-access-pdt87") pod "33b85b9d-0344-4bbf-95c3-a2ee25c15062" (UID: "33b85b9d-0344-4bbf-95c3-a2ee25c15062"). InnerVolumeSpecName "kube-api-access-pdt87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:30:24.175136 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.175107 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-util" (OuterVolumeSpecName: "util") pod "33b85b9d-0344-4bbf-95c3-a2ee25c15062" (UID: "33b85b9d-0344-4bbf-95c3-a2ee25c15062"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:30:24.271451 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.271411 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-util\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:24.271451 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.271448 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33b85b9d-0344-4bbf-95c3-a2ee25c15062-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:24.271599 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.271457 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdt87\" (UniqueName: \"kubernetes.io/projected/33b85b9d-0344-4bbf-95c3-a2ee25c15062-kube-api-access-pdt87\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:24.874290 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.874258 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" event={"ID":"33b85b9d-0344-4bbf-95c3-a2ee25c15062","Type":"ContainerDied","Data":"ea05c1e13e798f99c2ada587f9b27be51498f2840c380cc6e8de7676780ba5d7"} Jul 20 19:30:24.874466 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.874305 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea05c1e13e798f99c2ada587f9b27be51498f2840c380cc6e8de7676780ba5d7" Jul 20 19:30:24.874466 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:24.874304 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsfbq7" Jul 20 19:30:25.807246 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:25.807213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:27.868066 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:27.868037 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bx2qz" Jul 20 19:30:28.551737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:28.551708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:28.670224 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:28.670195 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:29.894450 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.894417 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv"] Jul 20 19:30:29.894818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.894701 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerName="pull" Jul 20 19:30:29.894818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.894711 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerName="pull" Jul 20 19:30:29.894818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.894727 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerName="util" Jul 20 19:30:29.894818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.894732 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerName="util" Jul 20 19:30:29.894818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.894746 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerName="extract" Jul 20 19:30:29.894818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.894752 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerName="extract" Jul 20 19:30:29.894818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.894801 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b85b9d-0344-4bbf-95c3-a2ee25c15062" containerName="extract" Jul 20 19:30:29.896719 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.896701 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" Jul 20 19:30:29.899687 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.899659 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 19:30:29.899833 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.899805 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:30:29.900883 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.900866 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-z96jp\"" Jul 20 19:30:29.906963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:29.906943 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv"] Jul 20 19:30:30.016012 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.015978 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb583ab9-b29b-4189-ba27-91ec86a3ad52-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zjplv\" (UID: \"bb583ab9-b29b-4189-ba27-91ec86a3ad52\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" Jul 20 19:30:30.016153 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.016060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjjx\" (UniqueName: \"kubernetes.io/projected/bb583ab9-b29b-4189-ba27-91ec86a3ad52-kube-api-access-tpjjx\") pod \"openshift-lws-operator-fd8ccff4c-zjplv\" (UID: \"bb583ab9-b29b-4189-ba27-91ec86a3ad52\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" Jul 20 19:30:30.117122 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.117088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb583ab9-b29b-4189-ba27-91ec86a3ad52-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zjplv\" (UID: \"bb583ab9-b29b-4189-ba27-91ec86a3ad52\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" Jul 20 19:30:30.117244 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.117159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjjx\" (UniqueName: \"kubernetes.io/projected/bb583ab9-b29b-4189-ba27-91ec86a3ad52-kube-api-access-tpjjx\") pod \"openshift-lws-operator-fd8ccff4c-zjplv\" (UID: \"bb583ab9-b29b-4189-ba27-91ec86a3ad52\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" Jul 20 19:30:30.117508 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.117488 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb583ab9-b29b-4189-ba27-91ec86a3ad52-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zjplv\" (UID: \"bb583ab9-b29b-4189-ba27-91ec86a3ad52\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" Jul 20 19:30:30.125948 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.125921 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjjx\" (UniqueName: \"kubernetes.io/projected/bb583ab9-b29b-4189-ba27-91ec86a3ad52-kube-api-access-tpjjx\") pod \"openshift-lws-operator-fd8ccff4c-zjplv\" (UID: \"bb583ab9-b29b-4189-ba27-91ec86a3ad52\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" Jul 20 19:30:30.206164 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.206089 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" Jul 20 19:30:30.334510 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.334489 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv"] Jul 20 19:30:30.337375 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:30:30.337345 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb583ab9_b29b_4189_ba27_91ec86a3ad52.slice/crio-5d2e26e0bc03319999cc179ebc4c075e7274f61dd20946cb112cd6dab58afbe0 WatchSource:0}: Error finding container 5d2e26e0bc03319999cc179ebc4c075e7274f61dd20946cb112cd6dab58afbe0: Status 404 returned error can't find the container with id 5d2e26e0bc03319999cc179ebc4c075e7274f61dd20946cb112cd6dab58afbe0 Jul 20 19:30:30.898316 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:30.898288 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" event={"ID":"bb583ab9-b29b-4189-ba27-91ec86a3ad52","Type":"ContainerStarted","Data":"5d2e26e0bc03319999cc179ebc4c075e7274f61dd20946cb112cd6dab58afbe0"} Jul 20 19:30:32.910511 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:32.910478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" event={"ID":"bb583ab9-b29b-4189-ba27-91ec86a3ad52","Type":"ContainerStarted","Data":"07a64ef2b6bec4a04915cd66828b40733ec12204f6f005157bf42db08105bf7a"} Jul 20 19:30:32.926662 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:32.926606 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zjplv" podStartSLOduration=2.05811852 podStartE2EDuration="3.926586667s" totalImagesPullingTime="1.868468147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:30:32.925094888 +0000 UTC m=+482.428415357" watchObservedRunningTime="2026-07-20 19:30:32.926586667 +0000 UTC m=+482.429907136" Jul 20 19:30:33.641672 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:33.641636 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:33.742731 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:33.742703 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:35.622079 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.622022 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:35.641510 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.641483 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7"] Jul 20 19:30:35.643895 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.643878 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.646807 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.646787 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 19:30:35.646905 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.646787 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 19:30:35.647975 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.647958 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-28vqj\"" Jul 20 19:30:35.658829 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.658798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hft4\" (UniqueName: \"kubernetes.io/projected/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-kube-api-access-2hft4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.658933 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.658916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.658985 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.658962 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.659532 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.659514 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7"] Jul 20 19:30:35.759967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.759936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hft4\" (UniqueName: \"kubernetes.io/projected/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-kube-api-access-2hft4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.760097 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.760035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.760097 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.760077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.760409 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.760363 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.760488 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.760429 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.773073 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.773052 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hft4\" (UniqueName: \"kubernetes.io/projected/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-kube-api-access-2hft4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:35.954057 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:35.954000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:36.081124 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:36.081099 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7"] Jul 20 19:30:36.083038 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:30:36.083008 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b90f263_4e1f_46d5_9ff4_e613fbd8d149.slice/crio-3af6dcb1f17177a9f30ca0e35c4714f8d909c0609069688ab226f95346a55c05 WatchSource:0}: Error finding container 3af6dcb1f17177a9f30ca0e35c4714f8d909c0609069688ab226f95346a55c05: Status 404 returned error can't find the container with id 3af6dcb1f17177a9f30ca0e35c4714f8d909c0609069688ab226f95346a55c05 Jul 20 19:30:36.929668 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:36.929634 2561 generic.go:356] "Generic (PLEG): container finished" podID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerID="794c3d17986946fd2ed154f54e052cfa576f26370f642d6c83fc65338bb57e91" exitCode=0 Jul 20 19:30:36.930090 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:36.929693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" event={"ID":"7b90f263-4e1f-46d5-9ff4-e613fbd8d149","Type":"ContainerDied","Data":"794c3d17986946fd2ed154f54e052cfa576f26370f642d6c83fc65338bb57e91"} Jul 20 19:30:36.930090 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:36.929746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" event={"ID":"7b90f263-4e1f-46d5-9ff4-e613fbd8d149","Type":"ContainerStarted","Data":"3af6dcb1f17177a9f30ca0e35c4714f8d909c0609069688ab226f95346a55c05"} Jul 20 19:30:37.935587 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:37.935558 2561 generic.go:356] "Generic (PLEG): container finished" podID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerID="b3e7f44409bf1dbad841caddfacf4c8ea100abf423f943a14924ef9580d37559" exitCode=0 Jul 20 19:30:37.935896 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:37.935604 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" event={"ID":"7b90f263-4e1f-46d5-9ff4-e613fbd8d149","Type":"ContainerDied","Data":"b3e7f44409bf1dbad841caddfacf4c8ea100abf423f943a14924ef9580d37559"} Jul 20 19:30:38.941907 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:38.941878 2561 generic.go:356] "Generic (PLEG): container finished" podID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerID="fb736bbe9ba5d31f166ecd864fa8955e2d81b7755a698c4bb6d5393b51304908" exitCode=0 Jul 20 19:30:38.942260 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:38.941960 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" event={"ID":"7b90f263-4e1f-46d5-9ff4-e613fbd8d149","Type":"ContainerDied","Data":"fb736bbe9ba5d31f166ecd864fa8955e2d81b7755a698c4bb6d5393b51304908"} Jul 20 19:30:40.074400 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.074364 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:40.089701 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.089679 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-bundle\") pod \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " Jul 20 19:30:40.089783 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.089741 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hft4\" (UniqueName: \"kubernetes.io/projected/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-kube-api-access-2hft4\") pod \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " Jul 20 19:30:40.089842 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.089790 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-util\") pod \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\" (UID: \"7b90f263-4e1f-46d5-9ff4-e613fbd8d149\") " Jul 20 19:30:40.091079 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.091044 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-bundle" (OuterVolumeSpecName: "bundle") pod "7b90f263-4e1f-46d5-9ff4-e613fbd8d149" (UID: "7b90f263-4e1f-46d5-9ff4-e613fbd8d149"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:30:40.092184 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.092153 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-kube-api-access-2hft4" (OuterVolumeSpecName: "kube-api-access-2hft4") pod "7b90f263-4e1f-46d5-9ff4-e613fbd8d149" (UID: "7b90f263-4e1f-46d5-9ff4-e613fbd8d149"). InnerVolumeSpecName "kube-api-access-2hft4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:30:40.096326 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.096299 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-util" (OuterVolumeSpecName: "util") pod "7b90f263-4e1f-46d5-9ff4-e613fbd8d149" (UID: "7b90f263-4e1f-46d5-9ff4-e613fbd8d149"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:30:40.190299 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.190246 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-util\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:40.190299 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.190294 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:40.190299 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.190305 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hft4\" (UniqueName: \"kubernetes.io/projected/7b90f263-4e1f-46d5-9ff4-e613fbd8d149-kube-api-access-2hft4\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:30:40.952735 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.952706 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" Jul 20 19:30:40.952892 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.952745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5dlb7" event={"ID":"7b90f263-4e1f-46d5-9ff4-e613fbd8d149","Type":"ContainerDied","Data":"3af6dcb1f17177a9f30ca0e35c4714f8d909c0609069688ab226f95346a55c05"} Jul 20 19:30:40.952892 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:40.952797 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3af6dcb1f17177a9f30ca0e35c4714f8d909c0609069688ab226f95346a55c05" Jul 20 19:30:45.974135 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:45.974094 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:46.075143 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:46.075113 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:47.102444 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.102416 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:47.197370 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.197337 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:47.674678 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.674639 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:47.830456 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.830429 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:47.967502 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.967420 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:47.992327 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.992292 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5"] Jul 20 19:30:47.992668 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.992651 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerName="extract" Jul 20 19:30:47.992750 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.992671 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerName="extract" Jul 20 19:30:47.992750 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.992708 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerName="pull" Jul 20 19:30:47.992750 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.992717 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerName="pull" Jul 20 19:30:47.992750 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.992730 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerName="util" Jul 20 19:30:47.992750 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.992739 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerName="util" Jul 20 19:30:47.992991 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.992821 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b90f263-4e1f-46d5-9ff4-e613fbd8d149" containerName="extract" Jul 20 19:30:47.995502 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.995483 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:47.997903 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.997884 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 19:30:47.998015 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.997989 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 19:30:47.999240 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.999211 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 19:30:47.999671 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:47.999653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2kwsn\"" Jul 20 19:30:48.000453 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.000422 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 19:30:48.020074 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.020052 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5"] Jul 20 19:30:48.052215 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.052191 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7170d993-27a7-4ad2-93dd-17110d26e790-manifests\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.052301 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.052221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7170d993-27a7-4ad2-93dd-17110d26e790-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.052301 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.052257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7170d993-27a7-4ad2-93dd-17110d26e790-tmp\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.052301 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.052274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7170d993-27a7-4ad2-93dd-17110d26e790-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.052445 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.052314 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rctqd\" (UniqueName: \"kubernetes.io/projected/7170d993-27a7-4ad2-93dd-17110d26e790-kube-api-access-rctqd\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.153630 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.153607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7170d993-27a7-4ad2-93dd-17110d26e790-manifests\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.153961 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.153637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7170d993-27a7-4ad2-93dd-17110d26e790-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.153961 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.153668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7170d993-27a7-4ad2-93dd-17110d26e790-tmp\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.153961 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.153874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7170d993-27a7-4ad2-93dd-17110d26e790-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.153961 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.153930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rctqd\" (UniqueName: \"kubernetes.io/projected/7170d993-27a7-4ad2-93dd-17110d26e790-kube-api-access-rctqd\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.154173 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.154067 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7170d993-27a7-4ad2-93dd-17110d26e790-manifests\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.155914 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.155888 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7170d993-27a7-4ad2-93dd-17110d26e790-tmp\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.156071 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.156053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7170d993-27a7-4ad2-93dd-17110d26e790-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.156190 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.156164 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7170d993-27a7-4ad2-93dd-17110d26e790-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.168074 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.168054 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rctqd\" (UniqueName: \"kubernetes.io/projected/7170d993-27a7-4ad2-93dd-17110d26e790-kube-api-access-rctqd\") pod \"opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5\" (UID: \"7170d993-27a7-4ad2-93dd-17110d26e790\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.192576 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.192554 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:48.287895 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.287867 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:48.305827 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.305808 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:48.387887 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.387858 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:48.465317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.465293 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5"] Jul 20 19:30:48.466900 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:30:48.466876 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7170d993_27a7_4ad2_93dd_17110d26e790.slice/crio-957a810d15cf100602b45111f735e42e1ce8dcd08d1c6c6ac000de2c3440aa2f WatchSource:0}: Error finding container 957a810d15cf100602b45111f735e42e1ce8dcd08d1c6c6ac000de2c3440aa2f: Status 404 returned error can't find the container with id 957a810d15cf100602b45111f735e42e1ce8dcd08d1c6c6ac000de2c3440aa2f Jul 20 19:30:48.493539 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.493507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:48.591372 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.591308 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:48.705474 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.705443 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:48.993242 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:48.993211 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" event={"ID":"7170d993-27a7-4ad2-93dd-17110d26e790","Type":"ContainerStarted","Data":"957a810d15cf100602b45111f735e42e1ce8dcd08d1c6c6ac000de2c3440aa2f"} Jul 20 19:30:52.011702 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:52.011669 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" event={"ID":"7170d993-27a7-4ad2-93dd-17110d26e790","Type":"ContainerStarted","Data":"93a7c63256d4c795375b1cfece13e2e6effb9a15c497696798c6898de4088eb6"} Jul 20 19:30:53.017305 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:53.017270 2561 generic.go:356] "Generic (PLEG): container finished" podID="7170d993-27a7-4ad2-93dd-17110d26e790" containerID="93a7c63256d4c795375b1cfece13e2e6effb9a15c497696798c6898de4088eb6" exitCode=0 Jul 20 19:30:53.017754 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:53.017354 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" event={"ID":"7170d993-27a7-4ad2-93dd-17110d26e790","Type":"ContainerDied","Data":"93a7c63256d4c795375b1cfece13e2e6effb9a15c497696798c6898de4088eb6"} Jul 20 19:30:54.023943 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:54.023906 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" event={"ID":"7170d993-27a7-4ad2-93dd-17110d26e790","Type":"ContainerStarted","Data":"8052cb81fc2e4a6415463221c978c17b3853cf320d74d0ac5de031fea805f4b3"} Jul 20 19:30:54.024419 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:54.023995 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:30:54.050089 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:54.050047 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" podStartSLOduration=2.5886580439999998 podStartE2EDuration="7.050032635s" totalImagesPullingTime="3.401497523s" totalInitContainerRuntime="1.059877068s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:30:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:30:54.047108533 +0000 UTC m=+503.550429021" watchObservedRunningTime="2026-07-20 19:30:54.050032635 +0000 UTC m=+503.553353103" Jul 20 19:30:57.626898 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:57.626868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:30:57.732513 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:30:57.732477 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:05.030799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:05.030768 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5" Jul 20 19:31:07.014557 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.014520 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:07.135863 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.135831 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:07.525517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.525485 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:07.578935 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.578912 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7"] Jul 20 19:31:07.584430 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.584413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.588649 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.588630 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 20 19:31:07.588649 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.588640 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 19:31:07.589600 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.589581 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 19:31:07.589689 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.589625 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 20 19:31:07.589689 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.589630 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c5d9n\"" Jul 20 19:31:07.597122 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.597100 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7"] Jul 20 19:31:07.683645 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.683618 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:07.713083 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.713058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gmx7\" (UniqueName: \"kubernetes.io/projected/c394aa2c-1834-4d22-a147-2bb6fdab428e-kube-api-access-4gmx7\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.713184 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.713085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c394aa2c-1834-4d22-a147-2bb6fdab428e-tls-certs\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.713184 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.713126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c394aa2c-1834-4d22-a147-2bb6fdab428e-tmp\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.813878 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.813807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c394aa2c-1834-4d22-a147-2bb6fdab428e-tmp\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.814017 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.813878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gmx7\" (UniqueName: \"kubernetes.io/projected/c394aa2c-1834-4d22-a147-2bb6fdab428e-kube-api-access-4gmx7\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.814017 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.813901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c394aa2c-1834-4d22-a147-2bb6fdab428e-tls-certs\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.816433 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.816395 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c394aa2c-1834-4d22-a147-2bb6fdab428e-tls-certs\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.816572 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.816543 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c394aa2c-1834-4d22-a147-2bb6fdab428e-tmp\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.820431 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.820409 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:07.823844 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.823817 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gmx7\" (UniqueName: \"kubernetes.io/projected/c394aa2c-1834-4d22-a147-2bb6fdab428e-kube-api-access-4gmx7\") pod \"kube-auth-proxy-7578c486d7-gs2g7\" (UID: \"c394aa2c-1834-4d22-a147-2bb6fdab428e\") " pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.894312 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.894284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" Jul 20 19:31:07.920657 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:07.920577 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:08.016165 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.016138 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:08.036447 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.036421 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7"] Jul 20 19:31:08.040117 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:31:08.040090 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc394aa2c_1834_4d22_a147_2bb6fdab428e.slice/crio-f0c4c6b3d3a58569c53e442d9057cacbdc8d986aa536f389cef02b64bc59775b WatchSource:0}: Error finding container f0c4c6b3d3a58569c53e442d9057cacbdc8d986aa536f389cef02b64bc59775b: Status 404 returned error can't find the container with id f0c4c6b3d3a58569c53e442d9057cacbdc8d986aa536f389cef02b64bc59775b Jul 20 19:31:08.087453 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.087368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" event={"ID":"c394aa2c-1834-4d22-a147-2bb6fdab428e","Type":"ContainerStarted","Data":"f0c4c6b3d3a58569c53e442d9057cacbdc8d986aa536f389cef02b64bc59775b"} Jul 20 19:31:08.115980 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.115948 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:08.785476 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.785438 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:08.847553 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.847522 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lkl5w"] Jul 20 19:31:08.850368 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.850347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:08.856084 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.856063 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 20 19:31:08.856328 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.856308 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4rpln\"" Jul 20 19:31:08.873349 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.873322 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lkl5w"] Jul 20 19:31:08.923321 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.923291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2fbk\" (UniqueName: \"kubernetes.io/projected/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-kube-api-access-f2fbk\") pod \"model-serving-api-54d89bd5fc-lkl5w\" (UID: \"048bd6bf-d10e-48d4-b63e-ab258f9f7bab\") " pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:08.923471 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:08.923360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-tls-certs\") pod \"model-serving-api-54d89bd5fc-lkl5w\" (UID: \"048bd6bf-d10e-48d4-b63e-ab258f9f7bab\") " pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:09.024131 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.024102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-tls-certs\") pod \"model-serving-api-54d89bd5fc-lkl5w\" (UID: \"048bd6bf-d10e-48d4-b63e-ab258f9f7bab\") " pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:09.024567 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.024172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2fbk\" (UniqueName: \"kubernetes.io/projected/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-kube-api-access-f2fbk\") pod \"model-serving-api-54d89bd5fc-lkl5w\" (UID: \"048bd6bf-d10e-48d4-b63e-ab258f9f7bab\") " pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:09.024567 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:31:09.024250 2561 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 20 19:31:09.024567 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:31:09.024310 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-tls-certs podName:048bd6bf-d10e-48d4-b63e-ab258f9f7bab nodeName:}" failed. No retries permitted until 2026-07-20 19:31:09.524292177 +0000 UTC m=+519.027612626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-tls-certs") pod "model-serving-api-54d89bd5fc-lkl5w" (UID: "048bd6bf-d10e-48d4-b63e-ab258f9f7bab") : secret "model-serving-api-tls" not found Jul 20 19:31:09.039183 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.039119 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2fbk\" (UniqueName: \"kubernetes.io/projected/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-kube-api-access-f2fbk\") pod \"model-serving-api-54d89bd5fc-lkl5w\" (UID: \"048bd6bf-d10e-48d4-b63e-ab258f9f7bab\") " pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:09.056922 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.056888 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-78qzx"] Jul 20 19:31:09.059707 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.059684 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.060757 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.060699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:09.062661 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.062640 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 19:31:09.062661 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.062658 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 19:31:09.063111 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.063093 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 19:31:09.063214 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.063140 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hffrt\"" Jul 20 19:31:09.063394 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.063365 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 19:31:09.075419 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.075395 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-78qzx"] Jul 20 19:31:09.125203 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.125182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-local-certs\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.125313 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.125227 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-token\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.125313 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.125253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-cacerts\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.125313 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.125293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.130764 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.125791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.130764 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.125868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkf55\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-kube-api-access-qkf55\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.130764 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.125943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.135587 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.135565 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:09.226941 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.226917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.227040 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.226951 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkf55\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-kube-api-access-qkf55\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.227094 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.227064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.227137 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.227120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-local-certs\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.227178 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.227169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-token\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.227247 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.227210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-cacerts\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.227247 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.227235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.227775 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.227749 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.229348 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.229327 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-local-certs\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.229472 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.229421 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.229593 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.229572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-cacerts\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.229665 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.229608 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.234990 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.234967 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-token\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.235157 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.235141 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkf55\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-kube-api-access-qkf55\") pod \"istiod-openshift-gateway-7574459656-78qzx\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.332969 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.332890 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:09.370090 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.370066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:09.509220 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.509174 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-78qzx"] Jul 20 19:31:09.511512 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:31:09.511485 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2064f3f_ae20_437a_bd14_4330b4c2bbfd.slice/crio-a0d88924883e248eee25324b6ca1814660aec8ce1dcc1bc3520a2c48ee68b70e WatchSource:0}: Error finding container a0d88924883e248eee25324b6ca1814660aec8ce1dcc1bc3520a2c48ee68b70e: Status 404 returned error can't find the container with id a0d88924883e248eee25324b6ca1814660aec8ce1dcc1bc3520a2c48ee68b70e Jul 20 19:31:09.530900 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.530877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-tls-certs\") pod \"model-serving-api-54d89bd5fc-lkl5w\" (UID: \"048bd6bf-d10e-48d4-b63e-ab258f9f7bab\") " pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:09.533420 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.533401 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/048bd6bf-d10e-48d4-b63e-ab258f9f7bab-tls-certs\") pod \"model-serving-api-54d89bd5fc-lkl5w\" (UID: \"048bd6bf-d10e-48d4-b63e-ab258f9f7bab\") " pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:09.762480 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.762447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:09.906927 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:09.906904 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lkl5w"] Jul 20 19:31:09.909136 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:31:09.909107 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048bd6bf_d10e_48d4_b63e_ab258f9f7bab.slice/crio-9bf4b474908a6adc6287b339c12ec57d5775eb3ecd747d2e8a3a6820269ed02f WatchSource:0}: Error finding container 9bf4b474908a6adc6287b339c12ec57d5775eb3ecd747d2e8a3a6820269ed02f: Status 404 returned error can't find the container with id 9bf4b474908a6adc6287b339c12ec57d5775eb3ecd747d2e8a3a6820269ed02f Jul 20 19:31:10.099911 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:10.099871 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" event={"ID":"048bd6bf-d10e-48d4-b63e-ab258f9f7bab","Type":"ContainerStarted","Data":"9bf4b474908a6adc6287b339c12ec57d5775eb3ecd747d2e8a3a6820269ed02f"} Jul 20 19:31:10.101082 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:10.101060 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" event={"ID":"c2064f3f-ae20-437a-bd14-4330b4c2bbfd","Type":"ContainerStarted","Data":"a0d88924883e248eee25324b6ca1814660aec8ce1dcc1bc3520a2c48ee68b70e"} Jul 20 19:31:10.115461 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:10.115431 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:11.109425 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:11.109366 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" event={"ID":"c394aa2c-1834-4d22-a147-2bb6fdab428e","Type":"ContainerStarted","Data":"fa08fd36f96b06434be6796aee710a1f2412d1a276d31b88db890a2e677e3cab"} Jul 20 19:31:11.130699 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:11.130619 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7578c486d7-gs2g7" podStartSLOduration=1.280788628 podStartE2EDuration="4.130597474s" totalImagesPullingTime="2.849808846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:11.129686794 +0000 UTC m=+520.633007268" watchObservedRunningTime="2026-07-20 19:31:11.130597474 +0000 UTC m=+520.633917981" Jul 20 19:31:13.070503 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:13.070442 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:13.070814 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:13.070531 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:31:13.718259 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:13.718211 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:13.817991 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:13.817956 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:13.971400 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:13.971357 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:14.125686 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.125655 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" event={"ID":"048bd6bf-d10e-48d4-b63e-ab258f9f7bab","Type":"ContainerStarted","Data":"65a9011a02a1d73ae67278bbd4c59b95265219648837b39c47f6504392d26462"} Jul 20 19:31:14.126102 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.125781 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:14.127264 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.127239 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" event={"ID":"c2064f3f-ae20-437a-bd14-4330b4c2bbfd","Type":"ContainerStarted","Data":"04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674"} Jul 20 19:31:14.127424 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.127404 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:14.128775 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.128752 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-78qzx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 19:31:14.128875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.128810 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" podUID="c2064f3f-ae20-437a-bd14-4330b4c2bbfd" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:31:14.147975 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.147936 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" podStartSLOduration=3.004178557 podStartE2EDuration="6.147923948s" totalImagesPullingTime="3.143745391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:14.146414245 +0000 UTC m=+523.649734743" watchObservedRunningTime="2026-07-20 19:31:14.147923948 +0000 UTC m=+523.651244416" Jul 20 19:31:14.165184 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.165135 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" podStartSLOduration=1.608382889 podStartE2EDuration="5.165121432s" totalImagesPullingTime="3.556738543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:14.164265121 +0000 UTC m=+523.667585585" watchObservedRunningTime="2026-07-20 19:31:14.165121432 +0000 UTC m=+523.668441902" Jul 20 19:31:14.274199 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.274096 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:14.379090 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:14.379052 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:15.131819 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:15.131790 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:18.833818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.833785 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:18.901003 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.900969 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd"] Jul 20 19:31:18.904616 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.904595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:18.908552 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.908529 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 20 19:31:18.908662 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.908563 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dfvbv\"" Jul 20 19:31:18.909737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.909720 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg"] Jul 20 19:31:18.912987 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.912972 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:18.915309 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.915291 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-f4vl4\"" Jul 20 19:31:18.915933 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.915918 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 20 19:31:18.921435 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.921410 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd"] Jul 20 19:31:18.925822 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.925799 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg"] Jul 20 19:31:18.952888 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:18.952858 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:19.019086 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.019056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9gm8\" (UniqueName: \"kubernetes.io/projected/9a6c60db-3409-475a-85d6-cc38df04d6d9-kube-api-access-z9gm8\") pod \"llmisvc-controller-manager-777c6bd7d5-5xzhg\" (UID: \"9a6c60db-3409-475a-85d6-cc38df04d6d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:19.019228 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.019091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6c60db-3409-475a-85d6-cc38df04d6d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5xzhg\" (UID: \"9a6c60db-3409-475a-85d6-cc38df04d6d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:19.019228 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.019109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggm4k\" (UniqueName: \"kubernetes.io/projected/7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7-kube-api-access-ggm4k\") pod \"kserve-controller-manager-d6f4b65b8-bfnjd\" (UID: \"7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:19.019228 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.019217 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7-cert\") pod \"kserve-controller-manager-d6f4b65b8-bfnjd\" (UID: \"7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:19.067065 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.067033 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:19.120292 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.120231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9gm8\" (UniqueName: \"kubernetes.io/projected/9a6c60db-3409-475a-85d6-cc38df04d6d9-kube-api-access-z9gm8\") pod \"llmisvc-controller-manager-777c6bd7d5-5xzhg\" (UID: \"9a6c60db-3409-475a-85d6-cc38df04d6d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:19.120292 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.120269 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6c60db-3409-475a-85d6-cc38df04d6d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5xzhg\" (UID: \"9a6c60db-3409-475a-85d6-cc38df04d6d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:19.120292 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.120287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggm4k\" (UniqueName: \"kubernetes.io/projected/7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7-kube-api-access-ggm4k\") pod \"kserve-controller-manager-d6f4b65b8-bfnjd\" (UID: \"7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:19.120565 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.120311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7-cert\") pod \"kserve-controller-manager-d6f4b65b8-bfnjd\" (UID: \"7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:19.120565 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:31:19.120417 2561 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 20 19:31:19.120565 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:31:19.120484 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6c60db-3409-475a-85d6-cc38df04d6d9-cert podName:9a6c60db-3409-475a-85d6-cc38df04d6d9 nodeName:}" failed. No retries permitted until 2026-07-20 19:31:19.620461437 +0000 UTC m=+529.123781890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9a6c60db-3409-475a-85d6-cc38df04d6d9-cert") pod "llmisvc-controller-manager-777c6bd7d5-5xzhg" (UID: "9a6c60db-3409-475a-85d6-cc38df04d6d9") : secret "llmisvc-webhook-server-cert" not found Jul 20 19:31:19.122716 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.122693 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7-cert\") pod \"kserve-controller-manager-d6f4b65b8-bfnjd\" (UID: \"7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:19.133677 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.133657 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggm4k\" (UniqueName: \"kubernetes.io/projected/7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7-kube-api-access-ggm4k\") pod \"kserve-controller-manager-d6f4b65b8-bfnjd\" (UID: \"7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:19.137319 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.137300 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9gm8\" (UniqueName: \"kubernetes.io/projected/9a6c60db-3409-475a-85d6-cc38df04d6d9-kube-api-access-z9gm8\") pod \"llmisvc-controller-manager-777c6bd7d5-5xzhg\" (UID: \"9a6c60db-3409-475a-85d6-cc38df04d6d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:19.215041 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.215006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:19.317829 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.317796 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:19.374212 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.374191 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd"] Jul 20 19:31:19.376710 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:31:19.376683 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd7d89b_b9c2_47f9_8dfa_99f0d7e9b7c7.slice/crio-90e5abf4bc66f19d0367f3c349fa4df003be7d6ee7bcc7fe44c082b50abdbaf8 WatchSource:0}: Error finding container 90e5abf4bc66f19d0367f3c349fa4df003be7d6ee7bcc7fe44c082b50abdbaf8: Status 404 returned error can't find the container with id 90e5abf4bc66f19d0367f3c349fa4df003be7d6ee7bcc7fe44c082b50abdbaf8 Jul 20 19:31:19.624204 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.624119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6c60db-3409-475a-85d6-cc38df04d6d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5xzhg\" (UID: \"9a6c60db-3409-475a-85d6-cc38df04d6d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:19.626424 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.626397 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6c60db-3409-475a-85d6-cc38df04d6d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5xzhg\" (UID: \"9a6c60db-3409-475a-85d6-cc38df04d6d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:19.824009 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.823977 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:19.975243 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:19.975210 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg"] Jul 20 19:31:19.976564 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:31:19.976534 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9a6c60db_3409_475a_85d6_cc38df04d6d9.slice/crio-fb97a3ef04de73f613ac3084892bb8ad3c4eca049ffd3171c2daf53ad0c2e79f WatchSource:0}: Error finding container fb97a3ef04de73f613ac3084892bb8ad3c4eca049ffd3171c2daf53ad0c2e79f: Status 404 returned error can't find the container with id fb97a3ef04de73f613ac3084892bb8ad3c4eca049ffd3171c2daf53ad0c2e79f Jul 20 19:31:20.116145 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:20.116111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:20.162463 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:20.162365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" event={"ID":"9a6c60db-3409-475a-85d6-cc38df04d6d9","Type":"ContainerStarted","Data":"fb97a3ef04de73f613ac3084892bb8ad3c4eca049ffd3171c2daf53ad0c2e79f"} Jul 20 19:31:20.163765 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:20.163736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" event={"ID":"7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7","Type":"ContainerStarted","Data":"90e5abf4bc66f19d0367f3c349fa4df003be7d6ee7bcc7fe44c082b50abdbaf8"} Jul 20 19:31:20.214196 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:20.214169 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:20.327647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:20.327606 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:21.983440 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:21.983408 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-78qzx"] Jul 20 19:31:21.983860 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:21.983573 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" podUID="c2064f3f-ae20-437a-bd14-4330b4c2bbfd" containerName="discovery" containerID="cri-o://04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674" gracePeriod=30 Jul 20 19:31:22.432953 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.432932 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:22.552507 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.552426 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-local-certs\") pod \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " Jul 20 19:31:22.552507 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.552483 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-ca-configmap\") pod \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " Jul 20 19:31:22.552740 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.552557 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkf55\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-kube-api-access-qkf55\") pod \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " Jul 20 19:31:22.552740 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.552659 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-cacerts\") pod \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " Jul 20 19:31:22.552740 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.552720 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-token\") pod \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " Jul 20 19:31:22.552956 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.552790 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-kubeconfig\") pod \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " Jul 20 19:31:22.552956 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.552816 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-dns-cert\") pod \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\" (UID: \"c2064f3f-ae20-437a-bd14-4330b4c2bbfd\") " Jul 20 19:31:22.552956 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.552927 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c2064f3f-ae20-437a-bd14-4330b4c2bbfd" (UID: "c2064f3f-ae20-437a-bd14-4330b4c2bbfd"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:31:22.554653 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.554615 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-ca-configmap\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:31:22.563404 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.562443 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-local-certs" (OuterVolumeSpecName: "local-certs") pod "c2064f3f-ae20-437a-bd14-4330b4c2bbfd" (UID: "c2064f3f-ae20-437a-bd14-4330b4c2bbfd"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:31:22.563404 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.562554 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2064f3f-ae20-437a-bd14-4330b4c2bbfd" (UID: "c2064f3f-ae20-437a-bd14-4330b4c2bbfd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:31:22.563404 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.563168 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-kube-api-access-qkf55" (OuterVolumeSpecName: "kube-api-access-qkf55") pod "c2064f3f-ae20-437a-bd14-4330b4c2bbfd" (UID: "c2064f3f-ae20-437a-bd14-4330b4c2bbfd"). InnerVolumeSpecName "kube-api-access-qkf55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:31:22.565124 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.563674 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c2064f3f-ae20-437a-bd14-4330b4c2bbfd" (UID: "c2064f3f-ae20-437a-bd14-4330b4c2bbfd"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:31:22.568753 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.568589 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-cacerts" (OuterVolumeSpecName: "cacerts") pod "c2064f3f-ae20-437a-bd14-4330b4c2bbfd" (UID: "c2064f3f-ae20-437a-bd14-4330b4c2bbfd"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:31:22.569699 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.569665 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c2064f3f-ae20-437a-bd14-4330b4c2bbfd" (UID: "c2064f3f-ae20-437a-bd14-4330b4c2bbfd"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:31:22.655319 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.655292 2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-local-certs\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:31:22.655319 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.655321 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkf55\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-kube-api-access-qkf55\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:31:22.655529 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.655338 2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-cacerts\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:31:22.655529 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.655353 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-token\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:31:22.655529 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.655364 2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-kubeconfig\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:31:22.655529 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:22.655373 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2064f3f-ae20-437a-bd14-4330b4c2bbfd-istio-csr-dns-cert\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:31:23.181728 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.181700 2561 generic.go:356] "Generic (PLEG): container finished" podID="c2064f3f-ae20-437a-bd14-4330b4c2bbfd" containerID="04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674" exitCode=0 Jul 20 19:31:23.182093 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.181755 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" Jul 20 19:31:23.182093 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.181781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" event={"ID":"c2064f3f-ae20-437a-bd14-4330b4c2bbfd","Type":"ContainerDied","Data":"04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674"} Jul 20 19:31:23.182093 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.181849 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-78qzx" event={"ID":"c2064f3f-ae20-437a-bd14-4330b4c2bbfd","Type":"ContainerDied","Data":"a0d88924883e248eee25324b6ca1814660aec8ce1dcc1bc3520a2c48ee68b70e"} Jul 20 19:31:23.182093 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.181881 2561 scope.go:117] "RemoveContainer" containerID="04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674" Jul 20 19:31:23.183524 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.183503 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" event={"ID":"9a6c60db-3409-475a-85d6-cc38df04d6d9","Type":"ContainerStarted","Data":"7df8c20021a4689c1a652d91f0b136f81b3cac8acce7015f252bc317cd9a5ba1"} Jul 20 19:31:23.183662 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.183647 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:23.185329 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.185305 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" event={"ID":"7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7","Type":"ContainerStarted","Data":"b5d39637fd8ba5bec13d03ab139d671102aa5afd9e5b35ae7a6e9d89d2a7bfcc"} Jul 20 19:31:23.185623 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.185435 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:23.198106 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.198084 2561 scope.go:117] "RemoveContainer" containerID="04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674" Jul 20 19:31:23.198554 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:31:23.198529 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674\": container with ID starting with 04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674 not found: ID does not exist" containerID="04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674" Jul 20 19:31:23.198659 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.198564 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674"} err="failed to get container status \"04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674\": rpc error: code = NotFound desc = could not find container \"04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674\": container with ID starting with 04df544aa88af8d73d32d2317159bc12ad7a694932265faaf7a171c5cb1af674 not found: ID does not exist" Jul 20 19:31:23.200389 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.200358 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-78qzx"] Jul 20 19:31:23.209213 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.209195 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-78qzx"] Jul 20 19:31:23.224039 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.224000 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" podStartSLOduration=2.135597543 podStartE2EDuration="5.22398883s" totalImagesPullingTime="3.088391287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:23.222268985 +0000 UTC m=+532.725589454" watchObservedRunningTime="2026-07-20 19:31:23.22398883 +0000 UTC m=+532.727309298" Jul 20 19:31:23.242983 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.242948 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" podStartSLOduration=2.268409831 podStartE2EDuration="5.242936912s" totalImagesPullingTime="2.974527081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:23.242590871 +0000 UTC m=+532.745911358" watchObservedRunningTime="2026-07-20 19:31:23.242936912 +0000 UTC m=+532.746257362" Jul 20 19:31:23.931128 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.931099 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:23.989875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:23.989847 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:31:25.063994 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:25.063963 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2064f3f-ae20-437a-bd14-4330b4c2bbfd" path="/var/lib/kubelet/pods/c2064f3f-ae20-437a-bd14-4330b4c2bbfd/volumes" Jul 20 19:31:25.135754 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:25.135729 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lkl5w" Jul 20 19:31:54.192894 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:54.192860 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5xzhg" Jul 20 19:31:54.196014 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:54.195992 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bfnjd" Jul 20 19:31:56.944129 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:31:56.944093 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:08.591921 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.591888 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:08.690071 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.690039 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:08.745119 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.745085 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldlpp"] Jul 20 19:32:08.745440 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.745428 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2064f3f-ae20-437a-bd14-4330b4c2bbfd" containerName="discovery" Jul 20 19:32:08.745489 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.745441 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2064f3f-ae20-437a-bd14-4330b4c2bbfd" containerName="discovery" Jul 20 19:32:08.745527 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.745508 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2064f3f-ae20-437a-bd14-4330b4c2bbfd" containerName="discovery" Jul 20 19:32:08.749887 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.749864 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" Jul 20 19:32:08.752606 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.752581 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-n4w75\"" Jul 20 19:32:08.752729 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.752667 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 19:32:08.753551 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.753531 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 19:32:08.760952 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.760926 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldlpp"] Jul 20 19:32:08.790990 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.790959 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:08.838827 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.838797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxxjn\" (UniqueName: \"kubernetes.io/projected/7c6433a4-1503-4025-8cb9-a139389cf0e9-kube-api-access-cxxjn\") pod \"kuadrant-operator-catalog-ldlpp\" (UID: \"7c6433a4-1503-4025-8cb9-a139389cf0e9\") " pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" Jul 20 19:32:08.940308 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.940225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxxjn\" (UniqueName: \"kubernetes.io/projected/7c6433a4-1503-4025-8cb9-a139389cf0e9-kube-api-access-cxxjn\") pod \"kuadrant-operator-catalog-ldlpp\" (UID: \"7c6433a4-1503-4025-8cb9-a139389cf0e9\") " pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" Jul 20 19:32:08.949505 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:08.949477 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxxjn\" (UniqueName: \"kubernetes.io/projected/7c6433a4-1503-4025-8cb9-a139389cf0e9-kube-api-access-cxxjn\") pod \"kuadrant-operator-catalog-ldlpp\" (UID: \"7c6433a4-1503-4025-8cb9-a139389cf0e9\") " pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" Jul 20 19:32:09.059918 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.059873 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" Jul 20 19:32:09.086004 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.085977 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldlpp"] Jul 20 19:32:09.189607 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.189523 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldlpp"] Jul 20 19:32:09.192100 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:09.192024 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6433a4_1503_4025_8cb9_a139389cf0e9.slice/crio-d534908087ec5c66e1c88de70baa6b2686aeff85ee7756a1d94b1676d41e700e WatchSource:0}: Error finding container d534908087ec5c66e1c88de70baa6b2686aeff85ee7756a1d94b1676d41e700e: Status 404 returned error can't find the container with id d534908087ec5c66e1c88de70baa6b2686aeff85ee7756a1d94b1676d41e700e Jul 20 19:32:09.297633 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.297599 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mpr4m"] Jul 20 19:32:09.300870 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.300853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:09.308623 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.308595 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mpr4m"] Jul 20 19:32:09.394537 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.394506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" event={"ID":"7c6433a4-1503-4025-8cb9-a139389cf0e9","Type":"ContainerStarted","Data":"d534908087ec5c66e1c88de70baa6b2686aeff85ee7756a1d94b1676d41e700e"} Jul 20 19:32:09.443996 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.443908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m4gr\" (UniqueName: \"kubernetes.io/projected/b8481f8a-c4fe-427c-bb6c-1e53dea91702-kube-api-access-6m4gr\") pod \"kuadrant-operator-catalog-mpr4m\" (UID: \"b8481f8a-c4fe-427c-bb6c-1e53dea91702\") " pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:09.514852 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.514818 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:09.545059 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.545025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m4gr\" (UniqueName: \"kubernetes.io/projected/b8481f8a-c4fe-427c-bb6c-1e53dea91702-kube-api-access-6m4gr\") pod \"kuadrant-operator-catalog-mpr4m\" (UID: \"b8481f8a-c4fe-427c-bb6c-1e53dea91702\") " pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:09.557819 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.554830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m4gr\" (UniqueName: \"kubernetes.io/projected/b8481f8a-c4fe-427c-bb6c-1e53dea91702-kube-api-access-6m4gr\") pod \"kuadrant-operator-catalog-mpr4m\" (UID: \"b8481f8a-c4fe-427c-bb6c-1e53dea91702\") " pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:09.610938 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.610897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:09.723191 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.723158 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:09.746834 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:09.746746 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mpr4m"] Jul 20 19:32:09.751768 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:09.751737 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8481f8a_c4fe_427c_bb6c_1e53dea91702.slice/crio-a6d3496fea871ba0e2c69292bc4d80d2174ca17da660cf9db68a93ce94f40482 WatchSource:0}: Error finding container a6d3496fea871ba0e2c69292bc4d80d2174ca17da660cf9db68a93ce94f40482: Status 404 returned error can't find the container with id a6d3496fea871ba0e2c69292bc4d80d2174ca17da660cf9db68a93ce94f40482 Jul 20 19:32:10.403307 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:10.403230 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" event={"ID":"b8481f8a-c4fe-427c-bb6c-1e53dea91702","Type":"ContainerStarted","Data":"a6d3496fea871ba0e2c69292bc4d80d2174ca17da660cf9db68a93ce94f40482"} Jul 20 19:32:12.415620 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.415578 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" event={"ID":"b8481f8a-c4fe-427c-bb6c-1e53dea91702","Type":"ContainerStarted","Data":"80ab6891852bacd653cb6696d80477b939d7d61cf9e95dccdc9e279bbe15e7be"} Jul 20 19:32:12.417202 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.417170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" event={"ID":"7c6433a4-1503-4025-8cb9-a139389cf0e9","Type":"ContainerStarted","Data":"df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610"} Jul 20 19:32:12.417325 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.417194 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" podUID="7c6433a4-1503-4025-8cb9-a139389cf0e9" containerName="registry-server" containerID="cri-o://df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610" gracePeriod=2 Jul 20 19:32:12.431488 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.431445 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" podStartSLOduration=1.514924089 podStartE2EDuration="3.43142958s" totalImagesPullingTime="1.916505491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:12.429465791 +0000 UTC m=+581.932786285" watchObservedRunningTime="2026-07-20 19:32:12.43142958 +0000 UTC m=+581.934750051" Jul 20 19:32:12.445979 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.445936 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" podStartSLOduration=1.965610404 podStartE2EDuration="4.445919974s" totalImagesPullingTime="2.48030957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:12.445205868 +0000 UTC m=+581.948526338" watchObservedRunningTime="2026-07-20 19:32:12.445919974 +0000 UTC m=+581.949240444" Jul 20 19:32:12.668869 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.668806 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" Jul 20 19:32:12.775395 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.775351 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxxjn\" (UniqueName: \"kubernetes.io/projected/7c6433a4-1503-4025-8cb9-a139389cf0e9-kube-api-access-cxxjn\") pod \"7c6433a4-1503-4025-8cb9-a139389cf0e9\" (UID: \"7c6433a4-1503-4025-8cb9-a139389cf0e9\") " Jul 20 19:32:12.777546 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.777522 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6433a4-1503-4025-8cb9-a139389cf0e9-kube-api-access-cxxjn" (OuterVolumeSpecName: "kube-api-access-cxxjn") pod "7c6433a4-1503-4025-8cb9-a139389cf0e9" (UID: "7c6433a4-1503-4025-8cb9-a139389cf0e9"). InnerVolumeSpecName "kube-api-access-cxxjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:32:12.876130 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:12.876092 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxxjn\" (UniqueName: \"kubernetes.io/projected/7c6433a4-1503-4025-8cb9-a139389cf0e9-kube-api-access-cxxjn\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:13.424182 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.424087 2561 generic.go:356] "Generic (PLEG): container finished" podID="7c6433a4-1503-4025-8cb9-a139389cf0e9" containerID="df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610" exitCode=0 Jul 20 19:32:13.424182 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.424144 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" Jul 20 19:32:13.424182 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.424171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" event={"ID":"7c6433a4-1503-4025-8cb9-a139389cf0e9","Type":"ContainerDied","Data":"df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610"} Jul 20 19:32:13.424715 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.424240 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ldlpp" event={"ID":"7c6433a4-1503-4025-8cb9-a139389cf0e9","Type":"ContainerDied","Data":"d534908087ec5c66e1c88de70baa6b2686aeff85ee7756a1d94b1676d41e700e"} Jul 20 19:32:13.424715 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.424260 2561 scope.go:117] "RemoveContainer" containerID="df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610" Jul 20 19:32:13.433086 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.433066 2561 scope.go:117] "RemoveContainer" containerID="df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610" Jul 20 19:32:13.433327 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:32:13.433309 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610\": container with ID starting with df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610 not found: ID does not exist" containerID="df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610" Jul 20 19:32:13.433375 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.433334 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610"} err="failed to get container status \"df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610\": rpc error: code = NotFound desc = could not find container \"df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610\": container with ID starting with df6837a56b49d22bd033a66c1d50d0925af9c52dc3f003c1301a637f513bb610 not found: ID does not exist" Jul 20 19:32:13.440504 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.440481 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldlpp"] Jul 20 19:32:13.444328 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:13.444298 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldlpp"] Jul 20 19:32:15.064020 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:15.063988 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c6433a4-1503-4025-8cb9-a139389cf0e9" path="/var/lib/kubelet/pods/7c6433a4-1503-4025-8cb9-a139389cf0e9/volumes" Jul 20 19:32:15.878595 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:15.878560 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:19.611043 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:19.611012 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:19.611472 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:19.611088 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:19.633199 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:19.633176 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:20.479294 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:20.479270 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mpr4m" Jul 20 19:32:24.331191 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.331150 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74"] Jul 20 19:32:24.331706 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.331652 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c6433a4-1503-4025-8cb9-a139389cf0e9" containerName="registry-server" Jul 20 19:32:24.331706 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.331671 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c6433a4-1503-4025-8cb9-a139389cf0e9" containerName="registry-server" Jul 20 19:32:24.331821 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.331791 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c6433a4-1503-4025-8cb9-a139389cf0e9" containerName="registry-server" Jul 20 19:32:24.333757 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.333736 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.336395 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.336364 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gp7gx\"" Jul 20 19:32:24.343082 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.343061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74"] Jul 20 19:32:24.375255 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.375228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.375368 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.375294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k72q6\" (UniqueName: \"kubernetes.io/projected/7359d856-9186-4c0a-b4a9-1b2c7d98b077-kube-api-access-k72q6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.375368 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.375352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.476581 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.476553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k72q6\" (UniqueName: \"kubernetes.io/projected/7359d856-9186-4c0a-b4a9-1b2c7d98b077-kube-api-access-k72q6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.476720 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.476594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.476720 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.476622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.476940 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.476922 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.476977 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.476955 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.485255 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.485233 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k72q6\" (UniqueName: \"kubernetes.io/projected/7359d856-9186-4c0a-b4a9-1b2c7d98b077-kube-api-access-k72q6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.644076 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.644009 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:24.736889 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.736858 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh"] Jul 20 19:32:24.741328 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.741300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.751194 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.751126 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh"] Jul 20 19:32:24.774509 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.774487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74"] Jul 20 19:32:24.777101 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:24.777079 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7359d856_9186_4c0a_b4a9_1b2c7d98b077.slice/crio-251bbdc31af62d6441747c708143fec5f9f4371b03743af65eeaae9ee20773a0 WatchSource:0}: Error finding container 251bbdc31af62d6441747c708143fec5f9f4371b03743af65eeaae9ee20773a0: Status 404 returned error can't find the container with id 251bbdc31af62d6441747c708143fec5f9f4371b03743af65eeaae9ee20773a0 Jul 20 19:32:24.778747 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.778723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.778824 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.778768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx8d4\" (UniqueName: \"kubernetes.io/projected/660246b7-2ae0-4cb0-adcd-372b5d34b08b-kube-api-access-qx8d4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.778866 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.778848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.880159 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.880134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.880291 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.880169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx8d4\" (UniqueName: \"kubernetes.io/projected/660246b7-2ae0-4cb0-adcd-372b5d34b08b-kube-api-access-qx8d4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.880376 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.880362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.880521 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.880502 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.880674 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.880658 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:24.889549 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:24.889525 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx8d4\" (UniqueName: \"kubernetes.io/projected/660246b7-2ae0-4cb0-adcd-372b5d34b08b-kube-api-access-qx8d4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:25.058432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.058374 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:25.131167 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.131137 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd"] Jul 20 19:32:25.134297 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.134276 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.144115 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.144086 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd"] Jul 20 19:32:25.183054 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.183021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.183203 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.183076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.183203 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.183182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzczz\" (UniqueName: \"kubernetes.io/projected/89e5e924-0436-4124-97ab-b3ee4a142361-kube-api-access-tzczz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.191152 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.191119 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh"] Jul 20 19:32:25.192182 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:25.192158 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660246b7_2ae0_4cb0_adcd_372b5d34b08b.slice/crio-c832ce1cafa778f83bc10231a745bf5b9557abd636ee04728e9414d2fc13f55b WatchSource:0}: Error finding container c832ce1cafa778f83bc10231a745bf5b9557abd636ee04728e9414d2fc13f55b: Status 404 returned error can't find the container with id c832ce1cafa778f83bc10231a745bf5b9557abd636ee04728e9414d2fc13f55b Jul 20 19:32:25.283706 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.283677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzczz\" (UniqueName: \"kubernetes.io/projected/89e5e924-0436-4124-97ab-b3ee4a142361-kube-api-access-tzczz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.283843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.283736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.283843 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.283796 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.284172 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.284150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.284249 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.284188 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.292433 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.292409 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzczz\" (UniqueName: \"kubernetes.io/projected/89e5e924-0436-4124-97ab-b3ee4a142361-kube-api-access-tzczz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.446863 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.446798 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:25.481540 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.481507 2561 generic.go:356] "Generic (PLEG): container finished" podID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerID="4218a74869f0374f46e1ff196c3c2c5ea76aaf179c7c74fd45d04b69e11b8f02" exitCode=0 Jul 20 19:32:25.481698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.481590 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" event={"ID":"7359d856-9186-4c0a-b4a9-1b2c7d98b077","Type":"ContainerDied","Data":"4218a74869f0374f46e1ff196c3c2c5ea76aaf179c7c74fd45d04b69e11b8f02"} Jul 20 19:32:25.481698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.481656 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" event={"ID":"7359d856-9186-4c0a-b4a9-1b2c7d98b077","Type":"ContainerStarted","Data":"251bbdc31af62d6441747c708143fec5f9f4371b03743af65eeaae9ee20773a0"} Jul 20 19:32:25.483277 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.483254 2561 generic.go:356] "Generic (PLEG): container finished" podID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerID="652f3fe3439140e01cd6478d34c6f104c5b720e29780c7db954c68730eff6301" exitCode=0 Jul 20 19:32:25.483419 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.483283 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" event={"ID":"660246b7-2ae0-4cb0-adcd-372b5d34b08b","Type":"ContainerDied","Data":"652f3fe3439140e01cd6478d34c6f104c5b720e29780c7db954c68730eff6301"} Jul 20 19:32:25.483419 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.483314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" event={"ID":"660246b7-2ae0-4cb0-adcd-372b5d34b08b","Type":"ContainerStarted","Data":"c832ce1cafa778f83bc10231a745bf5b9557abd636ee04728e9414d2fc13f55b"} Jul 20 19:32:25.543073 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.543043 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5"] Jul 20 19:32:25.546656 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.546637 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.555628 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.555597 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5"] Jul 20 19:32:25.586640 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.586616 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.586830 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.586805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.586890 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.586867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pzb6\" (UniqueName: \"kubernetes.io/projected/638696cb-bc3b-492d-83fc-1c678351d548-kube-api-access-2pzb6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.587293 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.587276 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd"] Jul 20 19:32:25.589161 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:25.589140 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e5e924_0436_4124_97ab_b3ee4a142361.slice/crio-c6ef0ea0830e4228eaf6eaca68bd667a7294fbab207c1892247830b4d0d3069b WatchSource:0}: Error finding container c6ef0ea0830e4228eaf6eaca68bd667a7294fbab207c1892247830b4d0d3069b: Status 404 returned error can't find the container with id c6ef0ea0830e4228eaf6eaca68bd667a7294fbab207c1892247830b4d0d3069b Jul 20 19:32:25.687740 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.687715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.687841 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.687761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pzb6\" (UniqueName: \"kubernetes.io/projected/638696cb-bc3b-492d-83fc-1c678351d548-kube-api-access-2pzb6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.687841 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.687807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.688156 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.688136 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.688326 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.688137 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.697766 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.697720 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pzb6\" (UniqueName: \"kubernetes.io/projected/638696cb-bc3b-492d-83fc-1c678351d548-kube-api-access-2pzb6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.860533 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.860508 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:25.988259 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:25.988226 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5"] Jul 20 19:32:25.989829 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:25.989800 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638696cb_bc3b_492d_83fc_1c678351d548.slice/crio-f60feb442c31c98abb2940291cb059fa1126098d6da5268722467767f3d8cb46 WatchSource:0}: Error finding container f60feb442c31c98abb2940291cb059fa1126098d6da5268722467767f3d8cb46: Status 404 returned error can't find the container with id f60feb442c31c98abb2940291cb059fa1126098d6da5268722467767f3d8cb46 Jul 20 19:32:26.490672 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.490642 2561 generic.go:356] "Generic (PLEG): container finished" podID="638696cb-bc3b-492d-83fc-1c678351d548" containerID="e0752d095c68007abd790b343d2ac6bb9f3d25a2a298f980bb7dea41375c0a65" exitCode=0 Jul 20 19:32:26.491100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.490743 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" event={"ID":"638696cb-bc3b-492d-83fc-1c678351d548","Type":"ContainerDied","Data":"e0752d095c68007abd790b343d2ac6bb9f3d25a2a298f980bb7dea41375c0a65"} Jul 20 19:32:26.491100 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.490800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" event={"ID":"638696cb-bc3b-492d-83fc-1c678351d548","Type":"ContainerStarted","Data":"f60feb442c31c98abb2940291cb059fa1126098d6da5268722467767f3d8cb46"} Jul 20 19:32:26.492809 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.492785 2561 generic.go:356] "Generic (PLEG): container finished" podID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerID="5a3ebbf744559b0879cdd26055aadbba1984683644ab1679411baa373568a981" exitCode=0 Jul 20 19:32:26.492915 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.492840 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" event={"ID":"7359d856-9186-4c0a-b4a9-1b2c7d98b077","Type":"ContainerDied","Data":"5a3ebbf744559b0879cdd26055aadbba1984683644ab1679411baa373568a981"} Jul 20 19:32:26.494868 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.494845 2561 generic.go:356] "Generic (PLEG): container finished" podID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerID="e43b13127097821ac2594873e3f7b5c610f4ecaac2dd23edede246eb46df57ea" exitCode=0 Jul 20 19:32:26.495171 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.494943 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" event={"ID":"660246b7-2ae0-4cb0-adcd-372b5d34b08b","Type":"ContainerDied","Data":"e43b13127097821ac2594873e3f7b5c610f4ecaac2dd23edede246eb46df57ea"} Jul 20 19:32:26.497012 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.496969 2561 generic.go:356] "Generic (PLEG): container finished" podID="89e5e924-0436-4124-97ab-b3ee4a142361" containerID="b22e498a3336454c8ff8ec87c802529ae0d3a5cb5a97375539dc1597105e7348" exitCode=0 Jul 20 19:32:26.497012 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.497010 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" event={"ID":"89e5e924-0436-4124-97ab-b3ee4a142361","Type":"ContainerDied","Data":"b22e498a3336454c8ff8ec87c802529ae0d3a5cb5a97375539dc1597105e7348"} Jul 20 19:32:26.497235 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.497046 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" event={"ID":"89e5e924-0436-4124-97ab-b3ee4a142361","Type":"ContainerStarted","Data":"c6ef0ea0830e4228eaf6eaca68bd667a7294fbab207c1892247830b4d0d3069b"} Jul 20 19:32:26.586920 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:26.586884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:27.507799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:27.507767 2561 generic.go:356] "Generic (PLEG): container finished" podID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerID="e9ad563bdf54d1cc087b861da9282f8f4816b982ce51ed8c81b9e1e0c03130cb" exitCode=0 Jul 20 19:32:27.508165 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:27.507849 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" event={"ID":"7359d856-9186-4c0a-b4a9-1b2c7d98b077","Type":"ContainerDied","Data":"e9ad563bdf54d1cc087b861da9282f8f4816b982ce51ed8c81b9e1e0c03130cb"} Jul 20 19:32:27.509923 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:27.509902 2561 generic.go:356] "Generic (PLEG): container finished" podID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerID="05f168fea52d842e5d58feb645805e5397f01667f4251b835d5d5b52d46fbaae" exitCode=0 Jul 20 19:32:27.510044 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:27.509987 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" event={"ID":"660246b7-2ae0-4cb0-adcd-372b5d34b08b","Type":"ContainerDied","Data":"05f168fea52d842e5d58feb645805e5397f01667f4251b835d5d5b52d46fbaae"} Jul 20 19:32:27.511650 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:27.511627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" event={"ID":"638696cb-bc3b-492d-83fc-1c678351d548","Type":"ContainerStarted","Data":"312a7dd5632f8cc344f3232b6c02556bbaca4a6e48aa2c335106e9a9475ee175"} Jul 20 19:32:28.518103 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.518066 2561 generic.go:356] "Generic (PLEG): container finished" podID="89e5e924-0436-4124-97ab-b3ee4a142361" containerID="a9f7c5c03f582c2492c27622f9f55bea133ba78bd23b3c6d19e1a4f629799c7c" exitCode=0 Jul 20 19:32:28.518595 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.518153 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" event={"ID":"89e5e924-0436-4124-97ab-b3ee4a142361","Type":"ContainerDied","Data":"a9f7c5c03f582c2492c27622f9f55bea133ba78bd23b3c6d19e1a4f629799c7c"} Jul 20 19:32:28.519962 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.519938 2561 generic.go:356] "Generic (PLEG): container finished" podID="638696cb-bc3b-492d-83fc-1c678351d548" containerID="312a7dd5632f8cc344f3232b6c02556bbaca4a6e48aa2c335106e9a9475ee175" exitCode=0 Jul 20 19:32:28.520059 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.520009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" event={"ID":"638696cb-bc3b-492d-83fc-1c678351d548","Type":"ContainerDied","Data":"312a7dd5632f8cc344f3232b6c02556bbaca4a6e48aa2c335106e9a9475ee175"} Jul 20 19:32:28.671589 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.671559 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:28.712847 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.712820 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-util\") pod \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " Jul 20 19:32:28.712982 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.712912 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k72q6\" (UniqueName: \"kubernetes.io/projected/7359d856-9186-4c0a-b4a9-1b2c7d98b077-kube-api-access-k72q6\") pod \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " Jul 20 19:32:28.712982 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.712940 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-bundle\") pod \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\" (UID: \"7359d856-9186-4c0a-b4a9-1b2c7d98b077\") " Jul 20 19:32:28.713660 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.713633 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-bundle" (OuterVolumeSpecName: "bundle") pod "7359d856-9186-4c0a-b4a9-1b2c7d98b077" (UID: "7359d856-9186-4c0a-b4a9-1b2c7d98b077"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:32:28.714821 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.714801 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7359d856-9186-4c0a-b4a9-1b2c7d98b077-kube-api-access-k72q6" (OuterVolumeSpecName: "kube-api-access-k72q6") pod "7359d856-9186-4c0a-b4a9-1b2c7d98b077" (UID: "7359d856-9186-4c0a-b4a9-1b2c7d98b077"). InnerVolumeSpecName "kube-api-access-k72q6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:32:28.718765 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.718731 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-util" (OuterVolumeSpecName: "util") pod "7359d856-9186-4c0a-b4a9-1b2c7d98b077" (UID: "7359d856-9186-4c0a-b4a9-1b2c7d98b077"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:32:28.772728 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.772665 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:28.813319 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.813295 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx8d4\" (UniqueName: \"kubernetes.io/projected/660246b7-2ae0-4cb0-adcd-372b5d34b08b-kube-api-access-qx8d4\") pod \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " Jul 20 19:32:28.813473 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.813328 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-util\") pod \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " Jul 20 19:32:28.813473 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.813425 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-bundle\") pod \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\" (UID: \"660246b7-2ae0-4cb0-adcd-372b5d34b08b\") " Jul 20 19:32:28.813639 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.813621 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k72q6\" (UniqueName: \"kubernetes.io/projected/7359d856-9186-4c0a-b4a9-1b2c7d98b077-kube-api-access-k72q6\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:28.813698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.813646 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:28.813698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.813660 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7359d856-9186-4c0a-b4a9-1b2c7d98b077-util\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:28.814134 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.814102 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-bundle" (OuterVolumeSpecName: "bundle") pod "660246b7-2ae0-4cb0-adcd-372b5d34b08b" (UID: "660246b7-2ae0-4cb0-adcd-372b5d34b08b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:32:28.815703 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.815673 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660246b7-2ae0-4cb0-adcd-372b5d34b08b-kube-api-access-qx8d4" (OuterVolumeSpecName: "kube-api-access-qx8d4") pod "660246b7-2ae0-4cb0-adcd-372b5d34b08b" (UID: "660246b7-2ae0-4cb0-adcd-372b5d34b08b"). InnerVolumeSpecName "kube-api-access-qx8d4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:32:28.818433 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.818410 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-util" (OuterVolumeSpecName: "util") pod "660246b7-2ae0-4cb0-adcd-372b5d34b08b" (UID: "660246b7-2ae0-4cb0-adcd-372b5d34b08b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:32:28.914637 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.914608 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx8d4\" (UniqueName: \"kubernetes.io/projected/660246b7-2ae0-4cb0-adcd-372b5d34b08b-kube-api-access-qx8d4\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:28.914637 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.914633 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-util\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:28.914637 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:28.914643 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660246b7-2ae0-4cb0-adcd-372b5d34b08b-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:29.528065 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.528035 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" Jul 20 19:32:29.528065 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.528045 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74" event={"ID":"7359d856-9186-4c0a-b4a9-1b2c7d98b077","Type":"ContainerDied","Data":"251bbdc31af62d6441747c708143fec5f9f4371b03743af65eeaae9ee20773a0"} Jul 20 19:32:29.528546 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.528121 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="251bbdc31af62d6441747c708143fec5f9f4371b03743af65eeaae9ee20773a0" Jul 20 19:32:29.530006 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.529981 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" Jul 20 19:32:29.530261 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.529974 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh" event={"ID":"660246b7-2ae0-4cb0-adcd-372b5d34b08b","Type":"ContainerDied","Data":"c832ce1cafa778f83bc10231a745bf5b9557abd636ee04728e9414d2fc13f55b"} Jul 20 19:32:29.530352 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.530284 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c832ce1cafa778f83bc10231a745bf5b9557abd636ee04728e9414d2fc13f55b" Jul 20 19:32:29.532362 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.532341 2561 generic.go:356] "Generic (PLEG): container finished" podID="89e5e924-0436-4124-97ab-b3ee4a142361" containerID="279e154946a78878e8b19c77e8698e91c39c65069087d79d41ee7d8d54075931" exitCode=0 Jul 20 19:32:29.532464 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.532408 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" event={"ID":"89e5e924-0436-4124-97ab-b3ee4a142361","Type":"ContainerDied","Data":"279e154946a78878e8b19c77e8698e91c39c65069087d79d41ee7d8d54075931"} Jul 20 19:32:29.534340 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.534322 2561 generic.go:356] "Generic (PLEG): container finished" podID="638696cb-bc3b-492d-83fc-1c678351d548" containerID="8f4d406bbcf02318a97eab896be93f1df5049f2d664e23dbc20a8fed412c6b4a" exitCode=0 Jul 20 19:32:29.534451 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:29.534408 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" event={"ID":"638696cb-bc3b-492d-83fc-1c678351d548","Type":"ContainerDied","Data":"8f4d406bbcf02318a97eab896be93f1df5049f2d664e23dbc20a8fed412c6b4a"} Jul 20 19:32:30.681803 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.681781 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:30.701189 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.701164 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:30.731593 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.731563 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-util\") pod \"89e5e924-0436-4124-97ab-b3ee4a142361\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " Jul 20 19:32:30.731756 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.731659 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-util\") pod \"638696cb-bc3b-492d-83fc-1c678351d548\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " Jul 20 19:32:30.731756 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.731697 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-bundle\") pod \"89e5e924-0436-4124-97ab-b3ee4a142361\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " Jul 20 19:32:30.731868 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.731772 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzczz\" (UniqueName: \"kubernetes.io/projected/89e5e924-0436-4124-97ab-b3ee4a142361-kube-api-access-tzczz\") pod \"89e5e924-0436-4124-97ab-b3ee4a142361\" (UID: \"89e5e924-0436-4124-97ab-b3ee4a142361\") " Jul 20 19:32:30.731868 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.731794 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pzb6\" (UniqueName: \"kubernetes.io/projected/638696cb-bc3b-492d-83fc-1c678351d548-kube-api-access-2pzb6\") pod \"638696cb-bc3b-492d-83fc-1c678351d548\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " Jul 20 19:32:30.731868 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.731825 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-bundle\") pod \"638696cb-bc3b-492d-83fc-1c678351d548\" (UID: \"638696cb-bc3b-492d-83fc-1c678351d548\") " Jul 20 19:32:30.732261 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.732227 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-bundle" (OuterVolumeSpecName: "bundle") pod "89e5e924-0436-4124-97ab-b3ee4a142361" (UID: "89e5e924-0436-4124-97ab-b3ee4a142361"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:32:30.732413 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.732317 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-bundle" (OuterVolumeSpecName: "bundle") pod "638696cb-bc3b-492d-83fc-1c678351d548" (UID: "638696cb-bc3b-492d-83fc-1c678351d548"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:32:30.733981 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.733956 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e5e924-0436-4124-97ab-b3ee4a142361-kube-api-access-tzczz" (OuterVolumeSpecName: "kube-api-access-tzczz") pod "89e5e924-0436-4124-97ab-b3ee4a142361" (UID: "89e5e924-0436-4124-97ab-b3ee4a142361"). InnerVolumeSpecName "kube-api-access-tzczz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:32:30.734080 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.734014 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/638696cb-bc3b-492d-83fc-1c678351d548-kube-api-access-2pzb6" (OuterVolumeSpecName: "kube-api-access-2pzb6") pod "638696cb-bc3b-492d-83fc-1c678351d548" (UID: "638696cb-bc3b-492d-83fc-1c678351d548"). InnerVolumeSpecName "kube-api-access-2pzb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:32:30.740020 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.739995 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-util" (OuterVolumeSpecName: "util") pod "89e5e924-0436-4124-97ab-b3ee4a142361" (UID: "89e5e924-0436-4124-97ab-b3ee4a142361"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:32:30.741038 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.741013 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-util" (OuterVolumeSpecName: "util") pod "638696cb-bc3b-492d-83fc-1c678351d548" (UID: "638696cb-bc3b-492d-83fc-1c678351d548"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:32:30.832696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.832614 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-util\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:30.832696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.832640 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-util\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:30.832696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.832649 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89e5e924-0436-4124-97ab-b3ee4a142361-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:30.832696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.832656 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzczz\" (UniqueName: \"kubernetes.io/projected/89e5e924-0436-4124-97ab-b3ee4a142361-kube-api-access-tzczz\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:30.832696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.832666 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pzb6\" (UniqueName: \"kubernetes.io/projected/638696cb-bc3b-492d-83fc-1c678351d548-kube-api-access-2pzb6\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:30.832696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:30.832676 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/638696cb-bc3b-492d-83fc-1c678351d548-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:32:31.397997 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.387531 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:32:31.397997 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.387730 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:32:31.400098 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.400069 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:32:31.401969 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.401949 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:32:31.547545 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.547514 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" Jul 20 19:32:31.547545 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.547518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd" event={"ID":"89e5e924-0436-4124-97ab-b3ee4a142361","Type":"ContainerDied","Data":"c6ef0ea0830e4228eaf6eaca68bd667a7294fbab207c1892247830b4d0d3069b"} Jul 20 19:32:31.547789 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.547591 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6ef0ea0830e4228eaf6eaca68bd667a7294fbab207c1892247830b4d0d3069b" Jul 20 19:32:31.549984 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.549963 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" Jul 20 19:32:31.549984 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.549973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5" event={"ID":"638696cb-bc3b-492d-83fc-1c678351d548","Type":"ContainerDied","Data":"f60feb442c31c98abb2940291cb059fa1126098d6da5268722467767f3d8cb46"} Jul 20 19:32:31.550149 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:31.550011 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f60feb442c31c98abb2940291cb059fa1126098d6da5268722467767f3d8cb46" Jul 20 19:32:37.180141 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:37.180112 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:40.598185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:40.598137 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:41.910646 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.910603 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv"] Jul 20 19:32:41.911113 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911093 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="638696cb-bc3b-492d-83fc-1c678351d548" containerName="util" Jul 20 19:32:41.911113 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911112 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="638696cb-bc3b-492d-83fc-1c678351d548" containerName="util" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911135 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerName="pull" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911143 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerName="pull" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911157 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e5e924-0436-4124-97ab-b3ee4a142361" containerName="pull" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911166 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e5e924-0436-4124-97ab-b3ee4a142361" containerName="pull" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911177 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e5e924-0436-4124-97ab-b3ee4a142361" containerName="extract" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911185 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e5e924-0436-4124-97ab-b3ee4a142361" containerName="extract" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911197 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerName="util" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911205 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerName="util" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911216 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerName="extract" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911225 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerName="extract" Jul 20 19:32:41.911230 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911234 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerName="extract" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911242 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerName="extract" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911250 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="638696cb-bc3b-492d-83fc-1c678351d548" containerName="extract" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911257 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="638696cb-bc3b-492d-83fc-1c678351d548" containerName="extract" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911271 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e5e924-0436-4124-97ab-b3ee4a142361" containerName="util" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911280 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e5e924-0436-4124-97ab-b3ee4a142361" containerName="util" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911291 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerName="util" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911299 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerName="util" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911308 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerName="pull" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911317 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerName="pull" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911331 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="638696cb-bc3b-492d-83fc-1c678351d548" containerName="pull" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911340 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="638696cb-bc3b-492d-83fc-1c678351d548" containerName="pull" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911451 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e5e924-0436-4124-97ab-b3ee4a142361" containerName="extract" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911470 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="638696cb-bc3b-492d-83fc-1c678351d548" containerName="extract" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911479 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="660246b7-2ae0-4cb0-adcd-372b5d34b08b" containerName="extract" Jul 20 19:32:41.911781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.911491 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7359d856-9186-4c0a-b4a9-1b2c7d98b077" containerName="extract" Jul 20 19:32:41.914850 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.914830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:41.917550 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.917529 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jb89k\"" Jul 20 19:32:41.927182 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:41.927157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv"] Jul 20 19:32:42.025327 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.025290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a515907-5b29-4864-b508-5daab32dbd36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" (UID: \"2a515907-5b29-4864-b508-5daab32dbd36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:42.025520 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.025345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g4x6\" (UniqueName: \"kubernetes.io/projected/2a515907-5b29-4864-b508-5daab32dbd36-kube-api-access-4g4x6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" (UID: \"2a515907-5b29-4864-b508-5daab32dbd36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:42.125759 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.125718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a515907-5b29-4864-b508-5daab32dbd36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" (UID: \"2a515907-5b29-4864-b508-5daab32dbd36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:42.125906 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.125779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g4x6\" (UniqueName: \"kubernetes.io/projected/2a515907-5b29-4864-b508-5daab32dbd36-kube-api-access-4g4x6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" (UID: \"2a515907-5b29-4864-b508-5daab32dbd36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:42.126125 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.126097 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a515907-5b29-4864-b508-5daab32dbd36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" (UID: \"2a515907-5b29-4864-b508-5daab32dbd36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:42.134203 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.134175 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g4x6\" (UniqueName: \"kubernetes.io/projected/2a515907-5b29-4864-b508-5daab32dbd36-kube-api-access-4g4x6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" (UID: \"2a515907-5b29-4864-b508-5daab32dbd36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:42.225588 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.225561 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:42.365637 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.365613 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv"] Jul 20 19:32:42.367767 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:42.367739 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a515907_5b29_4864_b508_5daab32dbd36.slice/crio-1f259f825c8f0c8d6ae175448cd88d66784ca4565e33d1f0881ec3d6bd76b499 WatchSource:0}: Error finding container 1f259f825c8f0c8d6ae175448cd88d66784ca4565e33d1f0881ec3d6bd76b499: Status 404 returned error can't find the container with id 1f259f825c8f0c8d6ae175448cd88d66784ca4565e33d1f0881ec3d6bd76b499 Jul 20 19:32:42.370193 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.370175 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:32:42.576262 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.576176 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:42.606879 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:42.606843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" event={"ID":"2a515907-5b29-4864-b508-5daab32dbd36","Type":"ContainerStarted","Data":"1f259f825c8f0c8d6ae175448cd88d66784ca4565e33d1f0881ec3d6bd76b499"} Jul 20 19:32:43.490795 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:43.490762 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:43.862527 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:43.862437 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv"] Jul 20 19:32:43.865796 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:43.865780 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" Jul 20 19:32:43.868469 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:43.868448 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 20 19:32:43.868585 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:43.868475 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-h9xqq\"" Jul 20 19:32:43.875471 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:43.875445 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv"] Jul 20 19:32:43.941946 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:43.941912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxtd7\" (UniqueName: \"kubernetes.io/projected/e509a107-1130-45a0-9222-1afaa1b8b557-kube-api-access-bxtd7\") pod \"dns-operator-controller-manager-864dd78c4c-bw7tv\" (UID: \"e509a107-1130-45a0-9222-1afaa1b8b557\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" Jul 20 19:32:44.043169 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:44.043120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxtd7\" (UniqueName: \"kubernetes.io/projected/e509a107-1130-45a0-9222-1afaa1b8b557-kube-api-access-bxtd7\") pod \"dns-operator-controller-manager-864dd78c4c-bw7tv\" (UID: \"e509a107-1130-45a0-9222-1afaa1b8b557\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" Jul 20 19:32:44.056974 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:44.056944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxtd7\" (UniqueName: \"kubernetes.io/projected/e509a107-1130-45a0-9222-1afaa1b8b557-kube-api-access-bxtd7\") pod \"dns-operator-controller-manager-864dd78c4c-bw7tv\" (UID: \"e509a107-1130-45a0-9222-1afaa1b8b557\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" Jul 20 19:32:44.177055 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:44.176953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" Jul 20 19:32:44.323471 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:44.323402 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv"] Jul 20 19:32:44.326265 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:44.326234 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode509a107_1130_45a0_9222_1afaa1b8b557.slice/crio-e8b09630f169541385706eacdddabec43e9c40bf44426203ca22cd1ef3686161 WatchSource:0}: Error finding container e8b09630f169541385706eacdddabec43e9c40bf44426203ca22cd1ef3686161: Status 404 returned error can't find the container with id e8b09630f169541385706eacdddabec43e9c40bf44426203ca22cd1ef3686161 Jul 20 19:32:44.412841 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:44.412800 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:44.567140 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:44.567094 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:44.619617 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:44.619577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" event={"ID":"e509a107-1130-45a0-9222-1afaa1b8b557","Type":"ContainerStarted","Data":"e8b09630f169541385706eacdddabec43e9c40bf44426203ca22cd1ef3686161"} Jul 20 19:32:45.252904 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:45.252862 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:45.357369 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:45.357331 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:46.738034 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.738008 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f"] Jul 20 19:32:46.741987 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.741968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:32:46.745751 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.745732 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pwd9b\"" Jul 20 19:32:46.752793 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.752766 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f"] Jul 20 19:32:46.826404 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.826355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:46.871801 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.871759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klm8b\" (UniqueName: \"kubernetes.io/projected/e0764f00-1261-411e-a086-09f391ea7105-kube-api-access-klm8b\") pod \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" (UID: \"e0764f00-1261-411e-a086-09f391ea7105\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:32:46.964723 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.964694 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:46.972941 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.972916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klm8b\" (UniqueName: \"kubernetes.io/projected/e0764f00-1261-411e-a086-09f391ea7105-kube-api-access-klm8b\") pod \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" (UID: \"e0764f00-1261-411e-a086-09f391ea7105\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:32:46.985133 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:46.985106 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klm8b\" (UniqueName: \"kubernetes.io/projected/e0764f00-1261-411e-a086-09f391ea7105-kube-api-access-klm8b\") pod \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" (UID: \"e0764f00-1261-411e-a086-09f391ea7105\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:32:47.055996 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:47.055897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:32:47.194973 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:47.194944 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f"] Jul 20 19:32:47.199859 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:47.199826 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0764f00_1261_411e_a086_09f391ea7105.slice/crio-38c4a4b7e5863d31ba51ea89e959faae9e4301e2211aef296ef47930fa0b323d WatchSource:0}: Error finding container 38c4a4b7e5863d31ba51ea89e959faae9e4301e2211aef296ef47930fa0b323d: Status 404 returned error can't find the container with id 38c4a4b7e5863d31ba51ea89e959faae9e4301e2211aef296ef47930fa0b323d Jul 20 19:32:47.640395 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:47.640349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" event={"ID":"e0764f00-1261-411e-a086-09f391ea7105","Type":"ContainerStarted","Data":"38c4a4b7e5863d31ba51ea89e959faae9e4301e2211aef296ef47930fa0b323d"} Jul 20 19:32:47.642185 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:47.642153 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" event={"ID":"e509a107-1130-45a0-9222-1afaa1b8b557","Type":"ContainerStarted","Data":"174fca3f9a2fe28dfa258662ccce507b3ad1fe649075b093562c67bce2ad75ec"} Jul 20 19:32:47.642347 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:47.642223 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" Jul 20 19:32:47.671880 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:47.671790 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" podStartSLOduration=2.263110524 podStartE2EDuration="4.671766601s" totalImagesPullingTime="2.408656077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:47.669986145 +0000 UTC m=+617.173306634" watchObservedRunningTime="2026-07-20 19:32:47.671766601 +0000 UTC m=+617.175087075" Jul 20 19:32:47.772647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:47.772588 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:49.193375 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:49.193344 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:49.308278 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:49.308233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:49.654353 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:49.654320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" event={"ID":"2a515907-5b29-4864-b508-5daab32dbd36","Type":"ContainerStarted","Data":"e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c"} Jul 20 19:32:49.654570 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:49.654429 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:32:49.675325 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:49.675273 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" podStartSLOduration=2.101749295 podStartE2EDuration="8.675257433s" totalImagesPullingTime="6.573508138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:49.672855445 +0000 UTC m=+619.176175931" watchObservedRunningTime="2026-07-20 19:32:49.675257433 +0000 UTC m=+619.178577904" Jul 20 19:32:50.244289 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.244257 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9"] Jul 20 19:32:50.247625 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.247607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" Jul 20 19:32:50.250410 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.250373 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5x6f5\"" Jul 20 19:32:50.259492 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.259465 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9"] Jul 20 19:32:50.303991 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.303959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbp6t\" (UniqueName: \"kubernetes.io/projected/dffd8926-b5d9-4818-9d65-dca48d51d75a-kube-api-access-xbp6t\") pod \"authorino-operator-75cc8d5cb7-s4xc9\" (UID: \"dffd8926-b5d9-4818-9d65-dca48d51d75a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" Jul 20 19:32:50.405363 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.405337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbp6t\" (UniqueName: \"kubernetes.io/projected/dffd8926-b5d9-4818-9d65-dca48d51d75a-kube-api-access-xbp6t\") pod \"authorino-operator-75cc8d5cb7-s4xc9\" (UID: \"dffd8926-b5d9-4818-9d65-dca48d51d75a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" Jul 20 19:32:50.417202 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.417182 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbp6t\" (UniqueName: \"kubernetes.io/projected/dffd8926-b5d9-4818-9d65-dca48d51d75a-kube-api-access-xbp6t\") pod \"authorino-operator-75cc8d5cb7-s4xc9\" (UID: \"dffd8926-b5d9-4818-9d65-dca48d51d75a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" Jul 20 19:32:50.559629 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.559549 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" Jul 20 19:32:50.666664 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.666468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" event={"ID":"e0764f00-1261-411e-a086-09f391ea7105","Type":"ContainerStarted","Data":"243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da"} Jul 20 19:32:50.667373 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.667000 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:32:50.684826 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.684780 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" podStartSLOduration=1.580784982 podStartE2EDuration="4.684740357s" totalImagesPullingTime="3.103955375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:50.683519414 +0000 UTC m=+620.186839903" watchObservedRunningTime="2026-07-20 19:32:50.684740357 +0000 UTC m=+620.188060826" Jul 20 19:32:50.699336 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:50.699313 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9"] Jul 20 19:32:50.701648 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:32:50.701615 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffd8926_b5d9_4818_9d65_dca48d51d75a.slice/crio-fa7b9c9f2b425c1df2fd25ea389a7f6116ed57367a506f89533885055ca41c1e WatchSource:0}: Error finding container fa7b9c9f2b425c1df2fd25ea389a7f6116ed57367a506f89533885055ca41c1e: Status 404 returned error can't find the container with id fa7b9c9f2b425c1df2fd25ea389a7f6116ed57367a506f89533885055ca41c1e Jul 20 19:32:51.676941 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:51.676905 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" event={"ID":"dffd8926-b5d9-4818-9d65-dca48d51d75a","Type":"ContainerStarted","Data":"fa7b9c9f2b425c1df2fd25ea389a7f6116ed57367a506f89533885055ca41c1e"} Jul 20 19:32:52.167275 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:52.167232 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:52.229394 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:52.229347 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:52.667112 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:52.667071 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:53.689842 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:53.689798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" event={"ID":"dffd8926-b5d9-4818-9d65-dca48d51d75a","Type":"ContainerStarted","Data":"30136d15fd86c11461c25a800ba56ade84cf3ac8d77564c7f31b62e93327d933"} Jul 20 19:32:53.690316 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:53.689892 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" Jul 20 19:32:53.709088 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:53.709038 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" podStartSLOduration=1.293589584 podStartE2EDuration="3.70902284s" totalImagesPullingTime="2.415433256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:53.706475367 +0000 UTC m=+623.209795839" watchObservedRunningTime="2026-07-20 19:32:53.70902284 +0000 UTC m=+623.212343309" Jul 20 19:32:54.843601 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:54.843557 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:54.943793 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:54.943721 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:58.649690 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:58.649661 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bw7tv" Jul 20 19:32:59.818575 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:59.818540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:32:59.917198 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:32:59.917153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:00.669408 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:00.669367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:01.679310 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:01.679279 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.423371 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.423340 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv"] Jul 20 19:33:02.423566 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.423520 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" podUID="2a515907-5b29-4864-b508-5daab32dbd36" containerName="manager" containerID="cri-o://e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c" gracePeriod=2 Jul 20 19:33:02.436244 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.436215 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv"] Jul 20 19:33:02.443296 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.443252 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2a515907-5b29-4864-b508-5daab32dbd36\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\": pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.450452 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.450430 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f"] Jul 20 19:33:02.450685 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.450660 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" podUID="e0764f00-1261-411e-a086-09f391ea7105" containerName="manager" containerID="cri-o://243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da" gracePeriod=2 Jul 20 19:33:02.452793 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.452771 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb"] Jul 20 19:33:02.453491 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.453469 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a515907-5b29-4864-b508-5daab32dbd36" containerName="manager" Jul 20 19:33:02.453648 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.453606 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a515907-5b29-4864-b508-5daab32dbd36" containerName="manager" Jul 20 19:33:02.453781 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.453762 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a515907-5b29-4864-b508-5daab32dbd36" containerName="manager" Jul 20 19:33:02.457283 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.457262 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f"] Jul 20 19:33:02.457372 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.457347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:02.457649 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.457616 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.459841 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.459809 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.468605 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.468582 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb"] Jul 20 19:33:02.483646 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.483618 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd"] Jul 20 19:33:02.484018 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.484000 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0764f00-1261-411e-a086-09f391ea7105" containerName="manager" Jul 20 19:33:02.484018 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.484017 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0764f00-1261-411e-a086-09f391ea7105" containerName="manager" Jul 20 19:33:02.484153 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.484042 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="e0764f00-1261-411e-a086-09f391ea7105" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.484153 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.484097 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0764f00-1261-411e-a086-09f391ea7105" containerName="manager" Jul 20 19:33:02.487002 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.486982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" Jul 20 19:33:02.499854 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.499832 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd"] Jul 20 19:33:02.517951 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.517921 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="e0764f00-1261-411e-a086-09f391ea7105" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.519877 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.519853 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.616081 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.616046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88r7\" (UniqueName: \"kubernetes.io/projected/6c88b5fb-57e1-4653-aa86-fb27792b3019-kube-api-access-z88r7\") pod \"limitador-operator-controller-manager-859d7b78bd-2qcpd\" (UID: \"6c88b5fb-57e1-4653-aa86-fb27792b3019\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" Jul 20 19:33:02.616278 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.616125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gqrpb\" (UID: \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:02.616278 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.616204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5dl9\" (UniqueName: \"kubernetes.io/projected/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-kube-api-access-t5dl9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gqrpb\" (UID: \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:02.702933 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.702913 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.705593 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.705574 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.705877 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.705851 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="e0764f00-1261-411e-a086-09f391ea7105" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.710209 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.710189 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.712669 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.712647 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.715106 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.715085 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="e0764f00-1261-411e-a086-09f391ea7105" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.717529 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.717509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gqrpb\" (UID: \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:02.717600 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.717573 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5dl9\" (UniqueName: \"kubernetes.io/projected/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-kube-api-access-t5dl9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gqrpb\" (UID: \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:02.717637 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.717613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88r7\" (UniqueName: \"kubernetes.io/projected/6c88b5fb-57e1-4653-aa86-fb27792b3019-kube-api-access-z88r7\") pod \"limitador-operator-controller-manager-859d7b78bd-2qcpd\" (UID: \"6c88b5fb-57e1-4653-aa86-fb27792b3019\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" Jul 20 19:33:02.717939 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.717919 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gqrpb\" (UID: \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:02.731323 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.731298 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88r7\" (UniqueName: \"kubernetes.io/projected/6c88b5fb-57e1-4653-aa86-fb27792b3019-kube-api-access-z88r7\") pod \"limitador-operator-controller-manager-859d7b78bd-2qcpd\" (UID: \"6c88b5fb-57e1-4653-aa86-fb27792b3019\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" Jul 20 19:33:02.736029 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.736011 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5dl9\" (UniqueName: \"kubernetes.io/projected/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-kube-api-access-t5dl9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gqrpb\" (UID: \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:02.741200 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.741177 2561 generic.go:356] "Generic (PLEG): container finished" podID="2a515907-5b29-4864-b508-5daab32dbd36" containerID="e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c" exitCode=0 Jul 20 19:33:02.741298 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.741223 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.741343 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.741280 2561 scope.go:117] "RemoveContainer" containerID="e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c" Jul 20 19:33:02.742719 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.742700 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0764f00-1261-411e-a086-09f391ea7105" containerID="243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da" exitCode=0 Jul 20 19:33:02.742810 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.742760 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.743960 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.743939 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="e0764f00-1261-411e-a086-09f391ea7105" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.746404 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.746366 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.749230 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.749211 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="e0764f00-1261-411e-a086-09f391ea7105" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:02.749910 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.749896 2561 scope.go:117] "RemoveContainer" containerID="e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c" Jul 20 19:33:02.750143 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.750126 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c\": container with ID starting with e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c not found: ID does not exist" containerID="e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c" Jul 20 19:33:02.750195 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.750152 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c"} err="failed to get container status \"e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c\": rpc error: code = NotFound desc = could not find container \"e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c\": container with ID starting with e4e344007fb970df2df8dc9e1ff2ba95f8cf449435042762278828ff7b8feb3c not found: ID does not exist" Jul 20 19:33:02.750195 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.750168 2561 scope.go:117] "RemoveContainer" containerID="243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da" Jul 20 19:33:02.751867 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.751849 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:02.757762 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.757746 2561 scope.go:117] "RemoveContainer" containerID="243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da" Jul 20 19:33:02.757983 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:02.757964 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da\": container with ID starting with 243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da not found: ID does not exist" containerID="243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da" Jul 20 19:33:02.758038 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.757987 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da"} err="failed to get container status \"243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da\": rpc error: code = NotFound desc = could not find container \"243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da\": container with ID starting with 243d8ba7ab2fbeb83e3b6ebd29369ca496048022935dfb25622bf488a137d0da not found: ID does not exist" Jul 20 19:33:02.818352 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.818329 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a515907-5b29-4864-b508-5daab32dbd36-extensions-socket-volume\") pod \"2a515907-5b29-4864-b508-5daab32dbd36\" (UID: \"2a515907-5b29-4864-b508-5daab32dbd36\") " Jul 20 19:33:02.818449 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.818372 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klm8b\" (UniqueName: \"kubernetes.io/projected/e0764f00-1261-411e-a086-09f391ea7105-kube-api-access-klm8b\") pod \"e0764f00-1261-411e-a086-09f391ea7105\" (UID: \"e0764f00-1261-411e-a086-09f391ea7105\") " Jul 20 19:33:02.818449 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.818426 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g4x6\" (UniqueName: \"kubernetes.io/projected/2a515907-5b29-4864-b508-5daab32dbd36-kube-api-access-4g4x6\") pod \"2a515907-5b29-4864-b508-5daab32dbd36\" (UID: \"2a515907-5b29-4864-b508-5daab32dbd36\") " Jul 20 19:33:02.818851 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.818829 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a515907-5b29-4864-b508-5daab32dbd36-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a515907-5b29-4864-b508-5daab32dbd36" (UID: "2a515907-5b29-4864-b508-5daab32dbd36"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:33:02.820284 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.820261 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0764f00-1261-411e-a086-09f391ea7105-kube-api-access-klm8b" (OuterVolumeSpecName: "kube-api-access-klm8b") pod "e0764f00-1261-411e-a086-09f391ea7105" (UID: "e0764f00-1261-411e-a086-09f391ea7105"). InnerVolumeSpecName "kube-api-access-klm8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:33:02.820350 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.820278 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a515907-5b29-4864-b508-5daab32dbd36-kube-api-access-4g4x6" (OuterVolumeSpecName: "kube-api-access-4g4x6") pod "2a515907-5b29-4864-b508-5daab32dbd36" (UID: "2a515907-5b29-4864-b508-5daab32dbd36"). InnerVolumeSpecName "kube-api-access-4g4x6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:33:02.873963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.873937 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:02.882061 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.882029 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" Jul 20 19:33:02.919504 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.919475 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g4x6\" (UniqueName: \"kubernetes.io/projected/2a515907-5b29-4864-b508-5daab32dbd36-kube-api-access-4g4x6\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:33:02.919504 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.919501 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a515907-5b29-4864-b508-5daab32dbd36-extensions-socket-volume\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:33:02.919504 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:02.919511 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klm8b\" (UniqueName: \"kubernetes.io/projected/e0764f00-1261-411e-a086-09f391ea7105-kube-api-access-klm8b\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:33:03.018184 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.018153 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb"] Jul 20 19:33:03.019902 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:33:03.019875 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d44e29_fe66_438a_b0c7_22dfa7b1e4a3.slice/crio-8ccb788767c57298368ad30b032e37b8fc34a6ee50108a922977981046afd1fa WatchSource:0}: Error finding container 8ccb788767c57298368ad30b032e37b8fc34a6ee50108a922977981046afd1fa: Status 404 returned error can't find the container with id 8ccb788767c57298368ad30b032e37b8fc34a6ee50108a922977981046afd1fa Jul 20 19:33:03.038170 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.038151 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd"] Jul 20 19:33:03.039931 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:33:03.039908 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c88b5fb_57e1_4653_aa86_fb27792b3019.slice/crio-3fe994774f5cfce42029d597db76050c2b6fa9956910579907de7f5cfeac746d WatchSource:0}: Error finding container 3fe994774f5cfce42029d597db76050c2b6fa9956910579907de7f5cfeac746d: Status 404 returned error can't find the container with id 3fe994774f5cfce42029d597db76050c2b6fa9956910579907de7f5cfeac746d Jul 20 19:33:03.061863 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:03.061832 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:03.063905 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:03.063877 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="e0764f00-1261-411e-a086-09f391ea7105" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:03.064917 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.064897 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a515907-5b29-4864-b508-5daab32dbd36" path="/var/lib/kubelet/pods/2a515907-5b29-4864-b508-5daab32dbd36/volumes" Jul 20 19:33:03.065195 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.065184 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0764f00-1261-411e-a086-09f391ea7105" path="/var/lib/kubelet/pods/e0764f00-1261-411e-a086-09f391ea7105/volumes" Jul 20 19:33:03.065914 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:03.065894 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mtc6f\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="e0764f00-1261-411e-a086-09f391ea7105" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtc6f" Jul 20 19:33:03.067885 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:03.067864 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ztwzv\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="2a515907-5b29-4864-b508-5daab32dbd36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ztwzv" Jul 20 19:33:03.750909 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.750875 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" event={"ID":"6c88b5fb-57e1-4653-aa86-fb27792b3019","Type":"ContainerStarted","Data":"e0b914f0d2f87a3b0b4b3aedbe72bd91aa33d1c570d57854fd0cb4f7bb13cf28"} Jul 20 19:33:03.751345 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.750934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" event={"ID":"6c88b5fb-57e1-4653-aa86-fb27792b3019","Type":"ContainerStarted","Data":"3fe994774f5cfce42029d597db76050c2b6fa9956910579907de7f5cfeac746d"} Jul 20 19:33:03.751345 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.750960 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" Jul 20 19:33:03.752439 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.752412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" event={"ID":"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3","Type":"ContainerStarted","Data":"734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e"} Jul 20 19:33:03.752558 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.752454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" event={"ID":"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3","Type":"ContainerStarted","Data":"8ccb788767c57298368ad30b032e37b8fc34a6ee50108a922977981046afd1fa"} Jul 20 19:33:03.752558 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.752487 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:03.771493 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.771448 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" podStartSLOduration=1.771432994 podStartE2EDuration="1.771432994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:33:03.770428429 +0000 UTC m=+633.273748921" watchObservedRunningTime="2026-07-20 19:33:03.771432994 +0000 UTC m=+633.274753442" Jul 20 19:33:03.792884 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:03.792828 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" podStartSLOduration=1.792810142 podStartE2EDuration="1.792810142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:33:03.792655224 +0000 UTC m=+633.295975694" watchObservedRunningTime="2026-07-20 19:33:03.792810142 +0000 UTC m=+633.296130611" Jul 20 19:33:04.586321 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:04.586288 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:04.690295 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:04.690269 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:04.698032 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:04.698007 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4xc9" Jul 20 19:33:09.393674 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:09.393636 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:09.529191 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:09.529159 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:10.150862 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:10.150823 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:10.253520 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:10.253487 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:13.370089 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:13.370054 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:13.480432 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:13.480373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:14.760597 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:14.760565 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2qcpd" Jul 20 19:33:14.761024 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:14.760660 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:19.490814 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.490783 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb"] Jul 20 19:33:19.491397 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.490944 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" podUID="89d44e29-fe66-438a-b0c7-22dfa7b1e4a3" containerName="manager" containerID="cri-o://734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e" gracePeriod=10 Jul 20 19:33:19.746813 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.746757 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:19.762862 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.762839 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5dl9\" (UniqueName: \"kubernetes.io/projected/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-kube-api-access-t5dl9\") pod \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\" (UID: \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\") " Jul 20 19:33:19.762964 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.762896 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-extensions-socket-volume\") pod \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\" (UID: \"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3\") " Jul 20 19:33:19.763295 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.763274 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "89d44e29-fe66-438a-b0c7-22dfa7b1e4a3" (UID: "89d44e29-fe66-438a-b0c7-22dfa7b1e4a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:33:19.765166 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.765134 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-kube-api-access-t5dl9" (OuterVolumeSpecName: "kube-api-access-t5dl9") pod "89d44e29-fe66-438a-b0c7-22dfa7b1e4a3" (UID: "89d44e29-fe66-438a-b0c7-22dfa7b1e4a3"). InnerVolumeSpecName "kube-api-access-t5dl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:33:19.843772 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.843738 2561 generic.go:356] "Generic (PLEG): container finished" podID="89d44e29-fe66-438a-b0c7-22dfa7b1e4a3" containerID="734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e" exitCode=0 Jul 20 19:33:19.843920 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.843792 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" Jul 20 19:33:19.843920 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.843821 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" event={"ID":"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3","Type":"ContainerDied","Data":"734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e"} Jul 20 19:33:19.843920 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.843893 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb" event={"ID":"89d44e29-fe66-438a-b0c7-22dfa7b1e4a3","Type":"ContainerDied","Data":"8ccb788767c57298368ad30b032e37b8fc34a6ee50108a922977981046afd1fa"} Jul 20 19:33:19.843920 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.843917 2561 scope.go:117] "RemoveContainer" containerID="734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e" Jul 20 19:33:19.852933 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.852914 2561 scope.go:117] "RemoveContainer" containerID="734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e" Jul 20 19:33:19.853169 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:19.853150 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e\": container with ID starting with 734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e not found: ID does not exist" containerID="734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e" Jul 20 19:33:19.853224 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.853177 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e"} err="failed to get container status \"734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e\": rpc error: code = NotFound desc = could not find container \"734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e\": container with ID starting with 734cfe7349e53122c50e43b0a52bf0e4a7fb70005d00042230254930a714d43e not found: ID does not exist" Jul 20 19:33:19.863968 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.863943 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-extensions-socket-volume\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:33:19.864086 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.863969 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5dl9\" (UniqueName: \"kubernetes.io/projected/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3-kube-api-access-t5dl9\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:33:19.866959 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.866935 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb"] Jul 20 19:33:19.871130 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:19.871111 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gqrpb"] Jul 20 19:33:21.063078 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:21.063046 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89d44e29-fe66-438a-b0c7-22dfa7b1e4a3" path="/var/lib/kubelet/pods/89d44e29-fe66-438a-b0c7-22dfa7b1e4a3/volumes" Jul 20 19:33:21.439408 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:21.439323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:21.494358 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:21.494325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:25.572719 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:25.572685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:25.673473 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:25.673435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:29.982785 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:29.982752 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:30.084177 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:30.084146 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:35.778749 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.778716 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6"] Jul 20 19:33:35.779269 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.779249 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d44e29-fe66-438a-b0c7-22dfa7b1e4a3" containerName="manager" Jul 20 19:33:35.779353 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.779272 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d44e29-fe66-438a-b0c7-22dfa7b1e4a3" containerName="manager" Jul 20 19:33:35.779429 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.779410 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89d44e29-fe66-438a-b0c7-22dfa7b1e4a3" containerName="manager" Jul 20 19:33:35.782315 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.782292 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.784893 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.784874 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9clzm\"" Jul 20 19:33:35.784997 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.784901 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 19:33:35.792125 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.792104 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6"] Jul 20 19:33:35.805477 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.805449 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:35.904105 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8wtx\" (UniqueName: \"kubernetes.io/projected/c611da0b-17c8-4218-bac3-ae1ed340d020-kube-api-access-x8wtx\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.904225 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.904225 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.904225 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c611da0b-17c8-4218-bac3-ae1ed340d020-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.904330 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.904330 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.904427 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.904427 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:35.904427 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:35.904370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005355 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005480 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005480 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005480 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005480 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005480 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8wtx\" (UniqueName: \"kubernetes.io/projected/c611da0b-17c8-4218-bac3-ae1ed340d020-kube-api-access-x8wtx\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005732 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005732 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005732 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c611da0b-17c8-4218-bac3-ae1ed340d020-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005887 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005836 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.005960 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.005902 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.006124 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.006096 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.006211 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.006165 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.006267 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.006232 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c611da0b-17c8-4218-bac3-ae1ed340d020-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.007752 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.007735 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.007958 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.007943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.013148 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.013120 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c611da0b-17c8-4218-bac3-ae1ed340d020-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.013258 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.013243 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8wtx\" (UniqueName: \"kubernetes.io/projected/c611da0b-17c8-4218-bac3-ae1ed340d020-kube-api-access-x8wtx\") pod \"maas-default-gateway-openshift-default-56654dcf7-7b5x6\" (UID: \"c611da0b-17c8-4218-bac3-ae1ed340d020\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.092673 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.092623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:36.198187 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.198127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:36.250259 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.250232 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6"] Jul 20 19:33:36.251892 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:33:36.251863 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc611da0b_17c8_4218_bac3_ae1ed340d020.slice/crio-c1dafddd55afafc86b7fff14f62767f319862a825823721b3cf1e1b4f1d77f02 WatchSource:0}: Error finding container c1dafddd55afafc86b7fff14f62767f319862a825823721b3cf1e1b4f1d77f02: Status 404 returned error can't find the container with id c1dafddd55afafc86b7fff14f62767f319862a825823721b3cf1e1b4f1d77f02 Jul 20 19:33:36.934830 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:36.934788 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" event={"ID":"c611da0b-17c8-4218-bac3-ae1ed340d020","Type":"ContainerStarted","Data":"c1dafddd55afafc86b7fff14f62767f319862a825823721b3cf1e1b4f1d77f02"} Jul 20 19:33:38.862477 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:38.862438 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:33:38.862775 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:38.862514 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:33:38.862775 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:38.862542 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:33:38.950356 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:38.950327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" event={"ID":"c611da0b-17c8-4218-bac3-ae1ed340d020","Type":"ContainerStarted","Data":"3de50f1aee6c75aa9ed7509a11430ead3954d525a9ff3796e8fe07582bb37d47"} Jul 20 19:33:38.971585 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:38.971541 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" podStartSLOduration=1.363234379 podStartE2EDuration="3.971525978s" totalImagesPullingTime="2.608291599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:33:38.970011033 +0000 UTC m=+668.473331518" watchObservedRunningTime="2026-07-20 19:33:38.971525978 +0000 UTC m=+668.474846504" Jul 20 19:33:39.093197 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.093128 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:39.094443 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.094409 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7b5x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 20 19:33:39.094580 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.094486 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" podUID="c611da0b-17c8-4218-bac3-ae1ed340d020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 20 19:33:39.951322 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.951279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:39.959340 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.959312 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g88z"] Jul 20 19:33:39.962202 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.962181 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:39.964647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.964617 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 20 19:33:39.964756 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.964706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gp7gx\"" Jul 20 19:33:39.971720 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:39.971685 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g88z"] Jul 20 19:33:40.041845 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.041814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6bst\" (UniqueName: \"kubernetes.io/projected/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-kube-api-access-v6bst\") pod \"limitador-limitador-64c94fd64f-7g88z\" (UID: \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:40.042035 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.041888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-config-file\") pod \"limitador-limitador-64c94fd64f-7g88z\" (UID: \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:40.057704 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.057674 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g88z"] Jul 20 19:33:40.062656 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.062616 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:40.097506 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.097481 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:40.143322 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.143291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6bst\" (UniqueName: \"kubernetes.io/projected/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-kube-api-access-v6bst\") pod \"limitador-limitador-64c94fd64f-7g88z\" (UID: \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:40.143582 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.143360 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-config-file\") pod \"limitador-limitador-64c94fd64f-7g88z\" (UID: \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:40.143969 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.143951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-config-file\") pod \"limitador-limitador-64c94fd64f-7g88z\" (UID: \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:40.151586 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.151563 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6bst\" (UniqueName: \"kubernetes.io/projected/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-kube-api-access-v6bst\") pod \"limitador-limitador-64c94fd64f-7g88z\" (UID: \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:40.178731 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.178700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:40.273171 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.273144 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:40.361825 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.361794 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:33:40.365240 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.365219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:40.375178 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.375153 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:33:40.402539 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.402512 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:33:40.409733 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.409706 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g88z"] Jul 20 19:33:40.411852 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:33:40.411826 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc97eeabd_42b6_4f43_abac_9e5d8cea4ce5.slice/crio-9f5cba1c7aa475796709ab2d8dc64e691a7b1e0f9282437e93ef465d519fb7e6 WatchSource:0}: Error finding container 9f5cba1c7aa475796709ab2d8dc64e691a7b1e0f9282437e93ef465d519fb7e6: Status 404 returned error can't find the container with id 9f5cba1c7aa475796709ab2d8dc64e691a7b1e0f9282437e93ef465d519fb7e6 Jul 20 19:33:40.446248 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.446222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j4cs\" (UniqueName: \"kubernetes.io/projected/f1732f90-2717-481b-b849-b08da664d8dc-kube-api-access-6j4cs\") pod \"limitador-limitador-54d6d988d5-frxlk\" (UID: \"f1732f90-2717-481b-b849-b08da664d8dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:40.446343 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.446253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1732f90-2717-481b-b849-b08da664d8dc-config-file\") pod \"limitador-limitador-54d6d988d5-frxlk\" (UID: \"f1732f90-2717-481b-b849-b08da664d8dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:40.547542 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.547469 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1732f90-2717-481b-b849-b08da664d8dc-config-file\") pod \"limitador-limitador-54d6d988d5-frxlk\" (UID: \"f1732f90-2717-481b-b849-b08da664d8dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:40.547665 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.547581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j4cs\" (UniqueName: \"kubernetes.io/projected/f1732f90-2717-481b-b849-b08da664d8dc-kube-api-access-6j4cs\") pod \"limitador-limitador-54d6d988d5-frxlk\" (UID: \"f1732f90-2717-481b-b849-b08da664d8dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:40.548093 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.548076 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1732f90-2717-481b-b849-b08da664d8dc-config-file\") pod \"limitador-limitador-54d6d988d5-frxlk\" (UID: \"f1732f90-2717-481b-b849-b08da664d8dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:40.555250 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.555223 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j4cs\" (UniqueName: \"kubernetes.io/projected/f1732f90-2717-481b-b849-b08da664d8dc-kube-api-access-6j4cs\") pod \"limitador-limitador-54d6d988d5-frxlk\" (UID: \"f1732f90-2717-481b-b849-b08da664d8dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:40.678839 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.678814 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:40.811547 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.811523 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:33:40.812635 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:33:40.812607 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1732f90_2717_481b_b849_b08da664d8dc.slice/crio-5f3c66f9b13fde0743cabe7b350141428ef66665e965c129539e9311557b28e8 WatchSource:0}: Error finding container 5f3c66f9b13fde0743cabe7b350141428ef66665e965c129539e9311557b28e8: Status 404 returned error can't find the container with id 5f3c66f9b13fde0743cabe7b350141428ef66665e965c129539e9311557b28e8 Jul 20 19:33:40.818663 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.818052 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:40.898844 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.898819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:40.961330 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.961302 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" event={"ID":"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5","Type":"ContainerStarted","Data":"9f5cba1c7aa475796709ab2d8dc64e691a7b1e0f9282437e93ef465d519fb7e6"} Jul 20 19:33:40.962666 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.962643 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" event={"ID":"f1732f90-2717-481b-b849-b08da664d8dc","Type":"ContainerStarted","Data":"5f3c66f9b13fde0743cabe7b350141428ef66665e965c129539e9311557b28e8"} Jul 20 19:33:40.962927 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.962909 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:40.963905 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:40.963889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:33:43.982893 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:43.982859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" event={"ID":"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5","Type":"ContainerStarted","Data":"01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c"} Jul 20 19:33:43.983312 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:43.982923 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:43.984374 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:43.984348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" event={"ID":"f1732f90-2717-481b-b849-b08da664d8dc","Type":"ContainerStarted","Data":"727881c2ac73eac93ffabea4df775aafc7b80853029d5a5bbb31e14c73596840"} Jul 20 19:33:43.984506 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:43.984418 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:43.999469 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:43.999425 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" podStartSLOduration=2.186723162 podStartE2EDuration="4.999408178s" totalImagesPullingTime="2.812685016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:33:43.99819614 +0000 UTC m=+673.501516623" watchObservedRunningTime="2026-07-20 19:33:43.999408178 +0000 UTC m=+673.502728648" Jul 20 19:33:44.015495 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:44.015445 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" podStartSLOduration=1.59289676 podStartE2EDuration="4.015428611s" totalImagesPullingTime="2.422531851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:33:44.014440393 +0000 UTC m=+673.517760886" watchObservedRunningTime="2026-07-20 19:33:44.015428611 +0000 UTC m=+673.518749082" Jul 20 19:33:54.996734 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:54.996704 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:54.997149 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:54.996781 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-frxlk" Jul 20 19:33:55.063255 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.063219 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g88z"] Jul 20 19:33:55.063476 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.063373 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" podUID="c97eeabd-42b6-4f43-abac-9e5d8cea4ce5" containerName="limitador" containerID="cri-o://01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c" gracePeriod=30 Jul 20 19:33:55.620627 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.620605 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:55.781485 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.781453 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-config-file\") pod \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\" (UID: \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\") " Jul 20 19:33:55.781636 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.781528 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6bst\" (UniqueName: \"kubernetes.io/projected/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-kube-api-access-v6bst\") pod \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\" (UID: \"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5\") " Jul 20 19:33:55.781804 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.781783 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-config-file" (OuterVolumeSpecName: "config-file") pod "c97eeabd-42b6-4f43-abac-9e5d8cea4ce5" (UID: "c97eeabd-42b6-4f43-abac-9e5d8cea4ce5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:33:55.783529 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.783510 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-kube-api-access-v6bst" (OuterVolumeSpecName: "kube-api-access-v6bst") pod "c97eeabd-42b6-4f43-abac-9e5d8cea4ce5" (UID: "c97eeabd-42b6-4f43-abac-9e5d8cea4ce5"). InnerVolumeSpecName "kube-api-access-v6bst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:33:55.882854 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.882829 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6bst\" (UniqueName: \"kubernetes.io/projected/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-kube-api-access-v6bst\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:33:55.882854 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:55.882850 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5-config-file\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:33:56.056315 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.056241 2561 generic.go:356] "Generic (PLEG): container finished" podID="c97eeabd-42b6-4f43-abac-9e5d8cea4ce5" containerID="01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c" exitCode=0 Jul 20 19:33:56.056315 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.056285 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" Jul 20 19:33:56.056777 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.056327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" event={"ID":"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5","Type":"ContainerDied","Data":"01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c"} Jul 20 19:33:56.056777 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.056401 2561 scope.go:117] "RemoveContainer" containerID="01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c" Jul 20 19:33:56.056777 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.056401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7g88z" event={"ID":"c97eeabd-42b6-4f43-abac-9e5d8cea4ce5","Type":"ContainerDied","Data":"9f5cba1c7aa475796709ab2d8dc64e691a7b1e0f9282437e93ef465d519fb7e6"} Jul 20 19:33:56.066229 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.065958 2561 scope.go:117] "RemoveContainer" containerID="01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c" Jul 20 19:33:56.066229 ip-10-0-135-59 kubenswrapper[2561]: E0720 19:33:56.066197 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c\": container with ID starting with 01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c not found: ID does not exist" containerID="01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c" Jul 20 19:33:56.066229 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.066223 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c"} err="failed to get container status \"01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c\": rpc error: code = NotFound desc = could not find container \"01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c\": container with ID starting with 01dc6cbc9553d0d21ce179e7bab2e2c1ea3e68abd3cea07ec30ab849eaae4d7c not found: ID does not exist" Jul 20 19:33:56.081777 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.081748 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g88z"] Jul 20 19:33:56.090764 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.090741 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7g88z"] Jul 20 19:33:56.114356 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.114333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:56.214016 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.213989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:56.586075 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.586034 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp"] Jul 20 19:33:56.587049 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.587021 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c97eeabd-42b6-4f43-abac-9e5d8cea4ce5" containerName="limitador" Jul 20 19:33:56.587229 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.587213 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c97eeabd-42b6-4f43-abac-9e5d8cea4ce5" containerName="limitador" Jul 20 19:33:56.587586 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.587565 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c97eeabd-42b6-4f43-abac-9e5d8cea4ce5" containerName="limitador" Jul 20 19:33:56.592895 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.592867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:33:56.595067 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.595045 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp"] Jul 20 19:33:56.595624 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.595602 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-fwj54\"" Jul 20 19:33:56.595624 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.595612 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 19:33:56.596691 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.596671 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 20 19:33:56.596691 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.596684 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 20 19:33:56.680799 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.680775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:33:56.692366 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.692342 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8kj2\" (UniqueName: \"kubernetes.io/projected/ca4f3f2a-88c1-4d9d-9044-df5fa8aba460-kube-api-access-s8kj2\") pod \"postgres-69fb4594cf-4m5dp\" (UID: \"ca4f3f2a-88c1-4d9d-9044-df5fa8aba460\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:33:56.692475 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.692426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca4f3f2a-88c1-4d9d-9044-df5fa8aba460-data\") pod \"postgres-69fb4594cf-4m5dp\" (UID: \"ca4f3f2a-88c1-4d9d-9044-df5fa8aba460\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:33:56.793073 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.793047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8kj2\" (UniqueName: \"kubernetes.io/projected/ca4f3f2a-88c1-4d9d-9044-df5fa8aba460-kube-api-access-s8kj2\") pod \"postgres-69fb4594cf-4m5dp\" (UID: \"ca4f3f2a-88c1-4d9d-9044-df5fa8aba460\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:33:56.793193 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.793104 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca4f3f2a-88c1-4d9d-9044-df5fa8aba460-data\") pod \"postgres-69fb4594cf-4m5dp\" (UID: \"ca4f3f2a-88c1-4d9d-9044-df5fa8aba460\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:33:56.793464 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.793448 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca4f3f2a-88c1-4d9d-9044-df5fa8aba460-data\") pod \"postgres-69fb4594cf-4m5dp\" (UID: \"ca4f3f2a-88c1-4d9d-9044-df5fa8aba460\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:33:56.801179 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.801155 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8kj2\" (UniqueName: \"kubernetes.io/projected/ca4f3f2a-88c1-4d9d-9044-df5fa8aba460-kube-api-access-s8kj2\") pod \"postgres-69fb4594cf-4m5dp\" (UID: \"ca4f3f2a-88c1-4d9d-9044-df5fa8aba460\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:33:56.904521 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:56.904465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:33:57.039435 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:57.039408 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp"] Jul 20 19:33:57.040775 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:33:57.040747 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4f3f2a_88c1_4d9d_9044_df5fa8aba460.slice/crio-f2b5a6ce165d97cccb4a3e7968990cf8043c4156a746ce171fb82b8fac4a5b4c WatchSource:0}: Error finding container f2b5a6ce165d97cccb4a3e7968990cf8043c4156a746ce171fb82b8fac4a5b4c: Status 404 returned error can't find the container with id f2b5a6ce165d97cccb4a3e7968990cf8043c4156a746ce171fb82b8fac4a5b4c Jul 20 19:33:57.063988 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:57.063956 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c97eeabd-42b6-4f43-abac-9e5d8cea4ce5" path="/var/lib/kubelet/pods/c97eeabd-42b6-4f43-abac-9e5d8cea4ce5/volumes" Jul 20 19:33:57.064296 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:33:57.064222 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" event={"ID":"ca4f3f2a-88c1-4d9d-9044-df5fa8aba460","Type":"ContainerStarted","Data":"f2b5a6ce165d97cccb4a3e7968990cf8043c4156a746ce171fb82b8fac4a5b4c"} Jul 20 19:34:02.098660 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:02.098619 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" event={"ID":"ca4f3f2a-88c1-4d9d-9044-df5fa8aba460","Type":"ContainerStarted","Data":"a2227f70edfb1754a358be40c26ca4cfd6587758d19c431e6c307c0cd0c8f091"} Jul 20 19:34:02.099054 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:02.098737 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:34:02.114102 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:02.114057 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" podStartSLOduration=1.446170601 podStartE2EDuration="6.114044579s" totalImagesPullingTime="4.667873978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:34:02.112739124 +0000 UTC m=+691.616059593" watchObservedRunningTime="2026-07-20 19:34:02.114044579 +0000 UTC m=+691.617365048" Jul 20 19:34:08.134654 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:08.134621 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4m5dp" Jul 20 19:34:08.450521 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:08.450433 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:08.677108 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:08.677077 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:15.133304 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:15.133268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:15.210445 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:15.210363 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:15.264811 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:15.264772 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:15.489820 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:15.489776 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:16.118759 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:16.118727 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:18.490489 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:18.490454 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:18.593101 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:18.593073 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:41.817441 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:41.817397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:41.866389 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:41.866355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:50.181096 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:50.181060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:50.276032 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:50.276004 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:50.677291 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:50.677251 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:50.820739 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:50.820706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:51.182594 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:51.182556 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:51.273585 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:51.273551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:34:51.455051 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:51.454977 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:34:59.425010 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:59.424911 2561 generic.go:356] "Generic (PLEG): container finished" podID="c611da0b-17c8-4218-bac3-ae1ed340d020" containerID="3de50f1aee6c75aa9ed7509a11430ead3954d525a9ff3796e8fe07582bb37d47" exitCode=0 Jul 20 19:34:59.425010 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:59.424995 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" event={"ID":"c611da0b-17c8-4218-bac3-ae1ed340d020","Type":"ContainerDied","Data":"3de50f1aee6c75aa9ed7509a11430ead3954d525a9ff3796e8fe07582bb37d47"} Jul 20 19:34:59.425458 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:59.425364 2561 scope.go:117] "RemoveContainer" containerID="3de50f1aee6c75aa9ed7509a11430ead3954d525a9ff3796e8fe07582bb37d47" Jul 20 19:34:59.426373 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:59.426344 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:34:59.426502 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:59.426429 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:34:59.426502 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:34:59.426465 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 19:35:00.432813 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:00.432778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" event={"ID":"c611da0b-17c8-4218-bac3-ae1ed340d020","Type":"ContainerStarted","Data":"881eae2766866e71ef14252d73a53e25d7267e7339bf2c2b09655ec843027334"} Jul 20 19:35:01.093066 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:01.093036 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:35:01.093244 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:01.093221 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7b5x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 20 19:35:01.093295 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:01.093264 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" podUID="c611da0b-17c8-4218-bac3-ae1ed340d020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 20 19:35:01.273434 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:01.273370 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:35:01.420993 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:01.420913 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:35:02.093688 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:02.093651 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7b5x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 20 19:35:02.094232 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:02.093717 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" podUID="c611da0b-17c8-4218-bac3-ae1ed340d020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 20 19:35:03.093858 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:03.093820 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7b5x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 20 19:35:03.094327 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:03.093889 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" podUID="c611da0b-17c8-4218-bac3-ae1ed340d020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 20 19:35:04.093263 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:04.093229 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7b5x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 20 19:35:04.093456 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:04.093283 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" podUID="c611da0b-17c8-4218-bac3-ae1ed340d020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 20 19:35:05.096312 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:05.096285 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:35:05.096813 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:05.096627 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:35:05.097204 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:05.097187 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7b5x6" Jul 20 19:35:08.626009 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.625973 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl"] Jul 20 19:35:08.628830 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.628811 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.632719 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.632695 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 19:35:08.632719 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.632710 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dxpmb\"" Jul 20 19:35:08.632901 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.632756 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 20 19:35:08.632901 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.632763 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 19:35:08.640527 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.640497 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl"] Jul 20 19:35:08.655982 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.655945 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:35:08.735907 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.735874 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.735907 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.735910 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.736118 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.735969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a514ebaa-948e-4119-ac4d-5fa4c0374d83-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.736118 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.736011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5cpg\" (UniqueName: \"kubernetes.io/projected/a514ebaa-948e-4119-ac4d-5fa4c0374d83-kube-api-access-p5cpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.736118 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.736063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.736118 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.736115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837087 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837231 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837096 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837231 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837231 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837231 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a514ebaa-948e-4119-ac4d-5fa4c0374d83-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837231 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5cpg\" (UniqueName: \"kubernetes.io/projected/a514ebaa-948e-4119-ac4d-5fa4c0374d83-kube-api-access-p5cpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837602 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837577 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837602 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837600 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.837747 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.837630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.839361 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.839343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a514ebaa-948e-4119-ac4d-5fa4c0374d83-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.839572 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.839556 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a514ebaa-948e-4119-ac4d-5fa4c0374d83-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.845112 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.845093 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5cpg\" (UniqueName: \"kubernetes.io/projected/a514ebaa-948e-4119-ac4d-5fa4c0374d83-kube-api-access-p5cpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl\" (UID: \"a514ebaa-948e-4119-ac4d-5fa4c0374d83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:08.941055 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:08.940992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:09.079268 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:09.079244 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl"] Jul 20 19:35:09.081095 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:35:09.081059 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda514ebaa_948e_4119_ac4d_5fa4c0374d83.slice/crio-b7f131db3611fc307c4f316f0903a80409b40f0c8aef649962d260c11595adeb WatchSource:0}: Error finding container b7f131db3611fc307c4f316f0903a80409b40f0c8aef649962d260c11595adeb: Status 404 returned error can't find the container with id b7f131db3611fc307c4f316f0903a80409b40f0c8aef649962d260c11595adeb Jul 20 19:35:09.143062 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:09.143033 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:35:09.486058 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:09.486018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" event={"ID":"a514ebaa-948e-4119-ac4d-5fa4c0374d83","Type":"ContainerStarted","Data":"b7f131db3611fc307c4f316f0903a80409b40f0c8aef649962d260c11595adeb"} Jul 20 19:35:10.492963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:10.492935 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" event={"ID":"a514ebaa-948e-4119-ac4d-5fa4c0374d83","Type":"ContainerStarted","Data":"01cfb0f7ab79d1f57cc9ab9db3e39f81716c7c14f9a26271c4daa612335c775c"} Jul 20 19:35:10.512036 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:10.511992 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" podStartSLOduration=1.381170623 podStartE2EDuration="2.511976678s" totalImagesPullingTime="1.130806055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:10.509584274 +0000 UTC m=+760.012904735" watchObservedRunningTime="2026-07-20 19:35:10.511976678 +0000 UTC m=+760.015297146" Jul 20 19:35:18.837742 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:18.837706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:35:18.941144 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:18.941109 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:18.941352 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:18.941185 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:18.954221 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:18.954197 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:19.352525 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:19.352495 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:35:19.553975 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:19.553945 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl" Jul 20 19:35:24.132916 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:24.132881 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:35:25.246462 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:25.246423 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:35:44.823822 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.823790 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2"] Jul 20 19:35:44.827801 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.827778 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.830716 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.830694 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 20 19:35:44.831706 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.831673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.831817 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.831720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-988mr\" (UniqueName: \"kubernetes.io/projected/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-kube-api-access-988mr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.831887 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.831868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.831948 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.831905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.831948 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.831933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.832064 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.832045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.842822 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.842799 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2"] Jul 20 19:35:44.861259 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.861211 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:35:44.932680 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.932657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.932789 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.932690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.932789 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.932708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-988mr\" (UniqueName: \"kubernetes.io/projected/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-kube-api-access-988mr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.932789 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.932772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.932947 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.932790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.932947 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.932810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.933087 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.933059 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.933191 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.933159 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.933242 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.933192 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.935008 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.934991 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.935273 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.935255 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:44.941039 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:44.941019 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-988mr\" (UniqueName: \"kubernetes.io/projected/2ca7d56f-ddfb-457a-9c47-8ba9bbed259f-kube-api-access-988mr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2\" (UID: \"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:45.138845 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:45.138772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:45.271537 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:45.271512 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2"] Jul 20 19:35:45.273354 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:35:45.273326 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca7d56f_ddfb_457a_9c47_8ba9bbed259f.slice/crio-e0958289c6b843283ea26cc347c331071db297859c4377d2aa23d7426faad17a WatchSource:0}: Error finding container e0958289c6b843283ea26cc347c331071db297859c4377d2aa23d7426faad17a: Status 404 returned error can't find the container with id e0958289c6b843283ea26cc347c331071db297859c4377d2aa23d7426faad17a Jul 20 19:35:45.684258 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:45.684223 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" event={"ID":"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f","Type":"ContainerStarted","Data":"577e3a2b11d8741aecdf15fbb6cf936499d3318767d291ab5a9b616304c5f61f"} Jul 20 19:35:45.684427 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:45.684277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" event={"ID":"2ca7d56f-ddfb-457a-9c47-8ba9bbed259f","Type":"ContainerStarted","Data":"e0958289c6b843283ea26cc347c331071db297859c4377d2aa23d7426faad17a"} Jul 20 19:35:45.702980 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:45.702932 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" podStartSLOduration=1.5151884359999999 podStartE2EDuration="1.702916986s" totalImagesPullingTime="187.72855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:45.70137072 +0000 UTC m=+795.204691189" watchObservedRunningTime="2026-07-20 19:35:45.702916986 +0000 UTC m=+795.206237454" Jul 20 19:35:46.455731 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:46.455693 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:35:55.139487 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:55.139407 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:55.139921 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:55.139488 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:55.152082 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:55.152062 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:35:55.748947 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:35:55.748919 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2" Jul 20 19:36:12.448892 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:36:12.448856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:36:14.053304 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:36:14.053265 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:36:27.550761 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:36:27.550725 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:36:30.247300 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:36:30.247265 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:37:28.118907 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:28.118828 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:37:31.442710 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:31.442681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:37:31.443838 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:31.443814 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:37:31.447091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:31.447072 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:37:31.447999 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:31.447977 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:37:35.543014 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:35.542966 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:37:35.642505 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:35.642475 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:37:36.738134 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:36.738093 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:37:36.839720 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:36.839685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:37:44.446901 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:44.446864 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:37:44.505860 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:37:44.505833 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:38:04.840941 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:04.840907 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:38:06.367674 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:06.367636 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:38:06.467772 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:06.467736 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:38:15.042509 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:15.042474 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:38:26.354737 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:26.354700 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:38:55.588075 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:55.588000 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:38:55.688679 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:55.688650 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:38:55.789255 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:55.789226 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:38:56.319420 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:56.319371 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:38:56.459634 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:38:56.459600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:39:06.503235 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:39:06.503204 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:39:06.569787 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:39:06.569757 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:39:06.624429 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:39:06.624395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:39:14.803491 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:39:14.803451 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:39:14.862897 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:39:14.862863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:39:22.623818 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:39:22.623782 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:39:43.003826 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:39:43.003788 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:39:44.205934 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:39:44.205887 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:07.358114 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:07.358079 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:40:18.843695 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:18.843660 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:40:24.848231 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:24.848153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:24.946453 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:24.946423 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:25.064168 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:25.064137 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:31.381442 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:31.381408 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:31.483870 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:31.483841 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:31.595713 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:31.595683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:31.778696 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:31.778663 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:37.643034 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:37.643002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:37.723246 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:37.723213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:40:53.359266 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:40:53.359234 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:41:01.656684 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:41:01.656645 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:41:12.755837 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:41:12.755801 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:41:21.556452 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:41:21.556420 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:41:30.972115 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:41:30.972079 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:41:40.750982 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:41:40.750944 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:41:52.249660 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:41:52.249623 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:42:02.464791 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:02.464758 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:42:28.053573 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:28.053542 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:42:31.480623 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:31.480585 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:42:31.483992 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:31.483972 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:42:31.485103 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:31.485085 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:42:31.488033 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:31.488018 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:42:37.552790 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:37.552752 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:42:48.728364 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:48.728326 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:42:50.323817 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:42:50.323782 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:43:00.562335 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:43:00.562299 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:43:11.260517 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:43:11.260484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:43:27.756446 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:43:27.756354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:43:31.124513 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:43:31.124482 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:43:37.455833 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:43:37.455793 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:43:47.553539 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:43:47.553507 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:43:56.354653 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:43:56.354617 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:44:06.157421 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:44:06.157369 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:45:53.756044 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:45:53.756003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:46:04.155041 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:46:04.155009 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:46:14.745972 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:46:14.745933 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:46:27.855494 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:46:27.855410 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:46:38.754624 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:46:38.754582 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:46:48.264043 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:46:48.264004 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:46:56.246872 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:46:56.246832 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:47:08.043289 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:08.043256 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:47:09.800739 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:09.800670 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:47:17.255698 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:17.255660 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:47:26.844581 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:26.844543 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:47:31.518881 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:31.518852 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:47:31.523296 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:31.523269 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:47:31.524285 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:31.524266 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:47:31.528513 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:31.528495 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:47:38.350738 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:47:38.350700 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:48:02.242929 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:02.242844 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:48:10.344647 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:10.344608 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:48:15.851963 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:15.851931 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:48:20.251605 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:20.251571 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:48:29.251524 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:29.251487 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:48:35.050128 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:35.050085 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:48:54.510973 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:54.510942 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:48:56.019430 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:56.019372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:48:58.452006 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:48:58.451968 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:49:11.760451 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:49:11.760417 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:49:21.155736 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:49:21.155701 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:49:33.945692 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:49:33.945659 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:49:48.370537 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:49:48.370503 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:49:57.653128 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:49:57.653098 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:50:11.655396 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:50:11.655349 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:50:21.352537 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:50:21.352505 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:50:34.269973 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:50:34.269942 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:50:35.356220 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:50:35.356188 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:50:51.256057 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:50:51.256022 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:51:03.648498 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:51:03.648419 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:51:15.649459 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:51:15.649421 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:51:24.851123 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:51:24.851089 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:51:26.977141 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:51:26.977100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:51:37.151678 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:51:37.151639 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:51:49.467278 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:51:49.467243 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:52:03.848429 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:03.848393 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:52:05.120889 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:05.120855 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:12.595973 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:12.595936 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:16.355362 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:16.355325 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:52:20.850994 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:20.850941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:26.055294 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:26.055212 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:52:26.228691 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:26.228662 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:29.189141 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:29.189109 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:29.260926 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:29.260895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:29.628224 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:29.628193 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:31.561224 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:31.561194 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:52:31.565606 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:31.565581 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:52:31.565733 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:31.565631 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:52:31.570223 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:31.570204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:52:35.494802 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:35.494769 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:35.565911 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:35.565876 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:35.709582 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:35.709555 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:35.849073 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:35.849002 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:52:36.024325 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:36.024295 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:36.771403 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:36.771345 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:38.674687 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:38.674659 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:38.762765 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:38.762739 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:38.866402 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:38.866357 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:39.024732 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:39.024692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:39.369984 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:39.369904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:39.473315 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:39.473289 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:52:46.248454 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:52:46.248353 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:53:04.252601 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.252563 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8"] Jul 20 19:53:04.256177 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.256160 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" Jul 20 19:53:04.259057 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.259034 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 19:53:04.263906 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.263882 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8"] Jul 20 19:53:04.341459 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.341426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee18544-b29c-4982-9f99-b77304ead9a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8\" (UID: \"7ee18544-b29c-4982-9f99-b77304ead9a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" Jul 20 19:53:04.442351 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.442320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee18544-b29c-4982-9f99-b77304ead9a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8\" (UID: \"7ee18544-b29c-4982-9f99-b77304ead9a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" Jul 20 19:53:04.442957 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.442937 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee18544-b29c-4982-9f99-b77304ead9a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8\" (UID: \"7ee18544-b29c-4982-9f99-b77304ead9a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" Jul 20 19:53:04.569365 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.569287 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" Jul 20 19:53:04.704033 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.704009 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8"] Jul 20 19:53:04.705691 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:53:04.705665 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee18544_b29c_4982_9f99_b77304ead9a6.slice/crio-548c6de12e292510f058049d7981935178a2b3dee7183fb29732b5e0e3f973f2 WatchSource:0}: Error finding container 548c6de12e292510f058049d7981935178a2b3dee7183fb29732b5e0e3f973f2: Status 404 returned error can't find the container with id 548c6de12e292510f058049d7981935178a2b3dee7183fb29732b5e0e3f973f2 Jul 20 19:53:04.707686 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:04.707667 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:53:05.400353 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:05.400321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" event={"ID":"7ee18544-b29c-4982-9f99-b77304ead9a6","Type":"ContainerStarted","Data":"548c6de12e292510f058049d7981935178a2b3dee7183fb29732b5e0e3f973f2"} Jul 20 19:53:07.414836 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:07.414736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" event={"ID":"7ee18544-b29c-4982-9f99-b77304ead9a6","Type":"ContainerStarted","Data":"a93fc38aaa121da5e94216a50184760c9b323857133ce8a773826c1e3df906b6"} Jul 20 19:53:07.432257 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:07.432211 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" podStartSLOduration=1.084725646 podStartE2EDuration="3.432192178s" totalImagesPullingTime="2.347466532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:53:07.431586172 +0000 UTC m=+1836.934906654" watchObservedRunningTime="2026-07-20 19:53:07.432192178 +0000 UTC m=+1836.935512650" Jul 20 19:53:08.422225 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:08.422188 2561 generic.go:356] "Generic (PLEG): container finished" podID="7ee18544-b29c-4982-9f99-b77304ead9a6" containerID="a93fc38aaa121da5e94216a50184760c9b323857133ce8a773826c1e3df906b6" exitCode=0 Jul 20 19:53:08.422636 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:08.422275 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" event={"ID":"7ee18544-b29c-4982-9f99-b77304ead9a6","Type":"ContainerDied","Data":"a93fc38aaa121da5e94216a50184760c9b323857133ce8a773826c1e3df906b6"} Jul 20 19:53:09.577695 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:09.577670 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" Jul 20 19:53:09.692852 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:09.692776 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee18544-b29c-4982-9f99-b77304ead9a6-maas-api-service-ca\") pod \"7ee18544-b29c-4982-9f99-b77304ead9a6\" (UID: \"7ee18544-b29c-4982-9f99-b77304ead9a6\") " Jul 20 19:53:09.693125 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:09.693105 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ee18544-b29c-4982-9f99-b77304ead9a6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ee18544-b29c-4982-9f99-b77304ead9a6" (UID: "7ee18544-b29c-4982-9f99-b77304ead9a6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:53:09.793605 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:09.793575 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ee18544-b29c-4982-9f99-b77304ead9a6-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:53:10.435636 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:10.435609 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" Jul 20 19:53:10.435798 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:10.435607 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8" event={"ID":"7ee18544-b29c-4982-9f99-b77304ead9a6","Type":"ContainerDied","Data":"548c6de12e292510f058049d7981935178a2b3dee7183fb29732b5e0e3f973f2"} Jul 20 19:53:10.435798 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:10.435737 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="548c6de12e292510f058049d7981935178a2b3dee7183fb29732b5e0e3f973f2" Jul 20 19:53:14.696493 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:14.696460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:17.651483 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:17.651445 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:53:19.332783 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:19.332753 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8"] Jul 20 19:53:19.334864 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:19.334834 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:19.337759 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:19.337733 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d9731fc-zhdg8"] Jul 20 19:53:20.529130 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:20.529099 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:20.622622 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:20.622589 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:21.065290 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:21.065254 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ee18544-b29c-4982-9f99-b77304ead9a6" path="/var/lib/kubelet/pods/7ee18544-b29c-4982-9f99-b77304ead9a6/volumes" Jul 20 19:53:25.489875 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:25.489843 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:25.879615 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:25.879528 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:26.062428 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:26.062400 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:26.470986 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:26.470954 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:26.641866 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:26.641833 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:29.051057 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:29.051021 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:53:50.503923 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.503890 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s"] Jul 20 19:53:50.504544 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.504526 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee18544-b29c-4982-9f99-b77304ead9a6" containerName="revoke-keys" Jul 20 19:53:50.504638 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.504547 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee18544-b29c-4982-9f99-b77304ead9a6" containerName="revoke-keys" Jul 20 19:53:50.504693 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.504674 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ee18544-b29c-4982-9f99-b77304ead9a6" containerName="revoke-keys" Jul 20 19:53:50.509872 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.509849 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" Jul 20 19:53:50.512837 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.512816 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 19:53:50.515756 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.515728 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s"] Jul 20 19:53:50.534575 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.534555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/186b70bf-133e-460e-a5fc-d6906cc5b3d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s\" (UID: \"186b70bf-133e-460e-a5fc-d6906cc5b3d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" Jul 20 19:53:50.635425 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.635402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/186b70bf-133e-460e-a5fc-d6906cc5b3d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s\" (UID: \"186b70bf-133e-460e-a5fc-d6906cc5b3d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" Jul 20 19:53:50.635969 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.635952 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/186b70bf-133e-460e-a5fc-d6906cc5b3d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s\" (UID: \"186b70bf-133e-460e-a5fc-d6906cc5b3d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" Jul 20 19:53:50.824485 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:50.824403 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" Jul 20 19:53:51.164087 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:51.164066 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s"] Jul 20 19:53:51.165580 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:53:51.165552 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186b70bf_133e_460e_a5fc_d6906cc5b3d8.slice/crio-d9b9a7f3bbd49e5c8496260349714a7c05fa8535e57ce25bd2906578c2f07ebb WatchSource:0}: Error finding container d9b9a7f3bbd49e5c8496260349714a7c05fa8535e57ce25bd2906578c2f07ebb: Status 404 returned error can't find the container with id d9b9a7f3bbd49e5c8496260349714a7c05fa8535e57ce25bd2906578c2f07ebb Jul 20 19:53:51.656714 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:51.656680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" event={"ID":"186b70bf-133e-460e-a5fc-d6906cc5b3d8","Type":"ContainerStarted","Data":"ddaea3d6ce9923139d177e175f3b09f43097120699556912feca9d7f240a40ec"} Jul 20 19:53:51.657101 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:51.656740 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" event={"ID":"186b70bf-133e-460e-a5fc-d6906cc5b3d8","Type":"ContainerStarted","Data":"d9b9a7f3bbd49e5c8496260349714a7c05fa8535e57ce25bd2906578c2f07ebb"} Jul 20 19:53:51.674198 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:51.674153 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" podStartSLOduration=1.674137343 podStartE2EDuration="1.674137343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:53:51.672594639 +0000 UTC m=+1881.175915128" watchObservedRunningTime="2026-07-20 19:53:51.674137343 +0000 UTC m=+1881.177457812" Jul 20 19:53:52.672854 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:52.672817 2561 generic.go:356] "Generic (PLEG): container finished" podID="186b70bf-133e-460e-a5fc-d6906cc5b3d8" containerID="ddaea3d6ce9923139d177e175f3b09f43097120699556912feca9d7f240a40ec" exitCode=0 Jul 20 19:53:52.673240 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:52.672881 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" event={"ID":"186b70bf-133e-460e-a5fc-d6906cc5b3d8","Type":"ContainerDied","Data":"ddaea3d6ce9923139d177e175f3b09f43097120699556912feca9d7f240a40ec"} Jul 20 19:53:53.812967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:53.812945 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" Jul 20 19:53:53.862534 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:53.862507 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/186b70bf-133e-460e-a5fc-d6906cc5b3d8-maas-api-service-ca\") pod \"186b70bf-133e-460e-a5fc-d6906cc5b3d8\" (UID: \"186b70bf-133e-460e-a5fc-d6906cc5b3d8\") " Jul 20 19:53:53.862827 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:53.862807 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/186b70bf-133e-460e-a5fc-d6906cc5b3d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "186b70bf-133e-460e-a5fc-d6906cc5b3d8" (UID: "186b70bf-133e-460e-a5fc-d6906cc5b3d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:53:53.963399 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:53.963320 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/186b70bf-133e-460e-a5fc-d6906cc5b3d8-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:53:54.685515 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:54.685485 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" Jul 20 19:53:54.685672 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:54.685516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s" event={"ID":"186b70bf-133e-460e-a5fc-d6906cc5b3d8","Type":"ContainerDied","Data":"d9b9a7f3bbd49e5c8496260349714a7c05fa8535e57ce25bd2906578c2f07ebb"} Jul 20 19:53:54.685672 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:54.685565 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9b9a7f3bbd49e5c8496260349714a7c05fa8535e57ce25bd2906578c2f07ebb" Jul 20 19:53:55.795140 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:55.795106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:53:55.891842 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:53:55.891817 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:01.107288 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:01.107251 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:03.851352 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:03.851311 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:54:05.592922 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:05.592883 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:05.614043 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:05.614013 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s"] Jul 20 19:54:05.619642 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:05.619606 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6c09e49f-v6q4s"] Jul 20 19:54:05.784720 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:05.784687 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:05.992180 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:05.992138 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:06.218614 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:06.218586 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:06.547581 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:06.547551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:06.975850 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:06.975819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:07.064456 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:07.064428 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="186b70bf-133e-460e-a5fc-d6906cc5b3d8" path="/var/lib/kubelet/pods/186b70bf-133e-460e-a5fc-d6906cc5b3d8/volumes" Jul 20 19:54:08.686055 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:08.686023 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:08.826855 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:08.826820 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:08.967418 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:08.967317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:09.301593 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:09.301564 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:09.655996 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:09.655922 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:09.743490 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:09.743457 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:15.660667 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:15.660636 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:54:34.444144 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.444109 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx"] Jul 20 19:54:34.444615 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.444520 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186b70bf-133e-460e-a5fc-d6906cc5b3d8" containerName="revoke-keys" Jul 20 19:54:34.444615 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.444533 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="186b70bf-133e-460e-a5fc-d6906cc5b3d8" containerName="revoke-keys" Jul 20 19:54:34.444615 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.444601 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="186b70bf-133e-460e-a5fc-d6906cc5b3d8" containerName="revoke-keys" Jul 20 19:54:34.447571 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.447554 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" Jul 20 19:54:34.451257 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.451239 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 19:54:34.464222 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.464201 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx"] Jul 20 19:54:34.599404 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.599358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2a8021-19b9-42a3-b22b-79931c859730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx\" (UID: \"0b2a8021-19b9-42a3-b22b-79931c859730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" Jul 20 19:54:34.700062 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.700001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2a8021-19b9-42a3-b22b-79931c859730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx\" (UID: \"0b2a8021-19b9-42a3-b22b-79931c859730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" Jul 20 19:54:34.700574 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.700558 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2a8021-19b9-42a3-b22b-79931c859730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx\" (UID: \"0b2a8021-19b9-42a3-b22b-79931c859730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" Jul 20 19:54:34.757649 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.757629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" Jul 20 19:54:34.904710 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:34.904675 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx"] Jul 20 19:54:34.907021 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:54:34.906991 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2a8021_19b9_42a3_b22b_79931c859730.slice/crio-dd3d5ff7802c11dcb672a4b8ac3baa501b4b6fdb15c2c5d559d88dce740c642c WatchSource:0}: Error finding container dd3d5ff7802c11dcb672a4b8ac3baa501b4b6fdb15c2c5d559d88dce740c642c: Status 404 returned error can't find the container with id dd3d5ff7802c11dcb672a4b8ac3baa501b4b6fdb15c2c5d559d88dce740c642c Jul 20 19:54:35.919986 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:35.919910 2561 generic.go:356] "Generic (PLEG): container finished" podID="0b2a8021-19b9-42a3-b22b-79931c859730" containerID="6ce02a026beada4c0c464124d0ba09ae2555c0bd2b61f7aa24e9810eca36b075" exitCode=0 Jul 20 19:54:35.920348 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:35.919996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" event={"ID":"0b2a8021-19b9-42a3-b22b-79931c859730","Type":"ContainerDied","Data":"6ce02a026beada4c0c464124d0ba09ae2555c0bd2b61f7aa24e9810eca36b075"} Jul 20 19:54:35.920348 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:35.920061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" event={"ID":"0b2a8021-19b9-42a3-b22b-79931c859730","Type":"ContainerStarted","Data":"dd3d5ff7802c11dcb672a4b8ac3baa501b4b6fdb15c2c5d559d88dce740c642c"} Jul 20 19:54:37.078332 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:37.078307 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" Jul 20 19:54:37.223445 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:37.223413 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2a8021-19b9-42a3-b22b-79931c859730-maas-api-service-ca\") pod \"0b2a8021-19b9-42a3-b22b-79931c859730\" (UID: \"0b2a8021-19b9-42a3-b22b-79931c859730\") " Jul 20 19:54:37.223729 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:37.223708 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b2a8021-19b9-42a3-b22b-79931c859730-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0b2a8021-19b9-42a3-b22b-79931c859730" (UID: "0b2a8021-19b9-42a3-b22b-79931c859730"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:54:37.324975 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:37.324948 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2a8021-19b9-42a3-b22b-79931c859730-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:54:37.931582 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:37.931547 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" event={"ID":"0b2a8021-19b9-42a3-b22b-79931c859730","Type":"ContainerDied","Data":"dd3d5ff7802c11dcb672a4b8ac3baa501b4b6fdb15c2c5d559d88dce740c642c"} Jul 20 19:54:37.931738 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:37.931620 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd3d5ff7802c11dcb672a4b8ac3baa501b4b6fdb15c2c5d559d88dce740c642c" Jul 20 19:54:37.931738 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:37.931556 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx" Jul 20 19:54:44.967857 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:44.967787 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:47.970999 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:47.970970 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:54:49.508434 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:49.508366 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx"] Jul 20 19:54:49.510978 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:49.510943 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:49.511183 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:49.511163 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d9b02c4d-fznbx"] Jul 20 19:54:50.747499 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:50.747451 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:50.961519 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:50.961487 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:51.064148 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:51.064078 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b2a8021-19b9-42a3-b22b-79931c859730" path="/var/lib/kubelet/pods/0b2a8021-19b9-42a3-b22b-79931c859730/volumes" Jul 20 19:54:51.194796 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:51.194769 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:51.646336 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:51.646307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:52.176710 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:52.176675 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:53.884745 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:53.884708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:53.995816 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:53.995776 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:54.180091 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:54.179995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:54.353316 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:54.353275 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:54.806981 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:54.806950 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:54.909056 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:54.909024 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:54:59.812694 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:54:59.812663 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:55:07.599669 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:07.599641 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:07.696558 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:07.696529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:15.675092 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:15.675057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:15.775375 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:15.775342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:18.729593 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.729563 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx"] Jul 20 19:55:18.730031 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.729949 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2a8021-19b9-42a3-b22b-79931c859730" containerName="revoke-keys" Jul 20 19:55:18.730031 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.729961 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2a8021-19b9-42a3-b22b-79931c859730" containerName="revoke-keys" Jul 20 19:55:18.730031 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.730028 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2a8021-19b9-42a3-b22b-79931c859730" containerName="revoke-keys" Jul 20 19:55:18.733178 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.733162 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" Jul 20 19:55:18.736552 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.736536 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 19:55:18.748618 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.748586 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx"] Jul 20 19:55:18.858052 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.858026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a14ae87-27e5-495d-a93b-678d31c8dc82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx\" (UID: \"7a14ae87-27e5-495d-a93b-678d31c8dc82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" Jul 20 19:55:18.958913 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.958886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a14ae87-27e5-495d-a93b-678d31c8dc82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx\" (UID: \"7a14ae87-27e5-495d-a93b-678d31c8dc82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" Jul 20 19:55:18.959509 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:18.959488 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a14ae87-27e5-495d-a93b-678d31c8dc82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx\" (UID: \"7a14ae87-27e5-495d-a93b-678d31c8dc82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" Jul 20 19:55:19.043533 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:19.043456 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" Jul 20 19:55:19.384495 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:19.384468 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx"] Jul 20 19:55:19.385691 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:55:19.385665 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a14ae87_27e5_495d_a93b_678d31c8dc82.slice/crio-6e0db23da9fbc8d027353bdfcce472a736e53a55d1e27aaba1a16a1f19c68514 WatchSource:0}: Error finding container 6e0db23da9fbc8d027353bdfcce472a736e53a55d1e27aaba1a16a1f19c68514: Status 404 returned error can't find the container with id 6e0db23da9fbc8d027353bdfcce472a736e53a55d1e27aaba1a16a1f19c68514 Jul 20 19:55:20.166786 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:20.166744 2561 generic.go:356] "Generic (PLEG): container finished" podID="7a14ae87-27e5-495d-a93b-678d31c8dc82" containerID="fdb80ad84c09d1d5837334bfcd0b3011269b48caf6497e90b4001ae27b3e3b4e" exitCode=0 Jul 20 19:55:20.167198 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:20.166800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" event={"ID":"7a14ae87-27e5-495d-a93b-678d31c8dc82","Type":"ContainerDied","Data":"fdb80ad84c09d1d5837334bfcd0b3011269b48caf6497e90b4001ae27b3e3b4e"} Jul 20 19:55:20.167198 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:20.166845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" event={"ID":"7a14ae87-27e5-495d-a93b-678d31c8dc82","Type":"ContainerStarted","Data":"6e0db23da9fbc8d027353bdfcce472a736e53a55d1e27aaba1a16a1f19c68514"} Jul 20 19:55:21.315202 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:21.315171 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" Jul 20 19:55:21.384777 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:21.384751 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a14ae87-27e5-495d-a93b-678d31c8dc82-maas-api-service-ca\") pod \"7a14ae87-27e5-495d-a93b-678d31c8dc82\" (UID: \"7a14ae87-27e5-495d-a93b-678d31c8dc82\") " Jul 20 19:55:21.385114 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:21.385095 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a14ae87-27e5-495d-a93b-678d31c8dc82-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7a14ae87-27e5-495d-a93b-678d31c8dc82" (UID: "7a14ae87-27e5-495d-a93b-678d31c8dc82"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:55:21.485804 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:21.485779 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a14ae87-27e5-495d-a93b-678d31c8dc82-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:55:22.179536 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:22.179512 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" Jul 20 19:55:22.179721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:22.179508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx" event={"ID":"7a14ae87-27e5-495d-a93b-678d31c8dc82","Type":"ContainerDied","Data":"6e0db23da9fbc8d027353bdfcce472a736e53a55d1e27aaba1a16a1f19c68514"} Jul 20 19:55:22.179721 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:22.179648 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e0db23da9fbc8d027353bdfcce472a736e53a55d1e27aaba1a16a1f19c68514" Jul 20 19:55:29.452495 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:29.452403 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:32.573258 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:32.573222 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:55:33.797364 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:33.797330 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx"] Jul 20 19:55:33.803049 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:33.803026 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e9637aa-6hlxx"] Jul 20 19:55:33.916648 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:33.916602 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:33.985049 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:33.985010 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:34.187309 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:34.187231 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:34.683682 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:34.683650 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:34.778961 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:34.778929 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:35.064714 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:35.064680 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a14ae87-27e5-495d-a93b-678d31c8dc82" path="/var/lib/kubelet/pods/7a14ae87-27e5-495d-a93b-678d31c8dc82/volumes" Jul 20 19:55:35.115641 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:35.115606 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:36.327280 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:36.327240 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:42.344313 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:42.344283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:42.473365 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:42.473333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:42.565861 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:42.565828 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:42.663225 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:42.663139 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:55:43.048892 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:55:43.048860 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:09.055579 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:09.055543 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:09.192798 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:09.192760 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:09.249034 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:09.249001 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:15.289870 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:15.289836 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:15.400909 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:15.400872 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:15.486600 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:15.486569 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:31.466243 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:31.466206 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:37.317225 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:37.317188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:37.388108 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:37.388075 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:37.489694 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:37.489657 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:37.585916 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:37.585827 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:48.105353 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:48.105318 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:48.971481 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:48.971448 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:55.509751 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:55.509677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:55.614921 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:55.614884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:55.709165 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:55.709140 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:55.807360 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:55.807288 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:56.684028 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:56.683996 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:56.780868 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:56.780839 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:56.883772 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:56.883740 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:58.536532 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:56:58.536496 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:00.250914 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:00.250881 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:57:05.028706 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:05.028666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:05.146715 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:05.146687 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:05.776208 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:05.776177 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:09.947471 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:09.947435 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:57:11.852431 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:11.852394 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:11.951706 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:11.951684 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:12.086845 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:12.086814 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:12.428112 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:12.428080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:12.534951 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:12.534919 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:15.363904 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:15.363869 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:15.458286 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:15.458253 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:15.566710 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:15.566677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:15.794759 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:15.794731 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:16.051365 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:16.051280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:16.159967 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:16.159938 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:19.866317 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:19.866279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:20.555866 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:20.555838 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:20.656309 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:20.656276 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:20.848598 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:20.848519 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:57:21.031576 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:21.031547 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:27.362116 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.362080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:27.462198 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.462167 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:27.739830 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.739804 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt"] Jul 20 19:57:27.740207 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.740195 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a14ae87-27e5-495d-a93b-678d31c8dc82" containerName="revoke-keys" Jul 20 19:57:27.740255 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.740209 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a14ae87-27e5-495d-a93b-678d31c8dc82" containerName="revoke-keys" Jul 20 19:57:27.740290 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.740284 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a14ae87-27e5-495d-a93b-678d31c8dc82" containerName="revoke-keys" Jul 20 19:57:27.743321 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.743306 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" Jul 20 19:57:27.746243 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.746224 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 19:57:27.751485 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.750982 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt"] Jul 20 19:57:27.893171 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.893137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fba74aac-172e-45ce-a61e-c9c66bf3b178-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt\" (UID: \"fba74aac-172e-45ce-a61e-c9c66bf3b178\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" Jul 20 19:57:27.994250 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.994172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fba74aac-172e-45ce-a61e-c9c66bf3b178-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt\" (UID: \"fba74aac-172e-45ce-a61e-c9c66bf3b178\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" Jul 20 19:57:27.994775 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:27.994758 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fba74aac-172e-45ce-a61e-c9c66bf3b178-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt\" (UID: \"fba74aac-172e-45ce-a61e-c9c66bf3b178\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" Jul 20 19:57:28.054894 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:28.054874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" Jul 20 19:57:28.189902 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:28.189865 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt"] Jul 20 19:57:28.191525 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:57:28.191498 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba74aac_172e_45ce_a61e_c9c66bf3b178.slice/crio-a3c3f1925f6b7eccfbb93adeee224b6d594c901442640b7ceaf7b520604702b4 WatchSource:0}: Error finding container a3c3f1925f6b7eccfbb93adeee224b6d594c901442640b7ceaf7b520604702b4: Status 404 returned error can't find the container with id a3c3f1925f6b7eccfbb93adeee224b6d594c901442640b7ceaf7b520604702b4 Jul 20 19:57:28.880429 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:28.880368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" event={"ID":"fba74aac-172e-45ce-a61e-c9c66bf3b178","Type":"ContainerStarted","Data":"9ed46e8a47fa51d2c1ca478b9c25d6f7a3e4fa4e296d148bd25e0fba88c6360c"} Jul 20 19:57:28.880845 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:28.880444 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" event={"ID":"fba74aac-172e-45ce-a61e-c9c66bf3b178","Type":"ContainerStarted","Data":"a3c3f1925f6b7eccfbb93adeee224b6d594c901442640b7ceaf7b520604702b4"} Jul 20 19:57:28.897784 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:28.897741 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" podStartSLOduration=1.897725678 podStartE2EDuration="1.897725678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:28.895489562 +0000 UTC m=+2098.398810031" watchObservedRunningTime="2026-07-20 19:57:28.897725678 +0000 UTC m=+2098.401046193" Jul 20 19:57:29.893995 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:29.893961 2561 generic.go:356] "Generic (PLEG): container finished" podID="fba74aac-172e-45ce-a61e-c9c66bf3b178" containerID="9ed46e8a47fa51d2c1ca478b9c25d6f7a3e4fa4e296d148bd25e0fba88c6360c" exitCode=0 Jul 20 19:57:29.894409 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:29.894042 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" event={"ID":"fba74aac-172e-45ce-a61e-c9c66bf3b178","Type":"ContainerDied","Data":"9ed46e8a47fa51d2c1ca478b9c25d6f7a3e4fa4e296d148bd25e0fba88c6360c"} Jul 20 19:57:31.031237 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.031209 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" Jul 20 19:57:31.122392 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.122357 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fba74aac-172e-45ce-a61e-c9c66bf3b178-maas-api-service-ca\") pod \"fba74aac-172e-45ce-a61e-c9c66bf3b178\" (UID: \"fba74aac-172e-45ce-a61e-c9c66bf3b178\") " Jul 20 19:57:31.122652 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.122629 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fba74aac-172e-45ce-a61e-c9c66bf3b178-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fba74aac-172e-45ce-a61e-c9c66bf3b178" (UID: "fba74aac-172e-45ce-a61e-c9c66bf3b178"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:57:31.223365 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.223342 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fba74aac-172e-45ce-a61e-c9c66bf3b178-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:57:31.599463 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.599361 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:57:31.604247 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.604227 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:57:31.607634 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.607611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 19:57:31.611769 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.611752 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 19:57:31.907476 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.907413 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" Jul 20 19:57:31.907603 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.907408 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt" event={"ID":"fba74aac-172e-45ce-a61e-c9c66bf3b178","Type":"ContainerDied","Data":"a3c3f1925f6b7eccfbb93adeee224b6d594c901442640b7ceaf7b520604702b4"} Jul 20 19:57:31.907603 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:31.907532 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3c3f1925f6b7eccfbb93adeee224b6d594c901442640b7ceaf7b520604702b4" Jul 20 19:57:38.241557 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:38.241525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:40.977635 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:40.977601 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:57:42.820929 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:42.820896 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:42.827706 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:42.827681 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt"] Jul 20 19:57:42.829986 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:42.829967 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd3c7e9a-twltt"] Jul 20 19:57:43.064107 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:43.064075 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fba74aac-172e-45ce-a61e-c9c66bf3b178" path="/var/lib/kubelet/pods/fba74aac-172e-45ce-a61e-c9c66bf3b178/volumes" Jul 20 19:57:43.223865 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:43.223836 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:49.588854 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:49.588815 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:49.686575 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:49.686541 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:49.933972 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:49.933884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:50.122782 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:50.122748 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:50.268527 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:50.268497 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:50.353278 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:50.353250 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:50.460112 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:50.460077 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:56.537189 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:56.537147 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:56.643964 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:56.643928 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:56.737683 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:56.737640 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:56.897984 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:57:56.897897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:02.915295 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:02.915255 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:02.985008 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:02.984977 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:09.806973 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:09.806915 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:10.137426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:10.137309 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:10.518973 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:10.518942 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:13.233330 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:13.233301 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:13.329553 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:13.329523 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:13.428312 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:13.428281 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:13.531742 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:13.531654 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:14.078318 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:14.078285 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:14.181244 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:14.181215 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:17.720316 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:17.720272 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:20.072366 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:20.072333 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:58:34.462132 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:34.462078 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:37.453525 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:37.453493 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:58:52.955580 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:52.955543 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:58:56.344791 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.344760 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b"] Jul 20 19:58:56.345184 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.345143 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba74aac-172e-45ce-a61e-c9c66bf3b178" containerName="revoke-keys" Jul 20 19:58:56.345184 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.345153 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba74aac-172e-45ce-a61e-c9c66bf3b178" containerName="revoke-keys" Jul 20 19:58:56.345273 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.345232 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fba74aac-172e-45ce-a61e-c9c66bf3b178" containerName="revoke-keys" Jul 20 19:58:56.348392 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.348367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" Jul 20 19:58:56.351347 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.351328 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 19:58:56.357885 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.357863 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b"] Jul 20 19:58:56.448723 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.448694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2391b48-9ef3-4886-8eee-1826aafd3a3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-723955e5-mx76b\" (UID: \"d2391b48-9ef3-4886-8eee-1826aafd3a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" Jul 20 19:58:56.549997 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.549965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2391b48-9ef3-4886-8eee-1826aafd3a3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-723955e5-mx76b\" (UID: \"d2391b48-9ef3-4886-8eee-1826aafd3a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" Jul 20 19:58:56.550626 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.550604 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2391b48-9ef3-4886-8eee-1826aafd3a3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-723955e5-mx76b\" (UID: \"d2391b48-9ef3-4886-8eee-1826aafd3a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" Jul 20 19:58:56.659849 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.659787 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" Jul 20 19:58:56.791343 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:56.791317 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b"] Jul 20 19:58:56.793490 ip-10-0-135-59 kubenswrapper[2561]: W0720 19:58:56.793461 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2391b48_9ef3_4886_8eee_1826aafd3a3d.slice/crio-f8f96fd1f1f5443e59c353437b02f7454799a20e9590e5a5de9f4a88d3051722 WatchSource:0}: Error finding container f8f96fd1f1f5443e59c353437b02f7454799a20e9590e5a5de9f4a88d3051722: Status 404 returned error can't find the container with id f8f96fd1f1f5443e59c353437b02f7454799a20e9590e5a5de9f4a88d3051722 Jul 20 19:58:57.400784 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:57.400603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" event={"ID":"d2391b48-9ef3-4886-8eee-1826aafd3a3d","Type":"ContainerStarted","Data":"4b58109138f5e728dacf98e036f353aaa28051d876d99151c4f4c67e0040e192"} Jul 20 19:58:57.400784 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:57.400665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" event={"ID":"d2391b48-9ef3-4886-8eee-1826aafd3a3d","Type":"ContainerStarted","Data":"f8f96fd1f1f5443e59c353437b02f7454799a20e9590e5a5de9f4a88d3051722"} Jul 20 19:58:57.417740 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:57.417694 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" podStartSLOduration=1.417676486 podStartE2EDuration="1.417676486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:58:57.416131561 +0000 UTC m=+2186.919452022" watchObservedRunningTime="2026-07-20 19:58:57.417676486 +0000 UTC m=+2186.920996955" Jul 20 19:58:58.407970 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:58.407939 2561 generic.go:356] "Generic (PLEG): container finished" podID="d2391b48-9ef3-4886-8eee-1826aafd3a3d" containerID="4b58109138f5e728dacf98e036f353aaa28051d876d99151c4f4c67e0040e192" exitCode=0 Jul 20 19:58:58.408331 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:58.407997 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" event={"ID":"d2391b48-9ef3-4886-8eee-1826aafd3a3d","Type":"ContainerDied","Data":"4b58109138f5e728dacf98e036f353aaa28051d876d99151c4f4c67e0040e192"} Jul 20 19:58:59.555083 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:59.555057 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" Jul 20 19:58:59.675131 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:59.675062 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2391b48-9ef3-4886-8eee-1826aafd3a3d-maas-api-service-ca\") pod \"d2391b48-9ef3-4886-8eee-1826aafd3a3d\" (UID: \"d2391b48-9ef3-4886-8eee-1826aafd3a3d\") " Jul 20 19:58:59.675426 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:59.675403 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2391b48-9ef3-4886-8eee-1826aafd3a3d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d2391b48-9ef3-4886-8eee-1826aafd3a3d" (UID: "d2391b48-9ef3-4886-8eee-1826aafd3a3d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:58:59.776479 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:58:59.776453 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2391b48-9ef3-4886-8eee-1826aafd3a3d-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 19:59:00.427080 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:00.427049 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" Jul 20 19:59:00.427228 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:00.427096 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b" event={"ID":"d2391b48-9ef3-4886-8eee-1826aafd3a3d","Type":"ContainerDied","Data":"f8f96fd1f1f5443e59c353437b02f7454799a20e9590e5a5de9f4a88d3051722"} Jul 20 19:59:00.427228 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:00.427147 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8f96fd1f1f5443e59c353437b02f7454799a20e9590e5a5de9f4a88d3051722" Jul 20 19:59:10.360731 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:10.360702 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:59:11.925811 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:11.925779 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:16.423056 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:16.423018 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b"] Jul 20 19:59:16.425337 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:16.425310 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723955e5-mx76b"] Jul 20 19:59:16.425897 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:16.425877 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:17.064137 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:17.064101 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2391b48-9ef3-4886-8eee-1826aafd3a3d" path="/var/lib/kubelet/pods/d2391b48-9ef3-4886-8eee-1826aafd3a3d/volumes" Jul 20 19:59:18.669267 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:18.669233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:20.849509 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:20.849471 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 19:59:23.751761 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:23.751724 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:31.614319 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:31.614287 2561 scope.go:117] "RemoveContainer" containerID="a93fc38aaa121da5e94216a50184760c9b323857133ce8a773826c1e3df906b6" Jul 20 19:59:59.994170 ip-10-0-135-59 kubenswrapper[2561]: I0720 19:59:59.994045 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:00.210928 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.210888 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6"] Jul 20 20:00:00.211409 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.211370 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2391b48-9ef3-4886-8eee-1826aafd3a3d" containerName="revoke-keys" Jul 20 20:00:00.211409 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.211405 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2391b48-9ef3-4886-8eee-1826aafd3a3d" containerName="revoke-keys" Jul 20 20:00:00.211588 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.211493 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2391b48-9ef3-4886-8eee-1826aafd3a3d" containerName="revoke-keys" Jul 20 20:00:00.214538 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.214518 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" Jul 20 20:00:00.217494 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.217475 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 20:00:00.222195 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.222174 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6"] Jul 20 20:00:00.226729 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.226710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" Jul 20 20:00:00.376741 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.376712 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6"] Jul 20 20:00:00.378167 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:00:00.378143 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97ef79c_56b3_473a_aa9e_ed79d0373807.slice/crio-185fde1bfdd9fc0b683fe8ea3161ec3fc464e0bb3176d2f1c00b08e2d8a967e7 WatchSource:0}: Error finding container 185fde1bfdd9fc0b683fe8ea3161ec3fc464e0bb3176d2f1c00b08e2d8a967e7: Status 404 returned error can't find the container with id 185fde1bfdd9fc0b683fe8ea3161ec3fc464e0bb3176d2f1c00b08e2d8a967e7 Jul 20 20:00:00.762784 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.762748 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" event={"ID":"b97ef79c-56b3-473a-aa9e-ed79d0373807","Type":"ContainerStarted","Data":"32203587fee43c650c96accf28c813cd92ae17fb50de77a41abfd814898ee3b4"} Jul 20 20:00:00.762912 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.762809 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" event={"ID":"b97ef79c-56b3-473a-aa9e-ed79d0373807","Type":"ContainerStarted","Data":"185fde1bfdd9fc0b683fe8ea3161ec3fc464e0bb3176d2f1c00b08e2d8a967e7"} Jul 20 20:00:00.779495 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:00.779446 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" podStartSLOduration=0.779429329 podStartE2EDuration="779.429329ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:00:00.777908091 +0000 UTC m=+2250.281228584" watchObservedRunningTime="2026-07-20 20:00:00.779429329 +0000 UTC m=+2250.282749798" Jul 20 20:00:01.231578 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:01.231547 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:01.769586 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:01.769553 2561 generic.go:356] "Generic (PLEG): container finished" podID="b97ef79c-56b3-473a-aa9e-ed79d0373807" containerID="32203587fee43c650c96accf28c813cd92ae17fb50de77a41abfd814898ee3b4" exitCode=0 Jul 20 20:00:01.769770 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:01.769640 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" event={"ID":"b97ef79c-56b3-473a-aa9e-ed79d0373807","Type":"ContainerDied","Data":"32203587fee43c650c96accf28c813cd92ae17fb50de77a41abfd814898ee3b4"} Jul 20 20:00:02.909953 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:02.909930 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" Jul 20 20:00:03.782745 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:03.782712 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" event={"ID":"b97ef79c-56b3-473a-aa9e-ed79d0373807","Type":"ContainerDied","Data":"185fde1bfdd9fc0b683fe8ea3161ec3fc464e0bb3176d2f1c00b08e2d8a967e7"} Jul 20 20:00:03.782922 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:03.782765 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="185fde1bfdd9fc0b683fe8ea3161ec3fc464e0bb3176d2f1c00b08e2d8a967e7" Jul 20 20:00:03.782922 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:03.782733 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-v2dx6" Jul 20 20:00:06.706206 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:06.706173 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:06.770324 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:06.770298 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:07.015710 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:07.015680 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:07.230872 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:07.230839 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:08.328905 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:08.328872 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:08.426835 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:08.426806 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:08.530677 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:08.530644 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:08.673777 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:08.673706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:08.767867 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:08.767834 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:09.286516 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:09.286488 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:09.396880 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:09.396846 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:09.490751 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:09.490723 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:10.840021 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:10.839988 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:10.965364 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:10.965326 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:00:16.513312 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:16.513280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:16.630439 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:16.630405 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:17.223146 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:17.223113 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:22.777213 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:22.777179 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:00:23.773829 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:23.773795 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:23.883217 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:23.883184 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:23.974702 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:23.974673 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:31.634725 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:31.634695 2561 scope.go:117] "RemoveContainer" containerID="ddaea3d6ce9923139d177e175f3b09f43097120699556912feca9d7f240a40ec" Jul 20 20:00:34.501307 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:34.501268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:35.552736 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:35.552692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:55.946801 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:00:55.946770 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:02.629985 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:02.629955 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:03.075627 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:03.075596 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:03.182455 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:03.182422 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:03.285249 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:03.285215 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:03.703456 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:03.703425 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:06.116176 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:06.116142 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:06.202013 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:06.201985 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:06.307623 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:06.307589 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:06.535566 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:06.535525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:06.805002 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:06.804921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:06.907044 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:06.907014 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:07.275876 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:07.275844 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:10.601028 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:10.600995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:10.916418 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:10.916302 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:11.218787 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:11.218709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:11.400936 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:11.400900 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:11.953482 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:11.953455 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:01:13.940662 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:13.940627 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:14.040902 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:14.040862 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:14.125531 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:14.125495 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:14.377432 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:14.377402 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:14.641593 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:14.641512 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:14.738588 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:14.738558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:18.405091 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:18.405060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:21.911039 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:21.911002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:27.843029 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:27.842995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:27.942920 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:27.942884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:28.363663 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:28.363627 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:01:31.655323 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:31.655293 2561 scope.go:117] "RemoveContainer" containerID="6ce02a026beada4c0c464124d0ba09ae2555c0bd2b61f7aa24e9810eca36b075" Jul 20 20:01:31.664713 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:31.664690 2561 scope.go:117] "RemoveContainer" containerID="fdb80ad84c09d1d5837334bfcd0b3011269b48caf6497e90b4001ae27b3e3b4e" Jul 20 20:01:36.867526 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:36.867492 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:36.972836 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:36.972801 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:57.656208 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:01:57.656165 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:01.967596 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:01.967557 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:02:16.161260 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:16.161224 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:02:19.377321 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:19.377284 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:28.876456 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:28.876423 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:29.298508 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:29.298479 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:29.402603 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:29.402569 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:31.641185 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:31.641155 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 20:02:31.646479 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:31.646456 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 20:02:31.650812 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:31.650789 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 20:02:31.654789 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:31.654771 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 20:02:33.305645 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:33.305613 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:33.459845 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:33.459810 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:38.394346 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:38.394311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:39.256210 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.256170 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:39.365123 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.365085 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48"] Jul 20 20:02:39.365514 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.365500 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97ef79c-56b3-473a-aa9e-ed79d0373807" containerName="cleanup" Jul 20 20:02:39.365582 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.365516 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97ef79c-56b3-473a-aa9e-ed79d0373807" containerName="cleanup" Jul 20 20:02:39.365628 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.365596 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b97ef79c-56b3-473a-aa9e-ed79d0373807" containerName="cleanup" Jul 20 20:02:39.368697 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.368682 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" Jul 20 20:02:39.371719 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.371700 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 20:02:39.378527 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.378499 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48"] Jul 20 20:02:39.460714 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.460561 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83d449e-4967-46f5-a57a-7f855b344ea1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48\" (UID: \"a83d449e-4967-46f5-a57a-7f855b344ea1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" Jul 20 20:02:39.561352 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.561266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83d449e-4967-46f5-a57a-7f855b344ea1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48\" (UID: \"a83d449e-4967-46f5-a57a-7f855b344ea1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" Jul 20 20:02:39.561904 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.561885 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83d449e-4967-46f5-a57a-7f855b344ea1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48\" (UID: \"a83d449e-4967-46f5-a57a-7f855b344ea1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" Jul 20 20:02:39.680296 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:39.680265 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" Jul 20 20:02:40.036896 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:40.036870 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48"] Jul 20 20:02:40.038709 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:02:40.038669 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83d449e_4967_46f5_a57a_7f855b344ea1.slice/crio-5c9a6094b5c9433fe61d0941fd0a957c779fabe518349c3b783d00e289835130 WatchSource:0}: Error finding container 5c9a6094b5c9433fe61d0941fd0a957c779fabe518349c3b783d00e289835130: Status 404 returned error can't find the container with id 5c9a6094b5c9433fe61d0941fd0a957c779fabe518349c3b783d00e289835130 Jul 20 20:02:40.080877 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:40.080848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:40.182350 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:40.182320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:40.661821 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:40.661784 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" event={"ID":"a83d449e-4967-46f5-a57a-7f855b344ea1","Type":"ContainerStarted","Data":"a54d3d1e8bfcb731fcf3657217ff93e3d3fb8f32ed7564ab815771496c5d5249"} Jul 20 20:02:40.662319 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:40.661871 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" event={"ID":"a83d449e-4967-46f5-a57a-7f855b344ea1","Type":"ContainerStarted","Data":"5c9a6094b5c9433fe61d0941fd0a957c779fabe518349c3b783d00e289835130"} Jul 20 20:02:40.681958 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:40.681912 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" podStartSLOduration=1.681895989 podStartE2EDuration="1.681895989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:40.681543251 +0000 UTC m=+2410.184863720" watchObservedRunningTime="2026-07-20 20:02:40.681895989 +0000 UTC m=+2410.185216436" Jul 20 20:02:41.668182 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:41.668145 2561 generic.go:356] "Generic (PLEG): container finished" podID="a83d449e-4967-46f5-a57a-7f855b344ea1" containerID="a54d3d1e8bfcb731fcf3657217ff93e3d3fb8f32ed7564ab815771496c5d5249" exitCode=0 Jul 20 20:02:41.668594 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:41.668232 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" event={"ID":"a83d449e-4967-46f5-a57a-7f855b344ea1","Type":"ContainerDied","Data":"a54d3d1e8bfcb731fcf3657217ff93e3d3fb8f32ed7564ab815771496c5d5249"} Jul 20 20:02:42.809370 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:42.809349 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" Jul 20 20:02:42.888364 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:42.888332 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83d449e-4967-46f5-a57a-7f855b344ea1-maas-api-service-ca\") pod \"a83d449e-4967-46f5-a57a-7f855b344ea1\" (UID: \"a83d449e-4967-46f5-a57a-7f855b344ea1\") " Jul 20 20:02:42.888690 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:42.888669 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a83d449e-4967-46f5-a57a-7f855b344ea1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a83d449e-4967-46f5-a57a-7f855b344ea1" (UID: "a83d449e-4967-46f5-a57a-7f855b344ea1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:02:42.989763 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:42.989732 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83d449e-4967-46f5-a57a-7f855b344ea1-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:02:43.683065 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:43.683035 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" Jul 20 20:02:43.683249 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:43.683033 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48" event={"ID":"a83d449e-4967-46f5-a57a-7f855b344ea1","Type":"ContainerDied","Data":"5c9a6094b5c9433fe61d0941fd0a957c779fabe518349c3b783d00e289835130"} Jul 20 20:02:43.683249 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:43.683167 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c9a6094b5c9433fe61d0941fd0a957c779fabe518349c3b783d00e289835130" Jul 20 20:02:45.658248 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:45.658211 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:02:49.922992 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:49.922960 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:54.459668 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:54.459566 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:54.467666 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:54.467638 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48"] Jul 20 20:02:54.478983 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:54.478957 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3e3435-nxk48"] Jul 20 20:02:54.865596 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:54.865560 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:55.064164 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:55.064129 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a83d449e-4967-46f5-a57a-7f855b344ea1" path="/var/lib/kubelet/pods/a83d449e-4967-46f5-a57a-7f855b344ea1/volumes" Jul 20 20:02:55.798361 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:02:55.798327 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:03:01.571263 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:01.571228 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:01.708791 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:01.708762 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:01.976434 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:01.976400 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:02.168656 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.168624 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:02.288471 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.288391 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq"] Jul 20 20:03:02.288897 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.288879 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a83d449e-4967-46f5-a57a-7f855b344ea1" containerName="revoke-keys" Jul 20 20:03:02.288994 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.288900 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a83d449e-4967-46f5-a57a-7f855b344ea1" containerName="revoke-keys" Jul 20 20:03:02.289053 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.289004 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a83d449e-4967-46f5-a57a-7f855b344ea1" containerName="revoke-keys" Jul 20 20:03:02.292328 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.292309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" Jul 20 20:03:02.295881 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.295866 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 20:03:02.304486 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.304462 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq"] Jul 20 20:03:02.363935 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.363907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8bdba7-5973-4947-ae64-44be533ab573-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq\" (UID: \"4b8bdba7-5973-4947-ae64-44be533ab573\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" Jul 20 20:03:02.465140 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.465112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8bdba7-5973-4947-ae64-44be533ab573-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq\" (UID: \"4b8bdba7-5973-4947-ae64-44be533ab573\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" Jul 20 20:03:02.465713 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.465696 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8bdba7-5973-4947-ae64-44be533ab573-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq\" (UID: \"4b8bdba7-5973-4947-ae64-44be533ab573\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" Jul 20 20:03:02.603208 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.603142 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" Jul 20 20:03:02.751510 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.751478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq"] Jul 20 20:03:02.752854 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:03:02.752816 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8bdba7_5973_4947_ae64_44be533ab573.slice/crio-9f9c6ba5185ded17076429b1b0f638ce3f44fee94718121ad793b811b48e6cb7 WatchSource:0}: Error finding container 9f9c6ba5185ded17076429b1b0f638ce3f44fee94718121ad793b811b48e6cb7: Status 404 returned error can't find the container with id 9f9c6ba5185ded17076429b1b0f638ce3f44fee94718121ad793b811b48e6cb7 Jul 20 20:03:02.794799 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:02.794776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" event={"ID":"4b8bdba7-5973-4947-ae64-44be533ab573","Type":"ContainerStarted","Data":"9f9c6ba5185ded17076429b1b0f638ce3f44fee94718121ad793b811b48e6cb7"} Jul 20 20:03:03.402970 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:03.402884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:03.555812 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:03.555776 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:03.802068 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:03.802025 2561 generic.go:356] "Generic (PLEG): container finished" podID="4b8bdba7-5973-4947-ae64-44be533ab573" containerID="49438f6057c8ab50b2ef9f34ce2635787aa8938ed495f98fbe2ac31aed345e2f" exitCode=0 Jul 20 20:03:03.802498 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:03.802117 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" event={"ID":"4b8bdba7-5973-4947-ae64-44be533ab573","Type":"ContainerDied","Data":"49438f6057c8ab50b2ef9f34ce2635787aa8938ed495f98fbe2ac31aed345e2f"} Jul 20 20:03:04.964914 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:04.964888 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" Jul 20 20:03:05.088923 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:05.088824 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8bdba7-5973-4947-ae64-44be533ab573-maas-api-service-ca\") pod \"4b8bdba7-5973-4947-ae64-44be533ab573\" (UID: \"4b8bdba7-5973-4947-ae64-44be533ab573\") " Jul 20 20:03:05.089218 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:05.089192 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b8bdba7-5973-4947-ae64-44be533ab573-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b8bdba7-5973-4947-ae64-44be533ab573" (UID: "4b8bdba7-5973-4947-ae64-44be533ab573"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:03:05.190728 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:05.190697 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b8bdba7-5973-4947-ae64-44be533ab573-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:03:05.816805 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:05.816782 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" Jul 20 20:03:05.816980 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:05.816779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq" event={"ID":"4b8bdba7-5973-4947-ae64-44be533ab573","Type":"ContainerDied","Data":"9f9c6ba5185ded17076429b1b0f638ce3f44fee94718121ad793b811b48e6cb7"} Jul 20 20:03:05.816980 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:05.816909 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f9c6ba5185ded17076429b1b0f638ce3f44fee94718121ad793b811b48e6cb7" Jul 20 20:03:12.907964 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:12.907923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:15.968499 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:15.968464 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:03:17.370933 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:17.370897 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq"] Jul 20 20:03:17.374741 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:17.374716 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dc9964-8r6gq"] Jul 20 20:03:17.376307 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:17.376288 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:17.750096 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:17.750057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:19.063622 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:19.063588 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b8bdba7-5973-4947-ae64-44be533ab573" path="/var/lib/kubelet/pods/4b8bdba7-5973-4947-ae64-44be533ab573/volumes" Jul 20 20:03:23.962337 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:23.962297 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:24.027343 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:24.027307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:24.226567 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:24.226539 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:24.454943 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:24.454909 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:24.791676 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:24.791639 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:25.093005 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:25.092919 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:25.261102 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:25.261066 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:26.624563 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:26.624533 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:27.783590 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:27.783559 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:27.874423 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:27.874374 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:27.950287 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:27.950250 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:28.258588 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:28.258551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:28.542371 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:28.542287 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:28.647585 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:28.647551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:31.705411 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:31.704588 2561 scope.go:117] "RemoveContainer" containerID="9ed46e8a47fa51d2c1ca478b9c25d6f7a3e4fa4e296d148bd25e0fba88c6360c" Jul 20 20:03:32.191629 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:32.191585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:32.676658 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:32.676629 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:32.997274 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:32.997243 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:33.329307 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:33.329218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:35.646248 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:35.646217 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:03:35.717866 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:35.717832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:37.079987 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:37.079958 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:40.220659 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:40.220620 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:48.238214 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.238177 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm"] Jul 20 20:03:48.238804 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.238783 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8bdba7-5973-4947-ae64-44be533ab573" containerName="revoke-keys" Jul 20 20:03:48.238898 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.238808 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8bdba7-5973-4947-ae64-44be533ab573" containerName="revoke-keys" Jul 20 20:03:48.238953 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.238930 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b8bdba7-5973-4947-ae64-44be533ab573" containerName="revoke-keys" Jul 20 20:03:48.241943 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.241923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" Jul 20 20:03:48.244353 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.244329 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 20:03:48.250222 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.249282 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm"] Jul 20 20:03:48.288491 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.288462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/748c1acb-7a61-441a-83e7-06d20542bd69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-da8568-8dbmm\" (UID: \"748c1acb-7a61-441a-83e7-06d20542bd69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" Jul 20 20:03:48.390024 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.389990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/748c1acb-7a61-441a-83e7-06d20542bd69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-da8568-8dbmm\" (UID: \"748c1acb-7a61-441a-83e7-06d20542bd69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" Jul 20 20:03:48.390733 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.390706 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/748c1acb-7a61-441a-83e7-06d20542bd69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-da8568-8dbmm\" (UID: \"748c1acb-7a61-441a-83e7-06d20542bd69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" Jul 20 20:03:48.554448 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.554350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" Jul 20 20:03:48.694489 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.694462 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm"] Jul 20 20:03:48.696044 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:03:48.696017 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748c1acb_7a61_441a_83e7_06d20542bd69.slice/crio-92745a576db70580f85d37c5d27b81262ca82a512321fe28e3345db62a64cc17 WatchSource:0}: Error finding container 92745a576db70580f85d37c5d27b81262ca82a512321fe28e3345db62a64cc17: Status 404 returned error can't find the container with id 92745a576db70580f85d37c5d27b81262ca82a512321fe28e3345db62a64cc17 Jul 20 20:03:48.863949 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:48.863870 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:49.016048 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:49.016016 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:49.077571 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:49.077537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" event={"ID":"748c1acb-7a61-441a-83e7-06d20542bd69","Type":"ContainerStarted","Data":"48c6ce8082a94adf12e5cb7bb9f76e26386ed433d9fdc8a2edc801d3b218cfcb"} Jul 20 20:03:49.077734 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:49.077592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" event={"ID":"748c1acb-7a61-441a-83e7-06d20542bd69","Type":"ContainerStarted","Data":"92745a576db70580f85d37c5d27b81262ca82a512321fe28e3345db62a64cc17"} Jul 20 20:03:49.094991 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:49.094944 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" podStartSLOduration=1.094928351 podStartE2EDuration="1.094928351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:49.093317505 +0000 UTC m=+2478.596637974" watchObservedRunningTime="2026-07-20 20:03:49.094928351 +0000 UTC m=+2478.598248798" Jul 20 20:03:50.084280 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:50.084244 2561 generic.go:356] "Generic (PLEG): container finished" podID="748c1acb-7a61-441a-83e7-06d20542bd69" containerID="48c6ce8082a94adf12e5cb7bb9f76e26386ed433d9fdc8a2edc801d3b218cfcb" exitCode=0 Jul 20 20:03:50.084703 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:50.084325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" event={"ID":"748c1acb-7a61-441a-83e7-06d20542bd69","Type":"ContainerDied","Data":"48c6ce8082a94adf12e5cb7bb9f76e26386ed433d9fdc8a2edc801d3b218cfcb"} Jul 20 20:03:51.227329 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:51.227303 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" Jul 20 20:03:51.318743 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:51.318710 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/748c1acb-7a61-441a-83e7-06d20542bd69-maas-api-service-ca\") pod \"748c1acb-7a61-441a-83e7-06d20542bd69\" (UID: \"748c1acb-7a61-441a-83e7-06d20542bd69\") " Jul 20 20:03:51.319111 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:51.319090 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/748c1acb-7a61-441a-83e7-06d20542bd69-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "748c1acb-7a61-441a-83e7-06d20542bd69" (UID: "748c1acb-7a61-441a-83e7-06d20542bd69"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:03:51.420245 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:51.420159 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/748c1acb-7a61-441a-83e7-06d20542bd69-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:03:51.653268 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:51.653235 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:03:52.096458 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:52.096428 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" Jul 20 20:03:52.096458 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:52.096448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm" event={"ID":"748c1acb-7a61-441a-83e7-06d20542bd69","Type":"ContainerDied","Data":"92745a576db70580f85d37c5d27b81262ca82a512321fe28e3345db62a64cc17"} Jul 20 20:03:52.096669 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:52.096493 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92745a576db70580f85d37c5d27b81262ca82a512321fe28e3345db62a64cc17" Jul 20 20:03:58.388114 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:58.388075 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:58.490086 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:03:58.490045 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:03.680841 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:03.680805 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:08.331198 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:08.331149 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:08.333319 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:08.333296 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm"] Jul 20 20:04:08.335633 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:08.335611 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-da8568-8dbmm"] Jul 20 20:04:08.553775 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:08.553741 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:04:08.702992 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:08.702908 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:09.064181 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:09.064154 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="748c1acb-7a61-441a-83e7-06d20542bd69" path="/var/lib/kubelet/pods/748c1acb-7a61-441a-83e7-06d20542bd69/volumes" Jul 20 20:04:14.560889 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:14.560855 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:14.656881 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:14.656848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:14.820748 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:14.820666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:15.053662 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.053626 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:15.171129 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.171046 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r"] Jul 20 20:04:15.171546 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.171516 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="748c1acb-7a61-441a-83e7-06d20542bd69" containerName="revoke-keys" Jul 20 20:04:15.171546 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.171534 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="748c1acb-7a61-441a-83e7-06d20542bd69" containerName="revoke-keys" Jul 20 20:04:15.171718 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.171598 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="748c1acb-7a61-441a-83e7-06d20542bd69" containerName="revoke-keys" Jul 20 20:04:15.174943 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.174926 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" Jul 20 20:04:15.177621 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.177588 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 20:04:15.185691 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.185665 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r"] Jul 20 20:04:15.242792 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.242755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4dd1c-415c-4259-84de-0ad2565496ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-75e28c-7864r\" (UID: \"b3e4dd1c-415c-4259-84de-0ad2565496ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" Jul 20 20:04:15.343720 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.343686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4dd1c-415c-4259-84de-0ad2565496ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-75e28c-7864r\" (UID: \"b3e4dd1c-415c-4259-84de-0ad2565496ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" Jul 20 20:04:15.344290 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.344269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4dd1c-415c-4259-84de-0ad2565496ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-75e28c-7864r\" (UID: \"b3e4dd1c-415c-4259-84de-0ad2565496ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" Jul 20 20:04:15.486777 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.486724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" Jul 20 20:04:15.623651 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:15.623622 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r"] Jul 20 20:04:15.626416 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:04:15.626369 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e4dd1c_415c_4259_84de_0ad2565496ee.slice/crio-10ad526a670e169a3957572df249512b9da63e243e287b81e448d0e371780c6e WatchSource:0}: Error finding container 10ad526a670e169a3957572df249512b9da63e243e287b81e448d0e371780c6e: Status 404 returned error can't find the container with id 10ad526a670e169a3957572df249512b9da63e243e287b81e448d0e371780c6e Jul 20 20:04:16.242600 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:16.242568 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" event={"ID":"b3e4dd1c-415c-4259-84de-0ad2565496ee","Type":"ContainerStarted","Data":"97e897de21791492d26bce6cd57bc15ffe6de4d21a9529ad57cfa172101231f4"} Jul 20 20:04:16.242769 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:16.242619 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" event={"ID":"b3e4dd1c-415c-4259-84de-0ad2565496ee","Type":"ContainerStarted","Data":"10ad526a670e169a3957572df249512b9da63e243e287b81e448d0e371780c6e"} Jul 20 20:04:16.259204 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:16.259154 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" podStartSLOduration=1.259137404 podStartE2EDuration="1.259137404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:16.258112133 +0000 UTC m=+2505.761432623" watchObservedRunningTime="2026-07-20 20:04:16.259137404 +0000 UTC m=+2505.762457872" Jul 20 20:04:17.250800 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:17.250766 2561 generic.go:356] "Generic (PLEG): container finished" podID="b3e4dd1c-415c-4259-84de-0ad2565496ee" containerID="97e897de21791492d26bce6cd57bc15ffe6de4d21a9529ad57cfa172101231f4" exitCode=0 Jul 20 20:04:17.251192 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:17.250850 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" event={"ID":"b3e4dd1c-415c-4259-84de-0ad2565496ee","Type":"ContainerDied","Data":"97e897de21791492d26bce6cd57bc15ffe6de4d21a9529ad57cfa172101231f4"} Jul 20 20:04:18.387577 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:18.387555 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" Jul 20 20:04:18.469227 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:18.469200 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4dd1c-415c-4259-84de-0ad2565496ee-maas-api-service-ca\") pod \"b3e4dd1c-415c-4259-84de-0ad2565496ee\" (UID: \"b3e4dd1c-415c-4259-84de-0ad2565496ee\") " Jul 20 20:04:18.469558 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:18.469537 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3e4dd1c-415c-4259-84de-0ad2565496ee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3e4dd1c-415c-4259-84de-0ad2565496ee" (UID: "b3e4dd1c-415c-4259-84de-0ad2565496ee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:04:18.570163 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:18.570091 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3e4dd1c-415c-4259-84de-0ad2565496ee-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:04:19.263263 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:19.263226 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" event={"ID":"b3e4dd1c-415c-4259-84de-0ad2565496ee","Type":"ContainerDied","Data":"10ad526a670e169a3957572df249512b9da63e243e287b81e448d0e371780c6e"} Jul 20 20:04:19.263444 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:19.263278 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10ad526a670e169a3957572df249512b9da63e243e287b81e448d0e371780c6e" Jul 20 20:04:19.263444 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:19.263238 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r" Jul 20 20:04:30.889016 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:30.888982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:31.070071 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:31.070041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:35.271495 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:35.271460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:35.282489 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:35.282460 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r"] Jul 20 20:04:35.284801 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:35.284778 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-75e28c-7864r"] Jul 20 20:04:35.782947 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:35.782912 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:35.911809 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:35.911771 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:04:37.063437 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:37.063407 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3e4dd1c-415c-4259-84de-0ad2565496ee" path="/var/lib/kubelet/pods/b3e4dd1c-415c-4259-84de-0ad2565496ee/volumes" Jul 20 20:04:41.825184 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:41.825138 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:41.926052 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:41.926016 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:42.094047 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:42.093960 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:42.330865 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:42.330833 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:42.690766 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:42.690729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:43.021267 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:43.021236 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:43.198905 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:43.198874 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:46.084605 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:46.084576 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:46.187588 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:46.187552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:46.293886 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:46.293855 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:46.397882 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:46.397793 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:46.979700 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:46.979666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:47.130797 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:47.130757 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:50.575359 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:50.575327 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:50.895583 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:50.895504 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:51.266397 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:51.266348 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:51.424966 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:51.424933 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:53.457829 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:53.457787 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:04:54.020954 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:54.020921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:54.119350 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:54.119317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:54.228804 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:54.228770 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:54.369482 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:54.369403 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:54.933708 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:54.933676 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:55.034123 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:55.034085 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:58.490726 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:04:58.490693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:06.077363 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:06.077328 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:05:09.071693 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:09.071660 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:09.156760 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:09.156724 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:09.958808 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:09.958775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:10.059108 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:10.059077 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:10.884958 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:10.884930 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:10.987703 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:10.987673 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:17.253043 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:17.252984 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:17.353574 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:17.353537 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:31.740070 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:31.740040 2561 scope.go:117] "RemoveContainer" containerID="4b58109138f5e728dacf98e036f353aaa28051d876d99151c4f4c67e0040e192" Jul 20 20:05:39.341015 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:39.340982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:42.760702 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:05:42.760670 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:06:04.066616 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:06:04.066536 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:07.755843 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:06:07.755809 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:06:22.268610 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:06:22.268576 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:06:39.459752 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:06:39.459719 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:06:53.950878 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:06:53.950844 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:07:13.563697 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:07:13.563666 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:07:31.683780 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:07:31.683707 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 20:07:31.688375 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:07:31.688354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 20:07:31.694625 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:07:31.694606 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 20:07:31.699092 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:07:31.699076 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 20:07:32.759472 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:07:32.759431 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:07:40.871547 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:07:40.871512 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:50.961027 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:07:50.960991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:08:06.462198 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:06.462155 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:07.140974 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:07.140935 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:09.368115 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:09.368083 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:08:10.679807 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:10.679774 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:16.130513 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:16.130480 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:16.227689 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:16.227656 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:23.854800 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:23.854771 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:08:40.012112 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:40.012065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:41.487933 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:41.487894 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:45.163568 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:08:45.163532 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:09:22.356781 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:09:22.356747 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:09:31.787074 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:09:31.787047 2561 scope.go:117] "RemoveContainer" containerID="a54d3d1e8bfcb731fcf3657217ff93e3d3fb8f32ed7564ab815771496c5d5249" Jul 20 20:09:31.795737 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:09:31.795717 2561 scope.go:117] "RemoveContainer" containerID="49438f6057c8ab50b2ef9f34ce2635787aa8938ed495f98fbe2ac31aed345e2f" Jul 20 20:09:40.561797 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:09:40.561758 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:09:46.888298 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:09:46.888266 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:47.646778 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:09:47.646750 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:50.278476 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:09:50.278441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:59.564549 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:09:59.564519 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:10:08.498216 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:08.498181 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:08.575103 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:08.575069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:09.973956 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:09.973917 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:10.077583 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:10.077551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:10.815373 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:10.815338 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:10.916491 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:10.916463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:14.237204 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:14.237168 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:18.140666 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:18.140634 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:18.244889 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:18.244851 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:18.246412 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:18.246391 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:10:31.819361 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:31.819289 2561 scope.go:117] "RemoveContainer" containerID="48c6ce8082a94adf12e5cb7bb9f76e26386ed433d9fdc8a2edc801d3b218cfcb" Jul 20 20:10:31.827917 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:31.827894 2561 scope.go:117] "RemoveContainer" containerID="97e897de21791492d26bce6cd57bc15ffe6de4d21a9529ad57cfa172101231f4" Jul 20 20:10:37.969747 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:37.969712 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:10:53.996213 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:10:53.996178 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:11:01.055897 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:01.055858 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:01.852333 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:01.852294 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:02.817505 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.817474 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7176-139944161363632"] Jul 20 20:11:02.817879 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.817871 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e4dd1c-415c-4259-84de-0ad2565496ee" containerName="revoke-keys" Jul 20 20:11:02.817924 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.817882 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e4dd1c-415c-4259-84de-0ad2565496ee" containerName="revoke-keys" Jul 20 20:11:02.817960 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.817953 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3e4dd1c-415c-4259-84de-0ad2565496ee" containerName="revoke-keys" Jul 20 20:11:02.821227 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.821210 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161363632" Jul 20 20:11:02.824127 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.824048 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bt7hd\"" Jul 20 20:11:02.827243 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.827215 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944161363632"] Jul 20 20:11:02.868122 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.868088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqq6t\" (UniqueName: \"kubernetes.io/projected/91a32970-5932-4e41-a3e1-afa6983f1c25-kube-api-access-hqq6t\") pod \"test-curl-7176-139944161363632\" (UID: \"91a32970-5932-4e41-a3e1-afa6983f1c25\") " pod="opendatahub/test-curl-7176-139944161363632" Jul 20 20:11:02.969393 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.969347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqq6t\" (UniqueName: \"kubernetes.io/projected/91a32970-5932-4e41-a3e1-afa6983f1c25-kube-api-access-hqq6t\") pod \"test-curl-7176-139944161363632\" (UID: \"91a32970-5932-4e41-a3e1-afa6983f1c25\") " pod="opendatahub/test-curl-7176-139944161363632" Jul 20 20:11:02.977875 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:02.977845 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqq6t\" (UniqueName: \"kubernetes.io/projected/91a32970-5932-4e41-a3e1-afa6983f1c25-kube-api-access-hqq6t\") pod \"test-curl-7176-139944161363632\" (UID: \"91a32970-5932-4e41-a3e1-afa6983f1c25\") " pod="opendatahub/test-curl-7176-139944161363632" Jul 20 20:11:03.131016 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:03.130944 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161363632" Jul 20 20:11:03.263390 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:03.263355 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944161363632"] Jul 20 20:11:03.265238 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:11:03.265206 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91a32970_5932_4e41_a3e1_afa6983f1c25.slice/crio-deedeeb3f3db30fd8fe7088cdc1e034a6272526c51c85f5552a7b5df89539274 WatchSource:0}: Error finding container deedeeb3f3db30fd8fe7088cdc1e034a6272526c51c85f5552a7b5df89539274: Status 404 returned error can't find the container with id deedeeb3f3db30fd8fe7088cdc1e034a6272526c51c85f5552a7b5df89539274 Jul 20 20:11:03.266580 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:03.266561 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 20:11:03.584176 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:03.584141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944161363632" event={"ID":"91a32970-5932-4e41-a3e1-afa6983f1c25","Type":"ContainerStarted","Data":"deedeeb3f3db30fd8fe7088cdc1e034a6272526c51c85f5552a7b5df89539274"} Jul 20 20:11:04.591366 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:04.591332 2561 generic.go:356] "Generic (PLEG): container finished" podID="91a32970-5932-4e41-a3e1-afa6983f1c25" containerID="faac3f4281f5484ea071cce5b9cad76d95cadcf965745a08b716ec589430762b" exitCode=0 Jul 20 20:11:04.591747 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:04.591405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944161363632" event={"ID":"91a32970-5932-4e41-a3e1-afa6983f1c25","Type":"ContainerDied","Data":"faac3f4281f5484ea071cce5b9cad76d95cadcf965745a08b716ec589430762b"} Jul 20 20:11:05.737234 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.737211 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161363632" Jul 20 20:11:05.761219 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.761199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7176-139944161363632_91a32970-5932-4e41-a3e1-afa6983f1c25/test-curl-7176-139944161363632/0.log" Jul 20 20:11:05.788670 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.788643 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7176-139944161363632"] Jul 20 20:11:05.794911 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.794889 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqq6t\" (UniqueName: \"kubernetes.io/projected/91a32970-5932-4e41-a3e1-afa6983f1c25-kube-api-access-hqq6t\") pod \"91a32970-5932-4e41-a3e1-afa6983f1c25\" (UID: \"91a32970-5932-4e41-a3e1-afa6983f1c25\") " Jul 20 20:11:05.795184 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.795168 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7176-139944161363632"] Jul 20 20:11:05.797030 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.797001 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a32970-5932-4e41-a3e1-afa6983f1c25-kube-api-access-hqq6t" (OuterVolumeSpecName: "kube-api-access-hqq6t") pod "91a32970-5932-4e41-a3e1-afa6983f1c25" (UID: "91a32970-5932-4e41-a3e1-afa6983f1c25"). InnerVolumeSpecName "kube-api-access-hqq6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:11:05.896700 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.896630 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqq6t\" (UniqueName: \"kubernetes.io/projected/91a32970-5932-4e41-a3e1-afa6983f1c25-kube-api-access-hqq6t\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:11:05.920783 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.920758 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7176-139944161364656"] Jul 20 20:11:05.921162 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.921150 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a32970-5932-4e41-a3e1-afa6983f1c25" containerName="test-curl-7176-139944161363632" Jul 20 20:11:05.921204 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.921164 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a32970-5932-4e41-a3e1-afa6983f1c25" containerName="test-curl-7176-139944161363632" Jul 20 20:11:05.921240 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.921226 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a32970-5932-4e41-a3e1-afa6983f1c25" containerName="test-curl-7176-139944161363632" Jul 20 20:11:05.924217 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.924203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161364656" Jul 20 20:11:05.931725 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.931704 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944161364656"] Jul 20 20:11:05.997725 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:05.997701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7lh9\" (UniqueName: \"kubernetes.io/projected/ad40a092-7fc9-4721-8463-88e5128c9e5c-kube-api-access-t7lh9\") pod \"test-curl-7176-139944161364656\" (UID: \"ad40a092-7fc9-4721-8463-88e5128c9e5c\") " pod="opendatahub/test-curl-7176-139944161364656" Jul 20 20:11:06.099138 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:06.099105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lh9\" (UniqueName: \"kubernetes.io/projected/ad40a092-7fc9-4721-8463-88e5128c9e5c-kube-api-access-t7lh9\") pod \"test-curl-7176-139944161364656\" (UID: \"ad40a092-7fc9-4721-8463-88e5128c9e5c\") " pod="opendatahub/test-curl-7176-139944161364656" Jul 20 20:11:06.118370 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:06.118340 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7lh9\" (UniqueName: \"kubernetes.io/projected/ad40a092-7fc9-4721-8463-88e5128c9e5c-kube-api-access-t7lh9\") pod \"test-curl-7176-139944161364656\" (UID: \"ad40a092-7fc9-4721-8463-88e5128c9e5c\") " pod="opendatahub/test-curl-7176-139944161364656" Jul 20 20:11:06.234575 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:06.234551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161364656" Jul 20 20:11:06.380311 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:06.380255 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944161364656"] Jul 20 20:11:06.603545 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:06.603461 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161363632" Jul 20 20:11:06.603545 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:06.603499 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="deedeeb3f3db30fd8fe7088cdc1e034a6272526c51c85f5552a7b5df89539274" Jul 20 20:11:06.604779 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:06.604748 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944161364656" event={"ID":"ad40a092-7fc9-4721-8463-88e5128c9e5c","Type":"ContainerStarted","Data":"60067150bd8449d7cf4a4ea8e5d3cb28762fddefd15efc34bb4672c0a36630a8"} Jul 20 20:11:06.614219 ip-10-0-135-59 kubenswrapper[2561]: E0720 20:11:06.614190 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7176-139944161363632\" is forbidden: User \"system:node:ip-10-0-135-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-59.ec2.internal' and this object" podUID="91a32970-5932-4e41-a3e1-afa6983f1c25" pod="opendatahub/test-curl-7176-139944161363632" Jul 20 20:11:07.063741 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:07.063709 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a32970-5932-4e41-a3e1-afa6983f1c25" path="/var/lib/kubelet/pods/91a32970-5932-4e41-a3e1-afa6983f1c25/volumes" Jul 20 20:11:07.612051 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:07.612014 2561 generic.go:356] "Generic (PLEG): container finished" podID="ad40a092-7fc9-4721-8463-88e5128c9e5c" containerID="cbeddd481cf05a8e961f617c2c4c2edfbd5990cba0136cd5ada95eb0681760b8" exitCode=0 Jul 20 20:11:07.612243 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:07.612107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944161364656" event={"ID":"ad40a092-7fc9-4721-8463-88e5128c9e5c","Type":"ContainerDied","Data":"cbeddd481cf05a8e961f617c2c4c2edfbd5990cba0136cd5ada95eb0681760b8"} Jul 20 20:11:08.754150 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.754128 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161364656" Jul 20 20:11:08.775834 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.775799 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7176-139944161364656_ad40a092-7fc9-4721-8463-88e5128c9e5c/test-curl-7176-139944161364656/0.log" Jul 20 20:11:08.802205 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.802175 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7176-139944161364656"] Jul 20 20:11:08.805459 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.805437 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7176-139944161364656"] Jul 20 20:11:08.824261 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.824238 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7lh9\" (UniqueName: \"kubernetes.io/projected/ad40a092-7fc9-4721-8463-88e5128c9e5c-kube-api-access-t7lh9\") pod \"ad40a092-7fc9-4721-8463-88e5128c9e5c\" (UID: \"ad40a092-7fc9-4721-8463-88e5128c9e5c\") " Jul 20 20:11:08.826250 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.826229 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad40a092-7fc9-4721-8463-88e5128c9e5c-kube-api-access-t7lh9" (OuterVolumeSpecName: "kube-api-access-t7lh9") pod "ad40a092-7fc9-4721-8463-88e5128c9e5c" (UID: "ad40a092-7fc9-4721-8463-88e5128c9e5c"). InnerVolumeSpecName "kube-api-access-t7lh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:11:08.926009 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.925923 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7lh9\" (UniqueName: \"kubernetes.io/projected/ad40a092-7fc9-4721-8463-88e5128c9e5c-kube-api-access-t7lh9\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:11:08.976448 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.976415 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:08.976853 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.976821 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad40a092-7fc9-4721-8463-88e5128c9e5c" containerName="test-curl-7176-139944161364656" Jul 20 20:11:08.976897 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.976856 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad40a092-7fc9-4721-8463-88e5128c9e5c" containerName="test-curl-7176-139944161364656" Jul 20 20:11:08.976933 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.976921 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad40a092-7fc9-4721-8463-88e5128c9e5c" containerName="test-curl-7176-139944161364656" Jul 20 20:11:08.979982 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.979966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:08.991272 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:08.991204 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:09.026573 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.026546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kcdj\" (UniqueName: \"kubernetes.io/projected/98fe02d8-0ae8-4533-b037-253cbe3fac01-kube-api-access-9kcdj\") pod \"test-curl-7176-139944161317200\" (UID: \"98fe02d8-0ae8-4533-b037-253cbe3fac01\") " pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:09.063913 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.063881 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad40a092-7fc9-4721-8463-88e5128c9e5c" path="/var/lib/kubelet/pods/ad40a092-7fc9-4721-8463-88e5128c9e5c/volumes" Jul 20 20:11:09.127357 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.127317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kcdj\" (UniqueName: \"kubernetes.io/projected/98fe02d8-0ae8-4533-b037-253cbe3fac01-kube-api-access-9kcdj\") pod \"test-curl-7176-139944161317200\" (UID: \"98fe02d8-0ae8-4533-b037-253cbe3fac01\") " pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:09.136762 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.136732 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kcdj\" (UniqueName: \"kubernetes.io/projected/98fe02d8-0ae8-4533-b037-253cbe3fac01-kube-api-access-9kcdj\") pod \"test-curl-7176-139944161317200\" (UID: \"98fe02d8-0ae8-4533-b037-253cbe3fac01\") " pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:09.289283 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.289247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:09.442671 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.442647 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:09.444081 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:11:09.444057 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98fe02d8_0ae8_4533_b037_253cbe3fac01.slice/crio-e7d679e540732e9540c2fcef409a247c17996a33ec9f74a4fef2cec9998565bc WatchSource:0}: Error finding container e7d679e540732e9540c2fcef409a247c17996a33ec9f74a4fef2cec9998565bc: Status 404 returned error can't find the container with id e7d679e540732e9540c2fcef409a247c17996a33ec9f74a4fef2cec9998565bc Jul 20 20:11:09.624629 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.624541 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944161317200" event={"ID":"98fe02d8-0ae8-4533-b037-253cbe3fac01","Type":"ContainerStarted","Data":"e7d679e540732e9540c2fcef409a247c17996a33ec9f74a4fef2cec9998565bc"} Jul 20 20:11:09.625680 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.625662 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161364656" Jul 20 20:11:09.625807 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:09.625668 2561 scope.go:117] "RemoveContainer" containerID="cbeddd481cf05a8e961f617c2c4c2edfbd5990cba0136cd5ada95eb0681760b8" Jul 20 20:11:10.633104 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:10.633065 2561 generic.go:356] "Generic (PLEG): container finished" podID="98fe02d8-0ae8-4533-b037-253cbe3fac01" containerID="18b8bc6d7e2c20b0a0b33a47df785c273a4fa985b7323363cc299f55c73955fc" exitCode=0 Jul 20 20:11:10.633624 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:10.633155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944161317200" event={"ID":"98fe02d8-0ae8-4533-b037-253cbe3fac01","Type":"ContainerDied","Data":"18b8bc6d7e2c20b0a0b33a47df785c273a4fa985b7323363cc299f55c73955fc"} Jul 20 20:11:11.777117 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.777094 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:11.799297 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.799269 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7176-139944161317200_98fe02d8-0ae8-4533-b037-253cbe3fac01/test-curl-7176-139944161317200/0.log" Jul 20 20:11:11.827905 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.827866 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:11.831734 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.831708 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:11.851217 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.851186 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kcdj\" (UniqueName: \"kubernetes.io/projected/98fe02d8-0ae8-4533-b037-253cbe3fac01-kube-api-access-9kcdj\") pod \"98fe02d8-0ae8-4533-b037-253cbe3fac01\" (UID: \"98fe02d8-0ae8-4533-b037-253cbe3fac01\") " Jul 20 20:11:11.853214 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.853184 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98fe02d8-0ae8-4533-b037-253cbe3fac01-kube-api-access-9kcdj" (OuterVolumeSpecName: "kube-api-access-9kcdj") pod "98fe02d8-0ae8-4533-b037-253cbe3fac01" (UID: "98fe02d8-0ae8-4533-b037-253cbe3fac01"). InnerVolumeSpecName "kube-api-access-9kcdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:11:11.952205 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.952125 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kcdj\" (UniqueName: \"kubernetes.io/projected/98fe02d8-0ae8-4533-b037-253cbe3fac01-kube-api-access-9kcdj\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:11:11.954600 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.954579 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:11.954990 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.954977 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98fe02d8-0ae8-4533-b037-253cbe3fac01" containerName="test-curl-7176-139944161317200" Jul 20 20:11:11.955030 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.954992 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="98fe02d8-0ae8-4533-b037-253cbe3fac01" containerName="test-curl-7176-139944161317200" Jul 20 20:11:11.955066 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.955055 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="98fe02d8-0ae8-4533-b037-253cbe3fac01" containerName="test-curl-7176-139944161317200" Jul 20 20:11:11.958043 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.958030 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:11.964854 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:11.964829 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:12.053617 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.053579 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbdc\" (UniqueName: \"kubernetes.io/projected/fb6a8aeb-2897-46cc-b5c3-332b34bb13fd-kube-api-access-mhbdc\") pod \"test-curl-7176-139944161317200\" (UID: \"fb6a8aeb-2897-46cc-b5c3-332b34bb13fd\") " pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:12.154903 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.154866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbdc\" (UniqueName: \"kubernetes.io/projected/fb6a8aeb-2897-46cc-b5c3-332b34bb13fd-kube-api-access-mhbdc\") pod \"test-curl-7176-139944161317200\" (UID: \"fb6a8aeb-2897-46cc-b5c3-332b34bb13fd\") " pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:12.165069 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.165039 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbdc\" (UniqueName: \"kubernetes.io/projected/fb6a8aeb-2897-46cc-b5c3-332b34bb13fd-kube-api-access-mhbdc\") pod \"test-curl-7176-139944161317200\" (UID: \"fb6a8aeb-2897-46cc-b5c3-332b34bb13fd\") " pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:12.268439 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.268398 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:12.402515 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.402489 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:12.404060 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:11:12.404031 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb6a8aeb_2897_46cc_b5c3_332b34bb13fd.slice/crio-c9a1cc2ee65c470214674b2295443624a891abace7846e047e6c48144d32aecf WatchSource:0}: Error finding container c9a1cc2ee65c470214674b2295443624a891abace7846e047e6c48144d32aecf: Status 404 returned error can't find the container with id c9a1cc2ee65c470214674b2295443624a891abace7846e047e6c48144d32aecf Jul 20 20:11:12.646420 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.646304 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944161317200" event={"ID":"fb6a8aeb-2897-46cc-b5c3-332b34bb13fd","Type":"ContainerStarted","Data":"c9a1cc2ee65c470214674b2295443624a891abace7846e047e6c48144d32aecf"} Jul 20 20:11:12.647552 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.647532 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7d679e540732e9540c2fcef409a247c17996a33ec9f74a4fef2cec9998565bc" Jul 20 20:11:12.647687 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.647553 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:12.659593 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:12.659564 2561 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7176-139944161317200" oldPodUID="98fe02d8-0ae8-4533-b037-253cbe3fac01" podUID="fb6a8aeb-2897-46cc-b5c3-332b34bb13fd" Jul 20 20:11:13.063645 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:13.063608 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98fe02d8-0ae8-4533-b037-253cbe3fac01" path="/var/lib/kubelet/pods/98fe02d8-0ae8-4533-b037-253cbe3fac01/volumes" Jul 20 20:11:13.654163 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:13.654126 2561 generic.go:356] "Generic (PLEG): container finished" podID="fb6a8aeb-2897-46cc-b5c3-332b34bb13fd" containerID="5ab68edcce324515eff57ba5b50f9ca87b7ed3e069e803810e65227d0edbe94b" exitCode=0 Jul 20 20:11:13.654360 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:13.654220 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944161317200" event={"ID":"fb6a8aeb-2897-46cc-b5c3-332b34bb13fd","Type":"ContainerDied","Data":"5ab68edcce324515eff57ba5b50f9ca87b7ed3e069e803810e65227d0edbe94b"} Jul 20 20:11:13.664274 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:13.664250 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:11:14.810370 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:14.810344 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:14.843302 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:14.843217 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7176-139944161317200_fb6a8aeb-2897-46cc-b5c3-332b34bb13fd/test-curl-7176-139944161317200/0.log" Jul 20 20:11:14.869999 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:14.869954 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:14.872983 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:14.872957 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7176-139944161317200"] Jul 20 20:11:14.880806 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:14.880790 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhbdc\" (UniqueName: \"kubernetes.io/projected/fb6a8aeb-2897-46cc-b5c3-332b34bb13fd-kube-api-access-mhbdc\") pod \"fb6a8aeb-2897-46cc-b5c3-332b34bb13fd\" (UID: \"fb6a8aeb-2897-46cc-b5c3-332b34bb13fd\") " Jul 20 20:11:14.882770 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:14.882745 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb6a8aeb-2897-46cc-b5c3-332b34bb13fd-kube-api-access-mhbdc" (OuterVolumeSpecName: "kube-api-access-mhbdc") pod "fb6a8aeb-2897-46cc-b5c3-332b34bb13fd" (UID: "fb6a8aeb-2897-46cc-b5c3-332b34bb13fd"). InnerVolumeSpecName "kube-api-access-mhbdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:11:14.982438 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:14.982414 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhbdc\" (UniqueName: \"kubernetes.io/projected/fb6a8aeb-2897-46cc-b5c3-332b34bb13fd-kube-api-access-mhbdc\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:11:14.999794 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:14.999772 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:15.000184 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.000171 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb6a8aeb-2897-46cc-b5c3-332b34bb13fd" containerName="test-curl-7176-139944161317200" Jul 20 20:11:15.000227 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.000185 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb6a8aeb-2897-46cc-b5c3-332b34bb13fd" containerName="test-curl-7176-139944161317200" Jul 20 20:11:15.000282 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.000273 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb6a8aeb-2897-46cc-b5c3-332b34bb13fd" containerName="test-curl-7176-139944161317200" Jul 20 20:11:15.003318 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.003303 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:15.011568 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.011529 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:15.063315 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.063283 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb6a8aeb-2897-46cc-b5c3-332b34bb13fd" path="/var/lib/kubelet/pods/fb6a8aeb-2897-46cc-b5c3-332b34bb13fd/volumes" Jul 20 20:11:15.083588 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.083563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skxwx\" (UniqueName: \"kubernetes.io/projected/980644aa-278e-49b4-a23b-0071d586dac7-kube-api-access-skxwx\") pod \"test-curl-7176-139944162325536\" (UID: \"980644aa-278e-49b4-a23b-0071d586dac7\") " pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:15.130281 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.130257 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:15.184954 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.184931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skxwx\" (UniqueName: \"kubernetes.io/projected/980644aa-278e-49b4-a23b-0071d586dac7-kube-api-access-skxwx\") pod \"test-curl-7176-139944162325536\" (UID: \"980644aa-278e-49b4-a23b-0071d586dac7\") " pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:15.193791 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.193768 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skxwx\" (UniqueName: \"kubernetes.io/projected/980644aa-278e-49b4-a23b-0071d586dac7-kube-api-access-skxwx\") pod \"test-curl-7176-139944162325536\" (UID: \"980644aa-278e-49b4-a23b-0071d586dac7\") " pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:15.313888 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.313826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:15.454763 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.454741 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:15.456393 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:11:15.456351 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod980644aa_278e_49b4_a23b_0071d586dac7.slice/crio-2b0d0e740c0c6181b35cdb02dabf279df790e6ab0106f31eb7a0ef8df1cf79ba WatchSource:0}: Error finding container 2b0d0e740c0c6181b35cdb02dabf279df790e6ab0106f31eb7a0ef8df1cf79ba: Status 404 returned error can't find the container with id 2b0d0e740c0c6181b35cdb02dabf279df790e6ab0106f31eb7a0ef8df1cf79ba Jul 20 20:11:15.666576 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.666498 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944162325536" event={"ID":"980644aa-278e-49b4-a23b-0071d586dac7","Type":"ContainerStarted","Data":"2b0d0e740c0c6181b35cdb02dabf279df790e6ab0106f31eb7a0ef8df1cf79ba"} Jul 20 20:11:15.667762 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.667733 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944161317200" Jul 20 20:11:15.667871 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:15.667767 2561 scope.go:117] "RemoveContainer" containerID="5ab68edcce324515eff57ba5b50f9ca87b7ed3e069e803810e65227d0edbe94b" Jul 20 20:11:16.675543 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:16.675442 2561 generic.go:356] "Generic (PLEG): container finished" podID="980644aa-278e-49b4-a23b-0071d586dac7" containerID="6121d24927f53704ad48d9aaf678974b0dc297ae3253ea8774e608d36a683c63" exitCode=0 Jul 20 20:11:16.676104 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:16.676076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944162325536" event={"ID":"980644aa-278e-49b4-a23b-0071d586dac7","Type":"ContainerDied","Data":"6121d24927f53704ad48d9aaf678974b0dc297ae3253ea8774e608d36a683c63"} Jul 20 20:11:17.825132 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:17.825110 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:17.854241 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:17.854215 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7176-139944162325536_980644aa-278e-49b4-a23b-0071d586dac7/test-curl-7176-139944162325536/0.log" Jul 20 20:11:17.885366 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:17.885336 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:17.890681 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:17.890656 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:17.910560 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:17.910536 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skxwx\" (UniqueName: \"kubernetes.io/projected/980644aa-278e-49b4-a23b-0071d586dac7-kube-api-access-skxwx\") pod \"980644aa-278e-49b4-a23b-0071d586dac7\" (UID: \"980644aa-278e-49b4-a23b-0071d586dac7\") " Jul 20 20:11:17.912513 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:17.912484 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/980644aa-278e-49b4-a23b-0071d586dac7-kube-api-access-skxwx" (OuterVolumeSpecName: "kube-api-access-skxwx") pod "980644aa-278e-49b4-a23b-0071d586dac7" (UID: "980644aa-278e-49b4-a23b-0071d586dac7"). InnerVolumeSpecName "kube-api-access-skxwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:11:18.011257 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.011217 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skxwx\" (UniqueName: \"kubernetes.io/projected/980644aa-278e-49b4-a23b-0071d586dac7-kube-api-access-skxwx\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:11:18.034025 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.033998 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:18.034468 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.034454 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="980644aa-278e-49b4-a23b-0071d586dac7" containerName="test-curl-7176-139944162325536" Jul 20 20:11:18.034509 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.034470 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="980644aa-278e-49b4-a23b-0071d586dac7" containerName="test-curl-7176-139944162325536" Jul 20 20:11:18.034564 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.034552 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="980644aa-278e-49b4-a23b-0071d586dac7" containerName="test-curl-7176-139944162325536" Jul 20 20:11:18.037645 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.037631 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:18.055747 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.055716 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:18.111921 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.111891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rt8c\" (UniqueName: \"kubernetes.io/projected/6aace85b-86ad-4914-a392-988ca70e9a5e-kube-api-access-4rt8c\") pod \"test-curl-7176-139944162325536\" (UID: \"6aace85b-86ad-4914-a392-988ca70e9a5e\") " pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:18.212953 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.212922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rt8c\" (UniqueName: \"kubernetes.io/projected/6aace85b-86ad-4914-a392-988ca70e9a5e-kube-api-access-4rt8c\") pod \"test-curl-7176-139944162325536\" (UID: \"6aace85b-86ad-4914-a392-988ca70e9a5e\") " pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:18.238301 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.238271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rt8c\" (UniqueName: \"kubernetes.io/projected/6aace85b-86ad-4914-a392-988ca70e9a5e-kube-api-access-4rt8c\") pod \"test-curl-7176-139944162325536\" (UID: \"6aace85b-86ad-4914-a392-988ca70e9a5e\") " pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:18.346682 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.346608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:18.484794 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.484766 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:18.486061 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:11:18.486040 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6aace85b_86ad_4914_a392_988ca70e9a5e.slice/crio-dea7b80fa831c71638c01afa05b0e2f0763b4650e2d831f10935aaa1b8f3885d WatchSource:0}: Error finding container dea7b80fa831c71638c01afa05b0e2f0763b4650e2d831f10935aaa1b8f3885d: Status 404 returned error can't find the container with id dea7b80fa831c71638c01afa05b0e2f0763b4650e2d831f10935aaa1b8f3885d Jul 20 20:11:18.692405 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.692314 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b0d0e740c0c6181b35cdb02dabf279df790e6ab0106f31eb7a0ef8df1cf79ba" Jul 20 20:11:18.692405 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.692312 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:18.693588 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.693561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944162325536" event={"ID":"6aace85b-86ad-4914-a392-988ca70e9a5e","Type":"ContainerStarted","Data":"dea7b80fa831c71638c01afa05b0e2f0763b4650e2d831f10935aaa1b8f3885d"} Jul 20 20:11:18.706369 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:18.706346 2561 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7176-139944162325536" oldPodUID="980644aa-278e-49b4-a23b-0071d586dac7" podUID="6aace85b-86ad-4914-a392-988ca70e9a5e" Jul 20 20:11:19.070660 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:19.070627 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="980644aa-278e-49b4-a23b-0071d586dac7" path="/var/lib/kubelet/pods/980644aa-278e-49b4-a23b-0071d586dac7/volumes" Jul 20 20:11:19.701546 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:19.701512 2561 generic.go:356] "Generic (PLEG): container finished" podID="6aace85b-86ad-4914-a392-988ca70e9a5e" containerID="6954e735205ca0999a6ed75ebc2880ab03e264e685ac7c4815edaa9e5e885e89" exitCode=0 Jul 20 20:11:19.701724 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:19.701599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7176-139944162325536" event={"ID":"6aace85b-86ad-4914-a392-988ca70e9a5e","Type":"ContainerDied","Data":"6954e735205ca0999a6ed75ebc2880ab03e264e685ac7c4815edaa9e5e885e89"} Jul 20 20:11:20.842420 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:20.842398 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:20.880224 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:20.880199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7176-139944162325536_6aace85b-86ad-4914-a392-988ca70e9a5e/test-curl-7176-139944162325536/0.log" Jul 20 20:11:20.918752 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:20.918719 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:20.926965 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:20.926939 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7176-139944162325536"] Jul 20 20:11:20.937129 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:20.937105 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rt8c\" (UniqueName: \"kubernetes.io/projected/6aace85b-86ad-4914-a392-988ca70e9a5e-kube-api-access-4rt8c\") pod \"6aace85b-86ad-4914-a392-988ca70e9a5e\" (UID: \"6aace85b-86ad-4914-a392-988ca70e9a5e\") " Jul 20 20:11:20.939123 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:20.939097 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aace85b-86ad-4914-a392-988ca70e9a5e-kube-api-access-4rt8c" (OuterVolumeSpecName: "kube-api-access-4rt8c") pod "6aace85b-86ad-4914-a392-988ca70e9a5e" (UID: "6aace85b-86ad-4914-a392-988ca70e9a5e"). InnerVolumeSpecName "kube-api-access-4rt8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:11:21.038661 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.038639 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rt8c\" (UniqueName: \"kubernetes.io/projected/6aace85b-86ad-4914-a392-988ca70e9a5e-kube-api-access-4rt8c\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:11:21.064172 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.064148 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aace85b-86ad-4914-a392-988ca70e9a5e" path="/var/lib/kubelet/pods/6aace85b-86ad-4914-a392-988ca70e9a5e/volumes" Jul 20 20:11:21.165022 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.164987 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng"] Jul 20 20:11:21.165488 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.165471 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aace85b-86ad-4914-a392-988ca70e9a5e" containerName="test-curl-7176-139944162325536" Jul 20 20:11:21.165590 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.165490 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aace85b-86ad-4914-a392-988ca70e9a5e" containerName="test-curl-7176-139944162325536" Jul 20 20:11:21.165651 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.165588 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aace85b-86ad-4914-a392-988ca70e9a5e" containerName="test-curl-7176-139944162325536" Jul 20 20:11:21.168814 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.168797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" Jul 20 20:11:21.173316 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.173300 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 20:11:21.191399 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.191366 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng"] Jul 20 20:11:21.240531 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.240507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34852f2-241c-43bd-85a0-3d8f883d3dcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-397b55-wnvng\" (UID: \"d34852f2-241c-43bd-85a0-3d8f883d3dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" Jul 20 20:11:21.341682 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.341601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34852f2-241c-43bd-85a0-3d8f883d3dcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-397b55-wnvng\" (UID: \"d34852f2-241c-43bd-85a0-3d8f883d3dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" Jul 20 20:11:21.342319 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.342300 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34852f2-241c-43bd-85a0-3d8f883d3dcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-397b55-wnvng\" (UID: \"d34852f2-241c-43bd-85a0-3d8f883d3dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" Jul 20 20:11:21.479375 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.479349 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" Jul 20 20:11:21.616356 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.616331 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng"] Jul 20 20:11:21.617780 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:11:21.617757 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34852f2_241c_43bd_85a0_3d8f883d3dcf.slice/crio-5d8ece366a01a15fc5bb8a6391a39ef7cb5e61040009a44c519c27b077bfeb9e WatchSource:0}: Error finding container 5d8ece366a01a15fc5bb8a6391a39ef7cb5e61040009a44c519c27b077bfeb9e: Status 404 returned error can't find the container with id 5d8ece366a01a15fc5bb8a6391a39ef7cb5e61040009a44c519c27b077bfeb9e Jul 20 20:11:21.714568 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.714539 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" event={"ID":"d34852f2-241c-43bd-85a0-3d8f883d3dcf","Type":"ContainerStarted","Data":"5d8ece366a01a15fc5bb8a6391a39ef7cb5e61040009a44c519c27b077bfeb9e"} Jul 20 20:11:21.715747 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.715731 2561 scope.go:117] "RemoveContainer" containerID="6954e735205ca0999a6ed75ebc2880ab03e264e685ac7c4815edaa9e5e885e89" Jul 20 20:11:21.715852 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.715750 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7176-139944162325536" Jul 20 20:11:21.844360 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.844333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:21.941698 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:21.941630 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:22.722893 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:22.722859 2561 generic.go:356] "Generic (PLEG): container finished" podID="d34852f2-241c-43bd-85a0-3d8f883d3dcf" containerID="aa5c888fa30d39b90d6d6fd4d4f0c272ccf68ecd8f573d45a8b22d0293f85ec6" exitCode=0 Jul 20 20:11:22.724734 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:22.722952 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" event={"ID":"d34852f2-241c-43bd-85a0-3d8f883d3dcf","Type":"ContainerDied","Data":"aa5c888fa30d39b90d6d6fd4d4f0c272ccf68ecd8f573d45a8b22d0293f85ec6"} Jul 20 20:11:23.861810 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:23.861783 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" Jul 20 20:11:23.965678 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:23.965642 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34852f2-241c-43bd-85a0-3d8f883d3dcf-maas-api-service-ca\") pod \"d34852f2-241c-43bd-85a0-3d8f883d3dcf\" (UID: \"d34852f2-241c-43bd-85a0-3d8f883d3dcf\") " Jul 20 20:11:23.966007 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:23.965986 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34852f2-241c-43bd-85a0-3d8f883d3dcf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d34852f2-241c-43bd-85a0-3d8f883d3dcf" (UID: "d34852f2-241c-43bd-85a0-3d8f883d3dcf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:11:24.066931 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:24.066846 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34852f2-241c-43bd-85a0-3d8f883d3dcf-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:11:24.737479 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:24.737446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" event={"ID":"d34852f2-241c-43bd-85a0-3d8f883d3dcf","Type":"ContainerDied","Data":"5d8ece366a01a15fc5bb8a6391a39ef7cb5e61040009a44c519c27b077bfeb9e"} Jul 20 20:11:24.737479 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:24.737481 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng" Jul 20 20:11:24.737692 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:24.737492 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d8ece366a01a15fc5bb8a6391a39ef7cb5e61040009a44c519c27b077bfeb9e" Jul 20 20:11:31.670065 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:31.670031 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:34.955014 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:34.954980 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:11:36.224491 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:36.224452 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:36.255764 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:36.255732 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng"] Jul 20 20:11:36.257970 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:36.257949 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-397b55-wnvng"] Jul 20 20:11:36.668826 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:36.668729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:37.065194 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:37.065158 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34852f2-241c-43bd-85a0-3d8f883d3dcf" path="/var/lib/kubelet/pods/d34852f2-241c-43bd-85a0-3d8f883d3dcf/volumes" Jul 20 20:11:42.626050 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:42.626019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:42.699729 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:42.699694 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:42.895053 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:42.894968 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:43.120715 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.120688 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:43.258125 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.258093 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49"] Jul 20 20:11:43.258555 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.258535 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34852f2-241c-43bd-85a0-3d8f883d3dcf" containerName="revoke-keys" Jul 20 20:11:43.258555 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.258554 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34852f2-241c-43bd-85a0-3d8f883d3dcf" containerName="revoke-keys" Jul 20 20:11:43.258703 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.258669 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34852f2-241c-43bd-85a0-3d8f883d3dcf" containerName="revoke-keys" Jul 20 20:11:43.261658 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.261641 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" Jul 20 20:11:43.264349 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.264331 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-stdfs\"" Jul 20 20:11:43.270229 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.270206 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49"] Jul 20 20:11:43.347748 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.347712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c01c322-d601-4576-91fe-f654de666d31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49\" (UID: \"0c01c322-d601-4576-91fe-f654de666d31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" Jul 20 20:11:43.448488 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.448454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c01c322-d601-4576-91fe-f654de666d31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49\" (UID: \"0c01c322-d601-4576-91fe-f654de666d31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" Jul 20 20:11:43.449104 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.449080 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c01c322-d601-4576-91fe-f654de666d31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49\" (UID: \"0c01c322-d601-4576-91fe-f654de666d31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" Jul 20 20:11:43.573353 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.573272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" Jul 20 20:11:43.915664 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.915637 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49"] Jul 20 20:11:43.917471 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:11:43.917438 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c01c322_d601_4576_91fe_f654de666d31.slice/crio-b346b53b24717dca2f485f5921720d337fbea1469356f110755ce3354052dee8 WatchSource:0}: Error finding container b346b53b24717dca2f485f5921720d337fbea1469356f110755ce3354052dee8: Status 404 returned error can't find the container with id b346b53b24717dca2f485f5921720d337fbea1469356f110755ce3354052dee8 Jul 20 20:11:43.959436 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:43.959367 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:44.059684 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:44.059653 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:44.855893 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:44.855860 2561 generic.go:356] "Generic (PLEG): container finished" podID="0c01c322-d601-4576-91fe-f654de666d31" containerID="2042830f9e5628b27f6e9a7990589602783cac77fa51c05d2e226250ddcb6662" exitCode=0 Jul 20 20:11:44.856079 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:44.855950 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" event={"ID":"0c01c322-d601-4576-91fe-f654de666d31","Type":"ContainerDied","Data":"2042830f9e5628b27f6e9a7990589602783cac77fa51c05d2e226250ddcb6662"} Jul 20 20:11:44.856079 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:44.856008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" event={"ID":"0c01c322-d601-4576-91fe-f654de666d31","Type":"ContainerStarted","Data":"b346b53b24717dca2f485f5921720d337fbea1469356f110755ce3354052dee8"} Jul 20 20:11:46.001832 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:46.001811 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" Jul 20 20:11:46.070152 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:46.070122 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c01c322-d601-4576-91fe-f654de666d31-maas-api-service-ca\") pod \"0c01c322-d601-4576-91fe-f654de666d31\" (UID: \"0c01c322-d601-4576-91fe-f654de666d31\") " Jul 20 20:11:46.070453 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:46.070431 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c01c322-d601-4576-91fe-f654de666d31-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0c01c322-d601-4576-91fe-f654de666d31" (UID: "0c01c322-d601-4576-91fe-f654de666d31"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:11:46.171820 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:46.171744 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c01c322-d601-4576-91fe-f654de666d31-maas-api-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 20 20:11:46.869026 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:46.869001 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" Jul 20 20:11:46.869202 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:46.869044 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49" event={"ID":"0c01c322-d601-4576-91fe-f654de666d31","Type":"ContainerDied","Data":"b346b53b24717dca2f485f5921720d337fbea1469356f110755ce3354052dee8"} Jul 20 20:11:46.869202 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:46.869092 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b346b53b24717dca2f485f5921720d337fbea1469356f110755ce3354052dee8" Jul 20 20:11:53.803357 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:53.803248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:57.052147 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:57.052115 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-frxlk"] Jul 20 20:11:58.345104 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:58.345071 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49"] Jul 20 20:11:58.347367 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:58.347345 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb9c1-4mw49"] Jul 20 20:11:58.350236 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:58.350200 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:58.719565 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:58.719538 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:59.063584 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:11:59.063506 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c01c322-d601-4576-91fe-f654de666d31" path="/var/lib/kubelet/pods/0c01c322-d601-4576-91fe-f654de666d31/volumes" Jul 20 20:12:04.872024 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:04.871984 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:04.945562 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:04.945525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:05.183830 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:05.183740 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:05.442764 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:05.442674 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:11.451414 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:11.451357 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bfnjd_7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7/manager/0.log" Jul 20 20:12:11.574256 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:11.574231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5xzhg_9a6c60db-3409-475a-85d6-cc38df04d6d9/manager/0.log" Jul 20 20:12:11.806213 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:11.806190 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lkl5w_048bd6bf-d10e-48d4-b63e-ab258f9f7bab/server/0.log" Jul 20 20:12:12.331347 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:12.331325 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5_7170d993-27a7-4ad2-93dd-17110d26e790/copy-manifests/0.log" Jul 20 20:12:12.338219 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:12.338199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5_7170d993-27a7-4ad2-93dd-17110d26e790/manager/0.log" Jul 20 20:12:12.904342 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:12.904311 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742960-v2dx6_b97ef79c-56b3-473a-aa9e-ed79d0373807/cleanup/0.log" Jul 20 20:12:13.020918 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:13.020886 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4m5dp_ca4f3f2a-88c1-4d9d-9044-df5fa8aba460/postgres/0.log" Jul 20 20:12:13.849142 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:13.849111 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd_89e5e924-0436-4124-97ab-b3ee4a142361/util/0.log" Jul 20 20:12:13.855198 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:13.855170 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd_89e5e924-0436-4124-97ab-b3ee4a142361/pull/0.log" Jul 20 20:12:13.864250 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:13.864232 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd_89e5e924-0436-4124-97ab-b3ee4a142361/extract/0.log" Jul 20 20:12:13.982595 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:13.982574 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5_638696cb-bc3b-492d-83fc-1c678351d548/util/0.log" Jul 20 20:12:13.988683 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:13.988667 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5_638696cb-bc3b-492d-83fc-1c678351d548/pull/0.log" Jul 20 20:12:13.995816 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:13.995798 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5_638696cb-bc3b-492d-83fc-1c678351d548/extract/0.log" Jul 20 20:12:14.113746 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.113655 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh_660246b7-2ae0-4cb0-adcd-372b5d34b08b/pull/0.log" Jul 20 20:12:14.120249 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.120227 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh_660246b7-2ae0-4cb0-adcd-372b5d34b08b/extract/0.log" Jul 20 20:12:14.126622 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.126604 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh_660246b7-2ae0-4cb0-adcd-372b5d34b08b/util/0.log" Jul 20 20:12:14.236881 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.236854 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74_7359d856-9186-4c0a-b4a9-1b2c7d98b077/util/0.log" Jul 20 20:12:14.243361 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.243346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74_7359d856-9186-4c0a-b4a9-1b2c7d98b077/pull/0.log" Jul 20 20:12:14.254306 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.254285 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74_7359d856-9186-4c0a-b4a9-1b2c7d98b077/extract/0.log" Jul 20 20:12:14.495077 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.495052 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s4xc9_dffd8926-b5d9-4818-9d65-dca48d51d75a/manager/0.log" Jul 20 20:12:14.615468 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.615444 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bw7tv_e509a107-1130-45a0-9222-1afaa1b8b557/manager/0.log" Jul 20 20:12:14.854171 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:14.854097 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mpr4m_b8481f8a-c4fe-427c-bb6c-1e53dea91702/registry-server/0.log" Jul 20 20:12:15.103958 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:15.103928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-frxlk_f1732f90-2717-481b-b849-b08da664d8dc/limitador/0.log" Jul 20 20:12:15.234767 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:15.234741 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2qcpd_6c88b5fb-57e1-4653-aa86-fb27792b3019/manager/0.log" Jul 20 20:12:15.852792 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:15.852759 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7578c486d7-gs2g7_c394aa2c-1834-4d22-a147-2bb6fdab428e/kube-auth-proxy/0.log" Jul 20 20:12:16.087627 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:16.087603 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7b5x6_c611da0b-17c8-4218-bac3-ae1ed340d020/istio-proxy/1.log" Jul 20 20:12:16.781155 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:16.781126 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-c7lfl_a514ebaa-948e-4119-ac4d-5fa4c0374d83/main/0.log" Jul 20 20:12:17.136948 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:17.136877 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzvc2_2ca7d56f-ddfb-457a-9c47-8ba9bbed259f/main/0.log" Jul 20 20:12:23.348533 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:23.348498 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:23.428643 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:23.428613 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:26.091644 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:26.091613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mwp22_c60c77c9-d83c-4dfe-aa6f-c5ee823a9fbd/global-pull-secret-syncer/0.log" Jul 20 20:12:26.188203 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:26.188172 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-blrqh_425540d6-9e74-4668-8ef0-4b2171da2f33/konnectivity-agent/0.log" Jul 20 20:12:26.278875 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:26.278851 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-59.ec2.internal_de7388bb11102855ed9215e9a2981d75/haproxy/0.log" Jul 20 20:12:30.643599 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.643573 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd_89e5e924-0436-4124-97ab-b3ee4a142361/extract/0.log" Jul 20 20:12:30.665557 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.665533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd_89e5e924-0436-4124-97ab-b3ee4a142361/util/0.log" Jul 20 20:12:30.691782 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.691751 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ct5nd_89e5e924-0436-4124-97ab-b3ee4a142361/pull/0.log" Jul 20 20:12:30.724073 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.724052 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5_638696cb-bc3b-492d-83fc-1c678351d548/extract/0.log" Jul 20 20:12:30.749417 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.749374 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5_638696cb-bc3b-492d-83fc-1c678351d548/util/0.log" Jul 20 20:12:30.798731 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.798712 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndkw5_638696cb-bc3b-492d-83fc-1c678351d548/pull/0.log" Jul 20 20:12:30.833161 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.833144 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh_660246b7-2ae0-4cb0-adcd-372b5d34b08b/extract/0.log" Jul 20 20:12:30.861588 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.861571 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh_660246b7-2ae0-4cb0-adcd-372b5d34b08b/util/0.log" Jul 20 20:12:30.886993 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.886973 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mh7jh_660246b7-2ae0-4cb0-adcd-372b5d34b08b/pull/0.log" Jul 20 20:12:30.935195 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.935141 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74_7359d856-9186-4c0a-b4a9-1b2c7d98b077/extract/0.log" Jul 20 20:12:30.967218 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:30.967198 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74_7359d856-9186-4c0a-b4a9-1b2c7d98b077/util/0.log" Jul 20 20:12:31.008815 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.008791 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18pv74_7359d856-9186-4c0a-b4a9-1b2c7d98b077/pull/0.log" Jul 20 20:12:31.541674 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.541645 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s4xc9_dffd8926-b5d9-4818-9d65-dca48d51d75a/manager/0.log" Jul 20 20:12:31.572919 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.572890 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bw7tv_e509a107-1130-45a0-9222-1afaa1b8b557/manager/0.log" Jul 20 20:12:31.658495 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.658474 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mpr4m_b8481f8a-c4fe-427c-bb6c-1e53dea91702/registry-server/0.log" Jul 20 20:12:31.722939 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.722915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 20:12:31.727187 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.727164 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 20:12:31.735696 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.735676 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 20:12:31.739715 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.739698 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5mhv_e8f4d497-b750-433f-831d-5059f8e330ee/ovn-acl-logging/0.log" Jul 20 20:12:31.910316 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.910247 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-frxlk_f1732f90-2717-481b-b849-b08da664d8dc/limitador/0.log" Jul 20 20:12:31.989029 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:31.989005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2qcpd_6c88b5fb-57e1-4653-aa86-fb27792b3019/manager/0.log" Jul 20 20:12:33.691843 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.691817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c6beb84-639a-48f0-9369-6fe7b238c248/alertmanager/0.log" Jul 20 20:12:33.728401 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.728356 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c6beb84-639a-48f0-9369-6fe7b238c248/config-reloader/0.log" Jul 20 20:12:33.756545 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.756525 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c6beb84-639a-48f0-9369-6fe7b238c248/kube-rbac-proxy-web/0.log" Jul 20 20:12:33.786798 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.786772 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c6beb84-639a-48f0-9369-6fe7b238c248/kube-rbac-proxy/0.log" Jul 20 20:12:33.815948 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.815886 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c6beb84-639a-48f0-9369-6fe7b238c248/kube-rbac-proxy-metric/0.log" Jul 20 20:12:33.848978 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.848955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c6beb84-639a-48f0-9369-6fe7b238c248/prom-label-proxy/0.log" Jul 20 20:12:33.874619 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.874597 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c6beb84-639a-48f0-9369-6fe7b238c248/init-config-reloader/0.log" Jul 20 20:12:33.945434 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.945411 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-vl2wq_fe5397c2-554a-400d-8247-ed16bee7482b/kube-state-metrics/0.log" Jul 20 20:12:33.971196 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.971176 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-vl2wq_fe5397c2-554a-400d-8247-ed16bee7482b/kube-rbac-proxy-main/0.log" Jul 20 20:12:33.995321 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:33.995301 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-vl2wq_fe5397c2-554a-400d-8247-ed16bee7482b/kube-rbac-proxy-self/0.log" Jul 20 20:12:34.027778 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:34.027761 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-669b987f7b-x4qbz_02cbd8ef-0d84-4156-9599-2a6db487a80f/metrics-server/0.log" Jul 20 20:12:34.268542 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:34.268521 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcx89_574698ea-00e6-4932-a5a7-6a0bce0ad0b8/node-exporter/0.log" Jul 20 20:12:34.290311 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:34.290291 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcx89_574698ea-00e6-4932-a5a7-6a0bce0ad0b8/kube-rbac-proxy/0.log" Jul 20 20:12:34.312566 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:34.312550 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcx89_574698ea-00e6-4932-a5a7-6a0bce0ad0b8/init-textfile/0.log" Jul 20 20:12:34.759026 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:34.759000 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65c8896d4f-r5ht6_58ec8fd3-3166-4dd9-9ee4-86be97d0370c/telemeter-client/0.log" Jul 20 20:12:34.788513 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:34.788482 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65c8896d4f-r5ht6_58ec8fd3-3166-4dd9-9ee4-86be97d0370c/reload/0.log" Jul 20 20:12:34.821591 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:34.821572 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65c8896d4f-r5ht6_58ec8fd3-3166-4dd9-9ee4-86be97d0370c/kube-rbac-proxy/0.log" Jul 20 20:12:36.708430 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.708400 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p"] Jul 20 20:12:36.708832 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.708818 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c01c322-d601-4576-91fe-f654de666d31" containerName="revoke-keys" Jul 20 20:12:36.708832 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.708833 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c01c322-d601-4576-91fe-f654de666d31" containerName="revoke-keys" Jul 20 20:12:36.708918 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.708907 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c01c322-d601-4576-91fe-f654de666d31" containerName="revoke-keys" Jul 20 20:12:36.712219 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.712199 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.721560 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.721532 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87kz5\"/\"openshift-service-ca.crt\"" Jul 20 20:12:36.721560 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.721546 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87kz5\"/\"kube-root-ca.crt\"" Jul 20 20:12:36.722143 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.722122 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p"] Jul 20 20:12:36.722584 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.722567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-87kz5\"/\"default-dockercfg-n49t4\"" Jul 20 20:12:36.771935 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.771909 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/1.log" Jul 20 20:12:36.776127 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.776090 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ltrfw_4729d6fa-e1ad-4cb4-81cb-f4f117b0f97e/console-operator/2.log" Jul 20 20:12:36.805715 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.805688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-lib-modules\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.805819 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.805721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm2r6\" (UniqueName: \"kubernetes.io/projected/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-kube-api-access-cm2r6\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.805819 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.805749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-sys\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.805819 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.805800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-proc\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.805944 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.805878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-podres\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.906644 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-proc\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.906748 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-podres\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.906748 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906727 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-proc\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.906882 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-lib-modules\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.906882 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm2r6\" (UniqueName: \"kubernetes.io/projected/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-kube-api-access-cm2r6\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.906882 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906802 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-sys\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.906882 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906834 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-podres\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.907040 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906913 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-lib-modules\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.907040 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.906912 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-sys\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:36.915913 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:36.915890 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm2r6\" (UniqueName: \"kubernetes.io/projected/4638fa09-6c64-4a02-8bfa-a3c13b6960ac-kube-api-access-cm2r6\") pod \"perf-node-gather-daemonset-4qn9p\" (UID: \"4638fa09-6c64-4a02-8bfa-a3c13b6960ac\") " pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:37.023071 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:37.023044 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:37.174771 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:37.174743 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p"] Jul 20 20:12:37.176524 ip-10-0-135-59 kubenswrapper[2561]: W0720 20:12:37.176494 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4638fa09_6c64_4a02_8bfa_a3c13b6960ac.slice/crio-305be9790e9ea89ef8f7336512959ec6e6294d9bf2bfe36049f7031122669c34 WatchSource:0}: Error finding container 305be9790e9ea89ef8f7336512959ec6e6294d9bf2bfe36049f7031122669c34: Status 404 returned error can't find the container with id 305be9790e9ea89ef8f7336512959ec6e6294d9bf2bfe36049f7031122669c34 Jul 20 20:12:37.391440 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:37.391340 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-mrkwh_28ddee51-0515-4171-a1d3-27f72947552c/download-server/0.log" Jul 20 20:12:38.162202 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:38.162173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" event={"ID":"4638fa09-6c64-4a02-8bfa-a3c13b6960ac","Type":"ContainerStarted","Data":"bc78826a0955925e5189fc52115e20d8c9eb9d6ce51cbe24bcaba79a287e5b7d"} Jul 20 20:12:38.162621 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:38.162220 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" event={"ID":"4638fa09-6c64-4a02-8bfa-a3c13b6960ac","Type":"ContainerStarted","Data":"305be9790e9ea89ef8f7336512959ec6e6294d9bf2bfe36049f7031122669c34"} Jul 20 20:12:38.162621 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:38.162279 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:38.180442 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:38.180399 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" podStartSLOduration=2.180372754 podStartE2EDuration="2.180372754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 20:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:12:38.178435202 +0000 UTC m=+3007.681755671" watchObservedRunningTime="2026-07-20 20:12:38.180372754 +0000 UTC m=+3007.683693222" Jul 20 20:12:39.063094 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:39.063064 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gx9kq_dcf41659-6793-4414-bf04-d1f36705dd5b/dns/0.log" Jul 20 20:12:39.086770 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:39.086739 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gx9kq_dcf41659-6793-4414-bf04-d1f36705dd5b/kube-rbac-proxy/0.log" Jul 20 20:12:39.247111 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:39.247085 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rr8kq_92421977-fd0d-44fa-8044-24f942e188ff/dns-node-resolver/0.log" Jul 20 20:12:39.818010 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:39.817981 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cf7d9dd99-4shqt_4d4a44ac-84d0-46ff-8f09-c3a4dfa8ef94/registry/0.log" Jul 20 20:12:39.927924 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:39.927898 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xf6bb_1dc444a4-b636-4ab5-b94f-64d04ac06517/node-ca/0.log" Jul 20 20:12:41.113505 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:41.113479 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7578c486d7-gs2g7_c394aa2c-1834-4d22-a147-2bb6fdab428e/kube-auth-proxy/0.log" Jul 20 20:12:41.235821 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:41.235787 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7b5x6_c611da0b-17c8-4218-bac3-ae1ed340d020/istio-proxy/0.log" Jul 20 20:12:41.259096 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:41.259073 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7b5x6_c611da0b-17c8-4218-bac3-ae1ed340d020/istio-proxy/1.log" Jul 20 20:12:42.052808 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:42.052774 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-52l2f_d49e6096-7f16-441f-9604-cd0e7e67452d/serve-healthcheck-canary/0.log" Jul 20 20:12:42.601153 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:42.601122 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-hqdlw_0382762c-47aa-476c-9c34-e9b401f3f4f2/insights-operator/0.log" Jul 20 20:12:42.601658 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:42.601416 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-hqdlw_0382762c-47aa-476c-9c34-e9b401f3f4f2/insights-operator/1.log" Jul 20 20:12:42.799487 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:42.799462 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkjk6_97beb4dc-665c-4796-85db-c0c87496ca78/kube-rbac-proxy/0.log" Jul 20 20:12:42.823935 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:42.823916 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkjk6_97beb4dc-665c-4796-85db-c0c87496ca78/exporter/0.log" Jul 20 20:12:42.850215 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:42.850196 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkjk6_97beb4dc-665c-4796-85db-c0c87496ca78/extractor/0.log" Jul 20 20:12:44.178394 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:44.178366 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-87kz5/perf-node-gather-daemonset-4qn9p" Jul 20 20:12:45.171647 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:45.171615 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bfnjd_7fd7d89b-b9c2-47f9-8dfa-99f0d7e9b7c7/manager/0.log" Jul 20 20:12:45.356660 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:45.356630 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5xzhg_9a6c60db-3409-475a-85d6-cc38df04d6d9/manager/0.log" Jul 20 20:12:45.530344 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:45.530321 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lkl5w_048bd6bf-d10e-48d4-b63e-ab258f9f7bab/server/0.log" Jul 20 20:12:45.855844 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:45.855764 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5_7170d993-27a7-4ad2-93dd-17110d26e790/manager/0.log" Jul 20 20:12:45.884962 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:45.884934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6d57ff7c-vkwf5_7170d993-27a7-4ad2-93dd-17110d26e790/copy-manifests/0.log" Jul 20 20:12:47.302039 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:47.302007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zjplv_bb583ab9-b29b-4189-ba27-91ec86a3ad52/openshift-lws-operator/0.log" Jul 20 20:12:47.303097 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:47.303076 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7578c486d7-gs2g7_c394aa2c-1834-4d22-a147-2bb6fdab428e/kube-auth-proxy/0.log" Jul 20 20:12:47.348954 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:47.348930 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7b5x6_c611da0b-17c8-4218-bac3-ae1ed340d020/istio-proxy/0.log" Jul 20 20:12:47.375796 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:47.375769 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7b5x6_c611da0b-17c8-4218-bac3-ae1ed340d020/istio-proxy/1.log" Jul 20 20:12:48.819894 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:48.819869 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7578c486d7-gs2g7_c394aa2c-1834-4d22-a147-2bb6fdab428e/kube-auth-proxy/0.log" Jul 20 20:12:48.860554 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:48.860528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7b5x6_c611da0b-17c8-4218-bac3-ae1ed340d020/istio-proxy/0.log" Jul 20 20:12:48.885916 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:48.885893 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7b5x6_c611da0b-17c8-4218-bac3-ae1ed340d020/istio-proxy/1.log" Jul 20 20:12:52.359559 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:52.359531 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ldf9k_9ead26b6-5a2e-4472-806d-6433eee94243/migrator/0.log" Jul 20 20:12:52.402484 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:52.402455 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ldf9k_9ead26b6-5a2e-4472-806d-6433eee94243/graceful-termination/0.log" Jul 20 20:12:53.829796 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:53.829763 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7grm6_be96d401-816a-4992-92e6-2b234cfb50c2/kube-multus/0.log" Jul 20 20:12:53.865749 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:53.865726 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6w9b8_8f843349-92fe-4144-9d95-1513eb1fbf51/kube-multus-additional-cni-plugins/0.log" Jul 20 20:12:53.890155 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:53.890131 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6w9b8_8f843349-92fe-4144-9d95-1513eb1fbf51/egress-router-binary-copy/0.log" Jul 20 20:12:53.912450 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:53.912429 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6w9b8_8f843349-92fe-4144-9d95-1513eb1fbf51/cni-plugins/0.log" Jul 20 20:12:53.944051 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:53.944029 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6w9b8_8f843349-92fe-4144-9d95-1513eb1fbf51/bond-cni-plugin/0.log" Jul 20 20:12:53.969724 ip-10-0-135-59 kubenswrapper[2561]: I0720 20:12:53.969708 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6w9b8_8f843349-92fe-4144-9d95-1513eb1fbf51/routeoverride-cni/0.log"