Jul 03 14:11:29.788082 ip-10-0-137-36 systemd[1]: Starting Kubernetes Kubelet... Jul 03 14:11:30.120354 ip-10-0-137-36 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 14:11:30.120354 ip-10-0-137-36 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 03 14:11:30.120354 ip-10-0-137-36 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 14:11:30.120354 ip-10-0-137-36 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 03 14:11:30.120354 ip-10-0-137-36 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 14:11:30.121245 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.121148 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 03 14:11:30.124542 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124527 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124544 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124548 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124551 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124554 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124557 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124560 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124563 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124566 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124573 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124576 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 14:11:30.124574 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124579 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124582 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124584 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124587 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124589 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124592 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124595 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124597 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124599 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124602 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124605 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124607 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124610 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124612 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124615 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124618 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124620 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124623 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124625 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124627 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124630 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 14:11:30.124853 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124632 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124635 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124637 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124639 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124642 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124645 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124648 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124650 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124652 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124655 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124659 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124663 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124665 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124669 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124672 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124675 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124678 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124680 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124683 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124685 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 14:11:30.125367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124688 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124690 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124693 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124695 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124697 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124701 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124703 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124706 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124708 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124711 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124713 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124716 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124719 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124722 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124724 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124728 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124732 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124735 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124738 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 14:11:30.125889 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124741 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124743 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124746 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124748 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124751 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124753 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124756 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124759 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124761 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124764 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124767 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124769 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124771 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124774 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124776 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124779 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124781 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124784 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124786 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124789 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 14:11:30.126343 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124791 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124793 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124796 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124811 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124814 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124816 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124819 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.124822 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125479 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125485 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125488 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125491 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125493 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125496 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125498 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125501 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125504 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125507 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125511 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 14:11:30.126827 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125514 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125516 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125519 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125521 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125524 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125527 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125530 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125532 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125535 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125537 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125540 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125542 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125545 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125547 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125550 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125552 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125555 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125557 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125560 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125562 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 14:11:30.127312 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125565 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125568 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125570 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125573 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125575 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125578 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125580 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125583 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125585 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125587 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125590 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125593 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125595 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125598 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125600 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125603 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125607 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125611 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125614 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125617 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 14:11:30.127845 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125619 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125622 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125624 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125627 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125630 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125634 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125636 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125639 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125642 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125645 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125647 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125650 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125652 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125656 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125658 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125661 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125664 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125666 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125669 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125671 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 14:11:30.128309 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125674 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125676 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125679 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125684 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125688 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125691 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125694 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125697 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125699 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125702 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125705 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125708 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125710 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125713 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125716 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125719 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125721 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125725 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125728 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 14:11:30.128786 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125730 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125733 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125735 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125738 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125740 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125743 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125746 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125749 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.125751 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126107 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126111 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126114 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126117 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126120 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126123 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126126 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126130 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126132 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126135 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 14:11:30.129264 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126137 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126140 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126142 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126145 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126148 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126150 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126153 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126156 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126161 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126163 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126166 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126168 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126171 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126173 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126176 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126178 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126181 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126183 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126186 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126188 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 14:11:30.129717 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126191 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126193 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126196 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126198 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126201 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126204 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126206 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126209 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126212 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126216 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126219 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126221 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126224 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126227 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126229 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126232 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126234 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126237 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126239 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126242 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126246 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 14:11:30.130247 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126249 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126252 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126255 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126257 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126259 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126262 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126264 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126267 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126269 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126272 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126274 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126277 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126280 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126282 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126285 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126288 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126290 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126293 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126295 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126298 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 14:11:30.130768 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126304 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126307 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126310 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126312 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126315 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126317 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126321 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126325 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126328 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126331 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126334 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126338 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126341 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126343 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126346 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126350 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126354 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126356 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 14:11:30.131262 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126359 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126362 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126364 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126367 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126370 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126372 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126375 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126377 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126380 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.126382 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126447 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126458 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126464 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126469 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126474 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126477 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126481 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126485 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126488 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126491 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126494 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126497 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 03 14:11:30.131679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126500 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126503 2574 flags.go:64] FLAG: --cgroup-root="" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126506 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126510 2574 flags.go:64] FLAG: --client-ca-file="" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126514 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126517 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126520 2574 flags.go:64] FLAG: --cluster-domain="" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126523 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126526 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126529 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126532 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126536 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126538 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126541 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126544 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126547 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126550 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126553 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126557 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126560 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126563 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126566 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126569 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126572 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126576 2574 flags.go:64] FLAG: --enable-server="true" Jul 03 14:11:30.132232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126578 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126583 2574 flags.go:64] FLAG: --event-burst="100" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126586 2574 flags.go:64] FLAG: --event-qps="50" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126588 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126591 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126594 2574 flags.go:64] FLAG: --eviction-hard="" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126597 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126600 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126603 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126605 2574 flags.go:64] FLAG: --eviction-soft="" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126610 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126612 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126615 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126618 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126621 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126624 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126626 2574 flags.go:64] FLAG: --feature-gates="" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126630 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126633 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126635 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126638 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126641 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126644 2574 flags.go:64] FLAG: --help="false" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126647 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126650 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 03 14:11:30.132844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126652 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126658 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126661 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126664 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126667 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126670 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126673 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126676 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126679 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126682 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126685 2574 flags.go:64] FLAG: --kube-reserved="" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126687 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126690 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126693 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126696 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126698 2574 flags.go:64] FLAG: --lock-file="" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126701 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126705 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126708 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126713 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126716 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126719 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126721 2574 flags.go:64] FLAG: --logging-format="text" Jul 03 14:11:30.133676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126724 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126727 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126730 2574 flags.go:64] FLAG: --manifest-url="" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126733 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126736 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126739 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126743 2574 flags.go:64] FLAG: --max-pods="110" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126746 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126748 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126751 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126754 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126757 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126760 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126763 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126769 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126773 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126776 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126779 2574 flags.go:64] FLAG: --pod-cidr="" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126781 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126786 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126789 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126824 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126829 2574 flags.go:64] FLAG: --port="10250" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126833 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 03 14:11:30.134425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126836 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-066446441cd6d4e1b" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126839 2574 flags.go:64] FLAG: --qos-reserved="" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126843 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126846 2574 flags.go:64] FLAG: --register-node="true" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126849 2574 flags.go:64] FLAG: --register-with-taints="" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126852 2574 flags.go:64] FLAG: --registry-burst="10" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126855 2574 flags.go:64] FLAG: --registry-qps="5" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126857 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126860 2574 flags.go:64] FLAG: --reserved-memory="" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126866 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126869 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126872 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126874 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126877 2574 flags.go:64] FLAG: --runonce="false" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126880 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126883 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126885 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126892 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126895 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126898 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126901 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126904 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126907 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126910 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126913 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126916 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 03 14:11:30.135045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126930 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126934 2574 flags.go:64] FLAG: --system-cgroups="" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126937 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126942 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126945 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126948 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126952 2574 flags.go:64] FLAG: --tls-min-version="" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126955 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126958 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126961 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126964 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126967 2574 flags.go:64] FLAG: --v="2" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126970 2574 flags.go:64] FLAG: --version="false" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126974 2574 flags.go:64] FLAG: --vmodule="" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126977 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.126980 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127087 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127091 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127094 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127098 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127100 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127103 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127106 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 14:11:30.135661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127109 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127111 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127114 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127116 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127121 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127124 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127127 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127130 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127133 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127136 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127139 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127142 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127145 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127147 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127150 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127152 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127155 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127159 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127161 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127163 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 14:11:30.136228 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127166 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127169 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127171 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127174 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127176 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127179 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127181 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127184 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127186 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127189 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127192 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127194 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127196 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127199 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127201 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127204 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127207 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127210 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127212 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127215 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 14:11:30.136715 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127217 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127220 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127223 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127225 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127228 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127230 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127232 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127235 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127237 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127241 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127244 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127246 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127248 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127251 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127253 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127256 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127260 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127263 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127266 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 14:11:30.137239 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127268 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127271 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127273 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127276 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127278 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127281 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127283 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127286 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127288 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127291 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127293 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127297 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127299 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127302 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127304 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127307 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127309 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127311 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127314 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127316 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 14:11:30.137719 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127319 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127322 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127326 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127330 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127333 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127336 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127339 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127342 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127344 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127347 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127349 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127351 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.127354 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.127359 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 14:11:30.138211 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.135228 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.135243 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.135262 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.135267 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135333 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135338 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135341 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135344 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135347 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135349 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135353 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135355 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135358 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135361 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135364 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135367 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135370 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135372 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135375 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135377 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 14:11:30.138547 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135380 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135382 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135387 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135408 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135412 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135415 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135418 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135421 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135424 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135428 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135431 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135434 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135437 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135442 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135444 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135447 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135450 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135453 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135455 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135458 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 14:11:30.139103 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135460 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135463 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135465 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135468 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135470 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135473 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135476 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135478 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135481 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135483 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135485 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135488 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135491 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135493 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135496 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135498 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135500 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135503 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135505 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135508 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 14:11:30.139587 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135512 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135515 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135518 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135520 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135523 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135526 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135529 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135531 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135534 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135536 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135539 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135541 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135544 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135546 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135549 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135551 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135553 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135556 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135558 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 14:11:30.140076 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135561 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135563 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135566 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135568 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135571 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135574 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135576 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135579 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135581 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135584 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135586 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135589 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135591 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135593 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135596 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135599 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135601 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135603 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135606 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 14:11:30.140618 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135608 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135611 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135613 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135616 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135618 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.135623 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135736 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135741 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135744 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135747 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135750 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135752 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135755 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135757 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 14:11:30.141092 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135760 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135762 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135764 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135767 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135770 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135772 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135775 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135777 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135780 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135782 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135785 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135787 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135790 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135792 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135795 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135809 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135812 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135814 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135817 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135819 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 14:11:30.141446 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135822 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135825 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135827 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135830 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135832 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135835 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135838 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135840 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135843 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135847 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135850 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135853 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135856 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135859 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135862 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135865 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135868 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135871 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135874 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 14:11:30.141940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135876 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135880 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135884 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135887 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135890 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135893 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135895 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135898 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135901 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135903 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135906 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135909 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135911 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135913 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135916 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135918 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135921 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135923 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135926 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 14:11:30.142385 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135928 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135931 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135933 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135936 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135939 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135942 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135945 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135948 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135951 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135954 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135956 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135959 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135963 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135965 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135968 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135970 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135972 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135975 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135977 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135980 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 14:11:30.142915 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135982 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135984 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135987 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135989 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135992 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135995 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.135997 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.136000 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.136002 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.136004 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.136007 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.136009 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:30.136012 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.136017 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.136109 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 03 14:11:30.143398 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.138883 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 03 14:11:30.143768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.140327 2574 server.go:1019] "Starting client certificate rotation" Jul 03 14:11:30.143768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.140421 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 14:11:30.143768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.140457 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 14:11:30.143768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.142943 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 14:11:30.144045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.144032 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 14:11:30.155136 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.155118 2574 log.go:25] "Validated CRI v1 runtime API" Jul 03 14:11:30.158284 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.158269 2574 log.go:25] "Validated CRI v1 image API" Jul 03 14:11:30.159185 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.159169 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 03 14:11:30.161635 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.161617 2574 fs.go:135] Filesystem UUIDs: map[49cbb563-f14f-42cd-9e08-a3c3ab23ba77:/dev/nvme0n1p4 5c387c31-f222-4bfc-860a-8c506052ce5c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 03 14:11:30.161702 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.161635 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 03 14:11:30.167728 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.167617 2574 manager.go:216] Machine: {Timestamp:2026-07-03 14:11:30.167155632 +0000 UTC m=+0.280977198 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099674 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e38e648100a4a3f057dd1e8d026ea SystemUUID:ec2e38e6-4810-0a4a-3f05-7dd1e8d026ea BootID:d63ac35d-3dd2-44a0-95ed-12b8283ce7e8 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:dc:73:3c:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:dc:73:3c:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:c2:94:29:bf:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 03 14:11:30.167728 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.167715 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 03 14:11:30.167874 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.167780 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 03 14:11:30.170352 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.170329 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 03 14:11:30.170473 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.170355 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 03 14:11:30.171020 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.171011 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 03 14:11:30.171056 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.171023 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 03 14:11:30.171056 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.171030 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 14:11:30.171616 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.171606 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 14:11:30.172845 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.172834 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 03 14:11:30.175480 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.175466 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 14:11:30.176504 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.176494 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 03 14:11:30.176612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.176603 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 03 14:11:30.176640 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.176629 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 03 14:11:30.176672 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.176643 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 03 14:11:30.176672 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.176656 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 03 14:11:30.176672 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.176664 2574 kubelet.go:398] "Adding apiserver pod source" Jul 03 14:11:30.176672 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.176672 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 03 14:11:30.176995 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.176982 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 14:11:30.177043 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.177001 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 14:11:30.178862 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.178845 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 03 14:11:30.180744 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.180732 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 03 14:11:30.180791 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.180761 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 03 14:11:30.181834 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181823 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 03 14:11:30.181867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181839 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 03 14:11:30.181867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181845 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 03 14:11:30.181867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181851 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 03 14:11:30.181867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181859 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 03 14:11:30.181867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181864 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 03 14:11:30.182000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181872 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 03 14:11:30.182000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181876 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 03 14:11:30.182000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181883 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 03 14:11:30.182000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181888 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 03 14:11:30.182000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181904 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 03 14:11:30.182000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.181910 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 03 14:11:30.182553 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.182542 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 03 14:11:30.182553 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.182553 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 03 14:11:30.185825 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.185794 2574 server.go:1268] "Started kubelet" Jul 03 14:11:30.185935 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.185873 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 03 14:11:30.186031 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.185989 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 03 14:11:30.186081 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.186049 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 03 14:11:30.186730 ip-10-0-137-36 systemd[1]: Started Kubernetes Kubelet. Jul 03 14:11:30.187663 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.187462 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 03 14:11:30.187663 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.187466 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 03 14:11:30.187663 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.187571 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 03 14:11:30.187912 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.187730 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 03 14:11:30.189079 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.189061 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 03 14:11:30.191688 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.191663 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 03 14:11:30.194270 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.194251 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 03 14:11:30.194941 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.194917 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 03 14:11:30.195024 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.195010 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:30.195518 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.195502 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 03 14:11:30.195518 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.195518 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 03 14:11:30.195673 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.195573 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 03 14:11:30.195673 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.195634 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 03 14:11:30.195673 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.195640 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 03 14:11:30.195893 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.195879 2574 factory.go:55] Registering systemd factory Jul 03 14:11:30.195951 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.195896 2574 factory.go:223] Registration of the systemd container factory successfully Jul 03 14:11:30.196129 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.196109 2574 factory.go:153] Registering CRI-O factory Jul 03 14:11:30.196129 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.196130 2574 factory.go:223] Registration of the crio container factory successfully Jul 03 14:11:30.196235 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.196176 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 03 14:11:30.196235 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.196196 2574 factory.go:103] Registering Raw factory Jul 03 14:11:30.196235 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.196209 2574 manager.go:1196] Started watching for new ooms in manager Jul 03 14:11:30.196316 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.195352 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-36.ec2.internal.18beccfd29d2bd92 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-36.ec2.internal,UID:ip-10-0-137-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-36.ec2.internal,},FirstTimestamp:2026-07-03 14:11:30.185764242 +0000 UTC m=+0.299585810,LastTimestamp:2026-07-03 14:11:30.185764242 +0000 UTC m=+0.299585810,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-36.ec2.internal,}" Jul 03 14:11:30.196573 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.196559 2574 manager.go:349] Starting recovery of all containers Jul 03 14:11:30.199242 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.199211 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 03 14:11:30.199332 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.199263 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 03 14:11:30.206645 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.206410 2574 manager.go:354] Recovery completed Jul 03 14:11:30.210291 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.210277 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 14:11:30.211978 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.211961 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientMemory" Jul 03 14:11:30.212070 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.211990 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 14:11:30.212070 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.212002 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientPID" Jul 03 14:11:30.212467 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.212454 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 03 14:11:30.212526 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.212467 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 14:11:30.212526 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.212466 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 03 14:11:30.212608 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.212528 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 03 14:11:30.213174 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.213159 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientMemory" Jul 03 14:11:30.213215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.213189 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 14:11:30.213215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.213207 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientPID" Jul 03 14:11:30.214242 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.214187 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-36.ec2.internal.18beccfd2b62bd84 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-36.ec2.internal,UID:ip-10-0-137-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-36.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-36.ec2.internal,},FirstTimestamp:2026-07-03 14:11:30.211978628 +0000 UTC m=+0.325800192,LastTimestamp:2026-07-03 14:11:30.211978628 +0000 UTC m=+0.325800192,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-36.ec2.internal,}" Jul 03 14:11:30.214672 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.214661 2574 policy_none.go:49] "None policy: Start" Jul 03 14:11:30.214703 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.214677 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 03 14:11:30.214703 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.214686 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 03 14:11:30.216689 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.216678 2574 policy_none.go:47] "Start" Jul 03 14:11:30.222385 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.222368 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fgjcz" Jul 03 14:11:30.223281 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.223208 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-36.ec2.internal.18beccfd2b62fce7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-36.ec2.internal,UID:ip-10-0-137-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-36.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-36.ec2.internal,},FirstTimestamp:2026-07-03 14:11:30.211994855 +0000 UTC m=+0.325816420,LastTimestamp:2026-07-03 14:11:30.211994855 +0000 UTC m=+0.325816420,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-36.ec2.internal,}" Jul 03 14:11:30.231608 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.231586 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fgjcz" Jul 03 14:11:30.233235 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.232992 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-36.ec2.internal.18beccfd2b632f45 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-36.ec2.internal,UID:ip-10-0-137-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-36.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-36.ec2.internal,},FirstTimestamp:2026-07-03 14:11:30.212007749 +0000 UTC m=+0.325829315,LastTimestamp:2026-07-03 14:11:30.212007749 +0000 UTC m=+0.325829315,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-36.ec2.internal,}" Jul 03 14:11:30.264441 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.264325 2574 manager.go:337] "Starting Device Plugin manager" Jul 03 14:11:30.264526 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.264467 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 03 14:11:30.264526 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.264482 2574 server.go:87] "Starting device plugin registration server" Jul 03 14:11:30.264726 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.264713 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 03 14:11:30.264757 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.264731 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 03 14:11:30.264869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.264850 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 03 14:11:30.264966 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.264922 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 03 14:11:30.264966 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.264929 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 03 14:11:30.265395 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.265377 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 03 14:11:30.265472 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.265427 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:30.351810 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.351759 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 03 14:11:30.353976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.352926 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 03 14:11:30.353976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.352971 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 03 14:11:30.353976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.352996 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 03 14:11:30.353976 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.353037 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 03 14:11:30.355697 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.355679 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 14:11:30.364847 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.364823 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 14:11:30.365656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.365640 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientMemory" Jul 03 14:11:30.365718 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.365672 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 14:11:30.365718 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.365687 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientPID" Jul 03 14:11:30.365718 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.365716 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.376141 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.376090 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.376141 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.376115 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-36.ec2.internal\": node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:30.404265 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.404245 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:30.454949 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.454920 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal"] Jul 03 14:11:30.455068 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.455000 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 14:11:30.456815 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.456788 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientMemory" Jul 03 14:11:30.456890 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.456834 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 14:11:30.456890 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.456847 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientPID" Jul 03 14:11:30.459380 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.459367 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 14:11:30.459491 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.459478 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.459537 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.459507 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 14:11:30.460325 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.460305 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientMemory" Jul 03 14:11:30.460431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.460359 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 14:11:30.460431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.460373 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientPID" Jul 03 14:11:30.460431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.460308 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientMemory" Jul 03 14:11:30.460431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.460413 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 14:11:30.460431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.460424 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientPID" Jul 03 14:11:30.462871 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.462855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.462949 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.462903 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 14:11:30.463959 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.463944 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientMemory" Jul 03 14:11:30.464057 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.463970 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 14:11:30.464057 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.463981 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientPID" Jul 03 14:11:30.485553 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.485534 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-36.ec2.internal\" not found" node="ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.490153 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.490136 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-36.ec2.internal\" not found" node="ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.497519 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.497502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54fa776803453540ffaa234553755b21-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal\" (UID: \"54fa776803453540ffaa234553755b21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.497607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.497527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54fa776803453540ffaa234553755b21-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal\" (UID: \"54fa776803453540ffaa234553755b21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.497607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.497550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e954a9731eeec410262c7374d29cc9b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-36.ec2.internal\" (UID: \"6e954a9731eeec410262c7374d29cc9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.504701 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.504683 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:30.597852 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.597827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54fa776803453540ffaa234553755b21-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal\" (UID: \"54fa776803453540ffaa234553755b21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.597937 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.597885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54fa776803453540ffaa234553755b21-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal\" (UID: \"54fa776803453540ffaa234553755b21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.597937 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.597915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e954a9731eeec410262c7374d29cc9b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-36.ec2.internal\" (UID: \"6e954a9731eeec410262c7374d29cc9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.598010 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.597944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54fa776803453540ffaa234553755b21-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal\" (UID: \"54fa776803453540ffaa234553755b21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.598010 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.597952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e954a9731eeec410262c7374d29cc9b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-36.ec2.internal\" (UID: \"6e954a9731eeec410262c7374d29cc9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.598010 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.597984 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54fa776803453540ffaa234553755b21-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal\" (UID: \"54fa776803453540ffaa234553755b21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.605534 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.605514 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:30.705698 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.705650 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:30.788496 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.788464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.794174 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:30.793933 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" Jul 03 14:11:30.806470 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.806453 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:30.907245 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:30.907207 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.007879 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:31.007822 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.107998 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:31.107972 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.139241 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.139214 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 03 14:11:31.139621 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.139341 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 14:11:31.205590 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.205569 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 14:11:31.208636 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:31.208617 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.235216 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.235181 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 14:06:30 +0000 UTC" deadline="2028-03-22 09:19:34.501277828 +0000 UTC" Jul 03 14:11:31.235216 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.235209 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15067h8m3.266072334s" Jul 03 14:11:31.268771 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.268694 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 14:11:31.270279 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.270253 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientMemory" Jul 03 14:11:31.270380 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.270300 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 14:11:31.270380 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.270315 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeHasSufficientPID" Jul 03 14:11:31.309720 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:31.309688 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.377708 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:31.377673 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e954a9731eeec410262c7374d29cc9b.slice/crio-f6cc7aa811a87103e58af2fc900722cf8d99b7a15d4baa9182bc4a0bbc371d42 WatchSource:0}: Error finding container f6cc7aa811a87103e58af2fc900722cf8d99b7a15d4baa9182bc4a0bbc371d42: Status 404 returned error can't find the container with id f6cc7aa811a87103e58af2fc900722cf8d99b7a15d4baa9182bc4a0bbc371d42 Jul 03 14:11:31.383047 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.383029 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 14:11:31.390351 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:31.390325 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54fa776803453540ffaa234553755b21.slice/crio-6df97effd4b4f5aa574e74dc56ae4ea770c82bdb54a6cb9c80c1fc92fb5c708c WatchSource:0}: Error finding container 6df97effd4b4f5aa574e74dc56ae4ea770c82bdb54a6cb9c80c1fc92fb5c708c: Status 404 returned error can't find the container with id 6df97effd4b4f5aa574e74dc56ae4ea770c82bdb54a6cb9c80c1fc92fb5c708c Jul 03 14:11:31.410666 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:31.410623 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.511456 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:31.511420 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.611647 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:31.611580 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.690449 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.690418 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 14:11:31.711975 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:31.711952 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-36.ec2.internal\" not found" Jul 03 14:11:31.765602 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.765578 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 14:11:31.797025 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.796984 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" Jul 03 14:11:31.832213 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.832184 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 14:11:31.833128 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.833113 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" Jul 03 14:11:31.868240 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:31.868157 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 14:11:32.179383 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.178996 2574 apiserver.go:52] "Watching apiserver" Jul 03 14:11:32.185892 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.185699 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 14:11:32.188568 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.188054 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 03 14:11:32.189388 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.189347 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-hwb85","kube-system/global-pull-secret-syncer-ln6k5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj","openshift-dns/node-resolver-4xx8z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal","openshift-multus/multus-grv2q","openshift-multus/network-metrics-daemon-7hk5x","kube-system/konnectivity-agent-7dbgc","kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l2nb8","openshift-image-registry/node-ca-2hwlt","openshift-multus/multus-additional-cni-plugins-grvbm","openshift-network-diagnostics/network-check-target-qtwnz","openshift-network-operator/iptables-alerter-wfhxw"] Jul 03 14:11:32.193512 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.193476 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:32.195289 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.195253 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 03 14:11:32.195844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.195690 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.196536 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.196513 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 03 14:11:32.196865 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.196828 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 03 14:11:32.197016 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.196923 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4xjvt\"" Jul 03 14:11:32.198249 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.198088 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.198902 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.198856 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 03 14:11:32.199091 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.199074 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ngkqf\"" Jul 03 14:11:32.199171 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.199092 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 03 14:11:32.200415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.200105 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 03 14:11:32.201019 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.200709 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 03 14:11:32.201019 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.200725 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 03 14:11:32.201207 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.201114 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 03 14:11:32.201458 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.201383 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.201458 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.201430 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5qpf\"" Jul 03 14:11:32.204219 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.203568 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 03 14:11:32.204219 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.203580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.204219 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.204010 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lzg6r\"" Jul 03 14:11:32.204714 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.204581 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 03 14:11:32.206656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.206138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.208109 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-serviceca\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.208240 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b7bb7a5-3be2-4080-a698-eae0a9729fb4-agent-certs\") pod \"konnectivity-agent-7dbgc\" (UID: \"7b7bb7a5-3be2-4080-a698-eae0a9729fb4\") " pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:32.208240 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-host\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.208240 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrf8\" (UniqueName: \"kubernetes.io/projected/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-kube-api-access-vcrf8\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.208240 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208223 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b7bb7a5-3be2-4080-a698-eae0a9729fb4-konnectivity-ca\") pod \"konnectivity-agent-7dbgc\" (UID: \"7b7bb7a5-3be2-4080-a698-eae0a9729fb4\") " pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:32.208460 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-iptables-alerter-script\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.208460 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-host-slash\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.208460 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208305 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqkfb\" (UniqueName: \"kubernetes.io/projected/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-kube-api-access-gqkfb\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.208841 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.208801 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:32.208953 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.208921 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:32.211709 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.211688 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.213520 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.213106 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 03 14:11:32.213520 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.213318 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 03 14:11:32.213952 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.213673 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 03 14:11:32.214038 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.214004 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 03 14:11:32.214095 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.214055 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 03 14:11:32.214740 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.214261 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 03 14:11:32.214740 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.214496 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vlvrd\"" Jul 03 14:11:32.214740 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.214657 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zw47q\"" Jul 03 14:11:32.214740 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.214742 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.215694 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.215122 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 03 14:11:32.215694 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.215249 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 03 14:11:32.215694 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.215372 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 03 14:11:32.215694 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.215471 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vn8dl\"" Jul 03 14:11:32.215694 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.215125 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 03 14:11:32.216056 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.215746 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 03 14:11:32.216056 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.215847 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 03 14:11:32.216963 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.216902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.218739 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.218236 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-49vwk\"" Jul 03 14:11:32.218739 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.218548 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 03 14:11:32.218739 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.218586 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 03 14:11:32.219245 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.219085 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 03 14:11:32.219655 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.219522 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:32.219655 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.219613 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:32.220444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.220216 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 03 14:11:32.220444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.220245 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fqws6\"" Jul 03 14:11:32.220602 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.220429 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 03 14:11:32.222199 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.222130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.222296 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.222204 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:32.222703 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.222680 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 14:11:32.250976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.250948 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-px9k2" Jul 03 14:11:32.266553 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.266519 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-px9k2" Jul 03 14:11:32.297248 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.297212 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 03 14:11:32.309443 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9qfr\" (UniqueName: \"kubernetes.io/projected/6489d734-92c8-46a1-a4cb-c7544e4cde59-kube-api-access-l9qfr\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:32.309624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.309624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-kubernetes\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.309624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-ovn\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.309624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqkfb\" (UniqueName: \"kubernetes.io/projected/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-kube-api-access-gqkfb\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.309624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-run\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.309624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-cni-bin\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.309624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309615 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b7bb7a5-3be2-4080-a698-eae0a9729fb4-agent-certs\") pod \"konnectivity-agent-7dbgc\" (UID: \"7b7bb7a5-3be2-4080-a698-eae0a9729fb4\") " pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-host\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-sys\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309692 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-cni-multus\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-daemon-config\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de48f353-bb1c-48c9-88f0-f4f64832f522-tmp\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lmhf\" (UniqueName: \"kubernetes.io/projected/291e999c-6c5c-49d6-9596-f4e025a7fd7a-kube-api-access-6lmhf\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-os-release\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-sys-fs\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309905 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-tuned\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309931 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-kubelet\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.310045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.309962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-iptables-alerter-script\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310060 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-host\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310079 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-registration-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-device-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-host\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkqb7\" (UniqueName: \"kubernetes.io/projected/de48f353-bb1c-48c9-88f0-f4f64832f522-kube-api-access-hkqb7\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-cni-bin\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-systemd\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-cni-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-hostroot\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-multus-certs\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-systemd-units\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-slash\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b7bb7a5-3be2-4080-a698-eae0a9729fb4-konnectivity-ca\") pod \"konnectivity-agent-7dbgc\" (UID: \"7b7bb7a5-3be2-4080-a698-eae0a9729fb4\") " pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:32.310638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b1febaf-1350-48a6-b149-00f607eaaf3b-kubelet-config\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-iptables-alerter-script\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-var-lib-kubelet\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-cnibin\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl49z\" (UniqueName: \"kubernetes.io/projected/2c2d956b-66dc-4751-8a97-69fedf0f5c14-kube-api-access-vl49z\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b1febaf-1350-48a6-b149-00f607eaaf3b-dbus\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysconfig\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-netns\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-kubelet\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-etc-kubernetes\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-cni-netd\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-env-overrides\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.310968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-serviceca\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-var-lib-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-etc-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-cni-binary-copy\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.311490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311168 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7b7bb7a5-3be2-4080-a698-eae0a9729fb4-konnectivity-ca\") pod \"konnectivity-agent-7dbgc\" (UID: \"7b7bb7a5-3be2-4080-a698-eae0a9729fb4\") " pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrf8\" (UniqueName: \"kubernetes.io/projected/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-kube-api-access-vcrf8\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-system-cni-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291e999c-6c5c-49d6-9596-f4e025a7fd7a-cni-binary-copy\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-ovnkube-config\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a265c5d5-cb5f-4251-835d-5404f228337f-ovn-node-metrics-cert\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nzvg\" (UniqueName: \"kubernetes.io/projected/a265c5d5-cb5f-4251-835d-5404f228337f-kube-api-access-9nzvg\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-serviceca\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-cnibin\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-socket-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysctl-d\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-log-socket\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311612 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kntf4\" (UniqueName: \"kubernetes.io/projected/a81641e6-5300-4ceb-8951-36eb3750748e-kube-api-access-kntf4\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.312459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-modprobe-d\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-socket-dir-parent\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-conf-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-run-netns\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-host-slash\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysctl-conf\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311918 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-lib-modules\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-k8s-cni-cncf-io\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311966 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-node-log\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.311992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-ovnkube-script-lib\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312071 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-host-slash\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-system-cni-dir\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-systemd\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.313098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-os-release\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.313762 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88q8l\" (UniqueName: \"kubernetes.io/projected/392a12d3-84f1-42e1-b217-956ab85b6224-kube-api-access-88q8l\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.313762 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c2d956b-66dc-4751-8a97-69fedf0f5c14-hosts-file\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.313762 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.312298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c2d956b-66dc-4751-8a97-69fedf0f5c14-tmp-dir\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.314827 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.314785 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7b7bb7a5-3be2-4080-a698-eae0a9729fb4-agent-certs\") pod \"konnectivity-agent-7dbgc\" (UID: \"7b7bb7a5-3be2-4080-a698-eae0a9729fb4\") " pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:32.319891 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.319854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqkfb\" (UniqueName: \"kubernetes.io/projected/6c4f5574-c0c0-44d9-ba10-79a7f4284d5f-kube-api-access-gqkfb\") pod \"iptables-alerter-wfhxw\" (UID: \"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f\") " pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.321185 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.321161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrf8\" (UniqueName: \"kubernetes.io/projected/b9645511-9ec8-42ad-85fb-d42ec2ba9df1-kube-api-access-vcrf8\") pod \"node-ca-2hwlt\" (UID: \"b9645511-9ec8-42ad-85fb-d42ec2ba9df1\") " pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.357944 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.357785 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" event={"ID":"54fa776803453540ffaa234553755b21","Type":"ContainerStarted","Data":"6df97effd4b4f5aa574e74dc56ae4ea770c82bdb54a6cb9c80c1fc92fb5c708c"} Jul 03 14:11:32.359045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.359012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" event={"ID":"6e954a9731eeec410262c7374d29cc9b","Type":"ContainerStarted","Data":"f6cc7aa811a87103e58af2fc900722cf8d99b7a15d4baa9182bc4a0bbc371d42"} Jul 03 14:11:32.413397 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9qfr\" (UniqueName: \"kubernetes.io/projected/6489d734-92c8-46a1-a4cb-c7544e4cde59-kube-api-access-l9qfr\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:32.413397 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.413623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-kubernetes\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.413623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413467 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-kubernetes\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.413623 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.413502 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:32.413623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-ovn\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.413623 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.413586 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret podName:6b1febaf-1350-48a6-b149-00f607eaaf3b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:32.913549916 +0000 UTC m=+3.027371469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret") pod "global-pull-secret-syncer-ln6k5" (UID: "6b1febaf-1350-48a6-b149-00f607eaaf3b") : object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:32.413623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-ovn\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.413623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-run\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.413623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-cni-bin\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-sys\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-cni-multus\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413687 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-daemon-config\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-cni-bin\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-sys\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-cni-multus\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de48f353-bb1c-48c9-88f0-f4f64832f522-tmp\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lmhf\" (UniqueName: \"kubernetes.io/projected/291e999c-6c5c-49d6-9596-f4e025a7fd7a-kube-api-access-6lmhf\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-os-release\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-run\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-sys-fs\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413929 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-tuned\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-kubelet\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413967 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-os-release\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-registration-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.414048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.413999 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-device-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-host\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkqb7\" (UniqueName: \"kubernetes.io/projected/de48f353-bb1c-48c9-88f0-f4f64832f522-kube-api-access-hkqb7\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-cni-bin\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-systemd\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-cni-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-sys-fs\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414154 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-hostroot\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414203 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-hostroot\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-multus-certs\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-systemd-units\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414244 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-multus-certs\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-slash\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-kubelet\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b1febaf-1350-48a6-b149-00f607eaaf3b-kubelet-config\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414365 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-daemon-config\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.414910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-var-lib-kubelet\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414416 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-cni-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-cnibin\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl49z\" (UniqueName: \"kubernetes.io/projected/2c2d956b-66dc-4751-8a97-69fedf0f5c14-kube-api-access-vl49z\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-slash\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414479 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b1febaf-1350-48a6-b149-00f607eaaf3b-kubelet-config\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-registration-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-var-lib-kubelet\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-systemd-units\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-cnibin\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b1febaf-1350-48a6-b149-00f607eaaf3b-dbus\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-host\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-systemd\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysconfig\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.415822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414674 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-device-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-cni-bin\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414720 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysconfig\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-netns\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b1febaf-1350-48a6-b149-00f607eaaf3b-dbus\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414776 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-netns\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414778 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-kubelet\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414822 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-var-lib-kubelet\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414888 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-etc-kubernetes\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414936 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-etc-kubernetes\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.414971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-cni-netd\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-env-overrides\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415030 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-var-lib-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-cni-netd\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-etc-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-cni-binary-copy\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415094 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-var-lib-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-system-cni-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.416899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415137 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-etc-openvswitch\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291e999c-6c5c-49d6-9596-f4e025a7fd7a-cni-binary-copy\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-ovnkube-config\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415196 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a265c5d5-cb5f-4251-835d-5404f228337f-ovn-node-metrics-cert\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nzvg\" (UniqueName: \"kubernetes.io/projected/a265c5d5-cb5f-4251-835d-5404f228337f-kube-api-access-9nzvg\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-cnibin\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-socket-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysctl-d\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-log-socket\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415452 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kntf4\" (UniqueName: \"kubernetes.io/projected/a81641e6-5300-4ceb-8951-36eb3750748e-kube-api-access-kntf4\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-modprobe-d\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415505 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-env-overrides\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-cni-binary-copy\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415638 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-socket-dir-parent\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.417607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415710 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-socket-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-socket-dir-parent\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysctl-d\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-conf-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-run-netns\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415777 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-log-socket\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-multus-conf-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415830 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-run-netns\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-modprobe-d\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415967 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a81641e6-5300-4ceb-8951-36eb3750748e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysctl-conf\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.415997 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/392a12d3-84f1-42e1-b217-956ab85b6224-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-lib-modules\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-k8s-cni-cncf-io\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.418315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416073 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-system-cni-dir\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-node-log\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-ovnkube-script-lib\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-system-cni-dir\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-systemd\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-os-release\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88q8l\" (UniqueName: \"kubernetes.io/projected/392a12d3-84f1-42e1-b217-956ab85b6224-kube-api-access-88q8l\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c2d956b-66dc-4751-8a97-69fedf0f5c14-hosts-file\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c2d956b-66dc-4751-8a97-69fedf0f5c14-tmp-dir\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291e999c-6c5c-49d6-9596-f4e025a7fd7a-cni-binary-copy\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416650 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-sysctl-conf\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c2d956b-66dc-4751-8a97-69fedf0f5c14-tmp-dir\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-system-cni-dir\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416794 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de48f353-bb1c-48c9-88f0-f4f64832f522-lib-modules\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-host-run-k8s-cni-cncf-io\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.418869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416849 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-node-log\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416852 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/392a12d3-84f1-42e1-b217-956ab85b6224-cnibin\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416923 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-ovnkube-config\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291e999c-6c5c-49d6-9596-f4e025a7fd7a-os-release\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a265c5d5-cb5f-4251-835d-5404f228337f-run-systemd\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416944 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de48f353-bb1c-48c9-88f0-f4f64832f522-etc-tuned\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.416938 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c2d956b-66dc-4751-8a97-69fedf0f5c14-hosts-file\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.417001 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.417055 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs podName:6489d734-92c8-46a1-a4cb-c7544e4cde59 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:32.917035937 +0000 UTC m=+3.030857501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs") pod "network-metrics-daemon-7hk5x" (UID: "6489d734-92c8-46a1-a4cb-c7544e4cde59") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.417182 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de48f353-bb1c-48c9-88f0-f4f64832f522-tmp\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.417351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a265c5d5-cb5f-4251-835d-5404f228337f-ovnkube-script-lib\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.419432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.418433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a265c5d5-cb5f-4251-835d-5404f228337f-ovn-node-metrics-cert\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.429550 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.429491 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 14:11:32.429550 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.429523 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 14:11:32.429550 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.429538 2574 projected.go:196] Error preparing data for projected volume kube-api-access-th4tl for pod openshift-network-diagnostics/network-check-target-qtwnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:32.429723 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.429602 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl podName:2e407c4f-72f7-4527-a6d7-3860240b9f36 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:32.929583722 +0000 UTC m=+3.043405292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-th4tl" (UniqueName: "kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl") pod "network-check-target-qtwnz" (UID: "2e407c4f-72f7-4527-a6d7-3860240b9f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:32.431324 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.431265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9qfr\" (UniqueName: \"kubernetes.io/projected/6489d734-92c8-46a1-a4cb-c7544e4cde59-kube-api-access-l9qfr\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:32.431984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.431950 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkqb7\" (UniqueName: \"kubernetes.io/projected/de48f353-bb1c-48c9-88f0-f4f64832f522-kube-api-access-hkqb7\") pod \"tuned-l2nb8\" (UID: \"de48f353-bb1c-48c9-88f0-f4f64832f522\") " pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.433656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.433605 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl49z\" (UniqueName: \"kubernetes.io/projected/2c2d956b-66dc-4751-8a97-69fedf0f5c14-kube-api-access-vl49z\") pod \"node-resolver-4xx8z\" (UID: \"2c2d956b-66dc-4751-8a97-69fedf0f5c14\") " pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.435367 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.435348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kntf4\" (UniqueName: \"kubernetes.io/projected/a81641e6-5300-4ceb-8951-36eb3750748e-kube-api-access-kntf4\") pod \"aws-ebs-csi-driver-node-ljxnj\" (UID: \"a81641e6-5300-4ceb-8951-36eb3750748e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.436149 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.436132 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nzvg\" (UniqueName: \"kubernetes.io/projected/a265c5d5-cb5f-4251-835d-5404f228337f-kube-api-access-9nzvg\") pod \"ovnkube-node-hwb85\" (UID: \"a265c5d5-cb5f-4251-835d-5404f228337f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.436519 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.436493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lmhf\" (UniqueName: \"kubernetes.io/projected/291e999c-6c5c-49d6-9596-f4e025a7fd7a-kube-api-access-6lmhf\") pod \"multus-grv2q\" (UID: \"291e999c-6c5c-49d6-9596-f4e025a7fd7a\") " pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.437116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.437089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88q8l\" (UniqueName: \"kubernetes.io/projected/392a12d3-84f1-42e1-b217-956ab85b6224-kube-api-access-88q8l\") pod \"multus-additional-cni-plugins-grvbm\" (UID: \"392a12d3-84f1-42e1-b217-956ab85b6224\") " pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.509855 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.509814 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:32.526332 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.526312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wfhxw" Jul 03 14:11:32.537208 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.537188 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2hwlt" Jul 03 14:11:32.544667 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.544639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" Jul 03 14:11:32.553186 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.553168 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4xx8z" Jul 03 14:11:32.561996 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.561976 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-grv2q" Jul 03 14:11:32.574904 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.574882 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:32.582645 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.582626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" Jul 03 14:11:32.589407 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.589390 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grvbm" Jul 03 14:11:32.919748 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.919668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:32.919748 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:32.919705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:32.919993 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.919835 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:32.919993 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.919849 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:32.919993 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.919916 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs podName:6489d734-92c8-46a1-a4cb-c7544e4cde59 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:33.919895449 +0000 UTC m=+4.033717007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs") pod "network-metrics-daemon-7hk5x" (UID: "6489d734-92c8-46a1-a4cb-c7544e4cde59") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:32.919993 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:32.919938 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret podName:6b1febaf-1350-48a6-b149-00f607eaaf3b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:33.919928347 +0000 UTC m=+4.033749900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret") pod "global-pull-secret-syncer-ln6k5" (UID: "6b1febaf-1350-48a6-b149-00f607eaaf3b") : object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:33.020867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:33.020809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:33.021040 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.020993 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 14:11:33.021040 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.021009 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 14:11:33.021040 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.021020 2574 projected.go:196] Error preparing data for projected volume kube-api-access-th4tl for pod openshift-network-diagnostics/network-check-target-qtwnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:33.021170 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.021080 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl podName:2e407c4f-72f7-4527-a6d7-3860240b9f36 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:34.021061897 +0000 UTC m=+4.134883451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-th4tl" (UniqueName: "kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl") pod "network-check-target-qtwnz" (UID: "2e407c4f-72f7-4527-a6d7-3860240b9f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:33.270213 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:33.270134 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 14:06:32 +0000 UTC" deadline="2027-12-11 18:38:37.492442369 +0000 UTC" Jul 03 14:11:33.270213 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:33.270165 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12628h27m4.222282094s" Jul 03 14:11:33.354079 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:33.354049 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:33.354252 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.354186 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:33.513208 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.513161 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291e999c_6c5c_49d6_9596_f4e025a7fd7a.slice/crio-a022e2f82f6b46cef06d36bbf5d3e31241346bcb1c7cc0f51ead6e87128ee8b8 WatchSource:0}: Error finding container a022e2f82f6b46cef06d36bbf5d3e31241346bcb1c7cc0f51ead6e87128ee8b8: Status 404 returned error can't find the container with id a022e2f82f6b46cef06d36bbf5d3e31241346bcb1c7cc0f51ead6e87128ee8b8 Jul 03 14:11:33.515217 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.515187 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde48f353_bb1c_48c9_88f0_f4f64832f522.slice/crio-22b2aa2cbaa66a0c6cefa06daa3019594eb755feb8bc0b40dac85e5b3597c76c WatchSource:0}: Error finding container 22b2aa2cbaa66a0c6cefa06daa3019594eb755feb8bc0b40dac85e5b3597c76c: Status 404 returned error can't find the container with id 22b2aa2cbaa66a0c6cefa06daa3019594eb755feb8bc0b40dac85e5b3597c76c Jul 03 14:11:33.518465 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.518415 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392a12d3_84f1_42e1_b217_956ab85b6224.slice/crio-50ec41fa6d27e33e76eb13dab095dea79ac4b90ab98659d1fb282125696c0f84 WatchSource:0}: Error finding container 50ec41fa6d27e33e76eb13dab095dea79ac4b90ab98659d1fb282125696c0f84: Status 404 returned error can't find the container with id 50ec41fa6d27e33e76eb13dab095dea79ac4b90ab98659d1fb282125696c0f84 Jul 03 14:11:33.519231 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.519203 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7bb7a5_3be2_4080_a698_eae0a9729fb4.slice/crio-970b2e778e992e7d827ca1465922b3b0e2c9ffff04ed10e7cbc335dad934bcc7 WatchSource:0}: Error finding container 970b2e778e992e7d827ca1465922b3b0e2c9ffff04ed10e7cbc335dad934bcc7: Status 404 returned error can't find the container with id 970b2e778e992e7d827ca1465922b3b0e2c9ffff04ed10e7cbc335dad934bcc7 Jul 03 14:11:33.520382 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.520310 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda265c5d5_cb5f_4251_835d_5404f228337f.slice/crio-6caf5e91b1c28f3b5bf0527d74f113de5c412d30ffd8ef5e6b76d5ec5802fb49 WatchSource:0}: Error finding container 6caf5e91b1c28f3b5bf0527d74f113de5c412d30ffd8ef5e6b76d5ec5802fb49: Status 404 returned error can't find the container with id 6caf5e91b1c28f3b5bf0527d74f113de5c412d30ffd8ef5e6b76d5ec5802fb49 Jul 03 14:11:33.522051 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.522009 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4f5574_c0c0_44d9_ba10_79a7f4284d5f.slice/crio-98ea1b33f20c3d7dbc60038ecd76f1a76269d2c46fcc9dd0245ce370d4a3b22d WatchSource:0}: Error finding container 98ea1b33f20c3d7dbc60038ecd76f1a76269d2c46fcc9dd0245ce370d4a3b22d: Status 404 returned error can't find the container with id 98ea1b33f20c3d7dbc60038ecd76f1a76269d2c46fcc9dd0245ce370d4a3b22d Jul 03 14:11:33.523800 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.523409 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9645511_9ec8_42ad_85fb_d42ec2ba9df1.slice/crio-b0207547e4854743ce0cc1a88dae08ba394750fb8a3ce16f0fe4e037a7a01eb7 WatchSource:0}: Error finding container b0207547e4854743ce0cc1a88dae08ba394750fb8a3ce16f0fe4e037a7a01eb7: Status 404 returned error can't find the container with id b0207547e4854743ce0cc1a88dae08ba394750fb8a3ce16f0fe4e037a7a01eb7 Jul 03 14:11:33.526802 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.526413 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81641e6_5300_4ceb_8951_36eb3750748e.slice/crio-9c6a6555672fda4075e5bc0447e58f0df26799ad4b55e2534a1edf7a6bb26ef2 WatchSource:0}: Error finding container 9c6a6555672fda4075e5bc0447e58f0df26799ad4b55e2534a1edf7a6bb26ef2: Status 404 returned error can't find the container with id 9c6a6555672fda4075e5bc0447e58f0df26799ad4b55e2534a1edf7a6bb26ef2 Jul 03 14:11:33.528711 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:11:33.528276 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2d956b_66dc_4751_8a97_69fedf0f5c14.slice/crio-9698824c6f71389992213669bbc439ec8e26ba0accc53897ea811de496a98d38 WatchSource:0}: Error finding container 9698824c6f71389992213669bbc439ec8e26ba0accc53897ea811de496a98d38: Status 404 returned error can't find the container with id 9698824c6f71389992213669bbc439ec8e26ba0accc53897ea811de496a98d38 Jul 03 14:11:33.929582 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:33.929377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:33.929729 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:33.929598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:33.929729 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.929543 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:33.929729 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.929709 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs podName:6489d734-92c8-46a1-a4cb-c7544e4cde59 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:35.929693032 +0000 UTC m=+6.043514585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs") pod "network-metrics-daemon-7hk5x" (UID: "6489d734-92c8-46a1-a4cb-c7544e4cde59") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:33.929884 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.929729 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:33.929884 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:33.929776 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret podName:6b1febaf-1350-48a6-b149-00f607eaaf3b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:35.929760848 +0000 UTC m=+6.043582423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret") pod "global-pull-secret-syncer-ln6k5" (UID: "6b1febaf-1350-48a6-b149-00f607eaaf3b") : object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:34.030478 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.030359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:34.030610 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:34.030497 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 14:11:34.030610 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:34.030517 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 14:11:34.030610 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:34.030526 2574 projected.go:196] Error preparing data for projected volume kube-api-access-th4tl for pod openshift-network-diagnostics/network-check-target-qtwnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:34.030610 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:34.030580 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl podName:2e407c4f-72f7-4527-a6d7-3860240b9f36 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:36.030563999 +0000 UTC m=+6.144385574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-th4tl" (UniqueName: "kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl") pod "network-check-target-qtwnz" (UID: "2e407c4f-72f7-4527-a6d7-3860240b9f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:34.270745 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.270684 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 14:06:32 +0000 UTC" deadline="2028-01-17 04:38:07.549807165 +0000 UTC" Jul 03 14:11:34.270745 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.270721 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13502h26m33.279091474s" Jul 03 14:11:34.356715 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.356629 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:34.356910 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:34.356778 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:34.357227 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.357178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:34.357329 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:34.357273 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:34.384520 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.384482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" event={"ID":"6e954a9731eeec410262c7374d29cc9b","Type":"ContainerStarted","Data":"a21d57623baa5fdb25ae141679742281ae50106bf6fe167b444757d5f5ef2a03"} Jul 03 14:11:34.393655 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.393603 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2hwlt" event={"ID":"b9645511-9ec8-42ad-85fb-d42ec2ba9df1","Type":"ContainerStarted","Data":"b0207547e4854743ce0cc1a88dae08ba394750fb8a3ce16f0fe4e037a7a01eb7"} Jul 03 14:11:34.398595 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.398532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wfhxw" event={"ID":"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f","Type":"ContainerStarted","Data":"98ea1b33f20c3d7dbc60038ecd76f1a76269d2c46fcc9dd0245ce370d4a3b22d"} Jul 03 14:11:34.401462 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.401434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"6caf5e91b1c28f3b5bf0527d74f113de5c412d30ffd8ef5e6b76d5ec5802fb49"} Jul 03 14:11:34.406116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.405450 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-36.ec2.internal" podStartSLOduration=2.405433059 podStartE2EDuration="2.405433059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:34.40523879 +0000 UTC m=+4.519060392" watchObservedRunningTime="2026-07-03 14:11:34.405433059 +0000 UTC m=+4.519254636" Jul 03 14:11:34.409912 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.409704 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-grv2q" event={"ID":"291e999c-6c5c-49d6-9596-f4e025a7fd7a","Type":"ContainerStarted","Data":"a022e2f82f6b46cef06d36bbf5d3e31241346bcb1c7cc0f51ead6e87128ee8b8"} Jul 03 14:11:34.411893 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.411831 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4xx8z" event={"ID":"2c2d956b-66dc-4751-8a97-69fedf0f5c14","Type":"ContainerStarted","Data":"9698824c6f71389992213669bbc439ec8e26ba0accc53897ea811de496a98d38"} Jul 03 14:11:34.418143 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.418118 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" event={"ID":"a81641e6-5300-4ceb-8951-36eb3750748e","Type":"ContainerStarted","Data":"9c6a6555672fda4075e5bc0447e58f0df26799ad4b55e2534a1edf7a6bb26ef2"} Jul 03 14:11:34.454029 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.453998 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7dbgc" event={"ID":"7b7bb7a5-3be2-4080-a698-eae0a9729fb4","Type":"ContainerStarted","Data":"970b2e778e992e7d827ca1465922b3b0e2c9ffff04ed10e7cbc335dad934bcc7"} Jul 03 14:11:34.459991 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.459956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerStarted","Data":"50ec41fa6d27e33e76eb13dab095dea79ac4b90ab98659d1fb282125696c0f84"} Jul 03 14:11:34.472080 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.471997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" event={"ID":"de48f353-bb1c-48c9-88f0-f4f64832f522","Type":"ContainerStarted","Data":"22b2aa2cbaa66a0c6cefa06daa3019594eb755feb8bc0b40dac85e5b3597c76c"} Jul 03 14:11:34.494175 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.494140 2574 generic.go:356] "Generic (PLEG): container finished" podID="54fa776803453540ffaa234553755b21" containerID="9de9b0eecf87f377f2d06e7eb5a63576feb2a9588d671b037c12d65b413219ef" exitCode=0 Jul 03 14:11:34.494290 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:34.494188 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" event={"ID":"54fa776803453540ffaa234553755b21","Type":"ContainerDied","Data":"9de9b0eecf87f377f2d06e7eb5a63576feb2a9588d671b037c12d65b413219ef"} Jul 03 14:11:35.354165 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:35.354111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:35.354655 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:35.354260 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:35.514141 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:35.514026 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" event={"ID":"54fa776803453540ffaa234553755b21","Type":"ContainerStarted","Data":"3440b3e159634d18a6e7c443d138983a46996e4058617a68bec1fb8f384387fc"} Jul 03 14:11:35.534514 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:35.534430 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-36.ec2.internal" podStartSLOduration=3.534410233 podStartE2EDuration="3.534410233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:35.534038798 +0000 UTC m=+5.647860377" watchObservedRunningTime="2026-07-03 14:11:35.534410233 +0000 UTC m=+5.648231812" Jul 03 14:11:35.949608 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:35.948842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:35.949608 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:35.948898 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:35.949608 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:35.949037 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:35.949608 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:35.949100 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret podName:6b1febaf-1350-48a6-b149-00f607eaaf3b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:39.949081092 +0000 UTC m=+10.062902651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret") pod "global-pull-secret-syncer-ln6k5" (UID: "6b1febaf-1350-48a6-b149-00f607eaaf3b") : object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:35.949608 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:35.949513 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:35.949608 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:35.949587 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs podName:6489d734-92c8-46a1-a4cb-c7544e4cde59 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:39.949570743 +0000 UTC m=+10.063392322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs") pod "network-metrics-daemon-7hk5x" (UID: "6489d734-92c8-46a1-a4cb-c7544e4cde59") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:36.049653 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:36.049616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:36.049896 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:36.049867 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 14:11:36.049896 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:36.049893 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 14:11:36.050026 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:36.049907 2574 projected.go:196] Error preparing data for projected volume kube-api-access-th4tl for pod openshift-network-diagnostics/network-check-target-qtwnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:36.050026 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:36.049968 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl podName:2e407c4f-72f7-4527-a6d7-3860240b9f36 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:40.049948959 +0000 UTC m=+10.163770517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-th4tl" (UniqueName: "kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl") pod "network-check-target-qtwnz" (UID: "2e407c4f-72f7-4527-a6d7-3860240b9f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:36.355055 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:36.354982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:36.355576 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:36.355113 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:36.357264 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:36.357240 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:36.357373 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:36.357349 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:37.353873 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:37.353841 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:37.354063 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:37.353980 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:38.353645 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:38.353599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:38.354076 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:38.353609 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:38.354076 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:38.353745 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:38.354076 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:38.353844 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:39.353650 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:39.353616 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:39.354075 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:39.353756 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:39.982388 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:39.982177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:39.982388 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:39.982228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:39.982388 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:39.982355 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:39.982690 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:39.982428 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs podName:6489d734-92c8-46a1-a4cb-c7544e4cde59 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:47.982407404 +0000 UTC m=+18.096228977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs") pod "network-metrics-daemon-7hk5x" (UID: "6489d734-92c8-46a1-a4cb-c7544e4cde59") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:39.982690 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:39.982365 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:39.982690 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:39.982514 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret podName:6b1febaf-1350-48a6-b149-00f607eaaf3b nodeName:}" failed. No retries permitted until 2026-07-03 14:11:47.982494476 +0000 UTC m=+18.096316031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret") pod "global-pull-secret-syncer-ln6k5" (UID: "6b1febaf-1350-48a6-b149-00f607eaaf3b") : object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:40.083156 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:40.083117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:40.083326 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:40.083281 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 14:11:40.083326 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:40.083297 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 14:11:40.083326 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:40.083307 2574 projected.go:196] Error preparing data for projected volume kube-api-access-th4tl for pod openshift-network-diagnostics/network-check-target-qtwnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:40.083491 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:40.083360 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl podName:2e407c4f-72f7-4527-a6d7-3860240b9f36 nodeName:}" failed. No retries permitted until 2026-07-03 14:11:48.083343142 +0000 UTC m=+18.197164695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-th4tl" (UniqueName: "kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl") pod "network-check-target-qtwnz" (UID: "2e407c4f-72f7-4527-a6d7-3860240b9f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:40.354794 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:40.354706 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:40.355238 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:40.354837 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:40.355238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:40.355200 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:40.355351 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:40.355294 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:41.353629 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:41.353583 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:41.353832 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:41.353723 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:42.353475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:42.353397 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:42.353945 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:42.353509 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:42.353945 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:42.353672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:42.353945 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:42.353774 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:43.353956 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:43.353425 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:43.353956 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:43.353571 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:44.354069 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:44.353967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:44.354515 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:44.354105 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:44.354515 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:44.354161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:44.354515 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:44.354272 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:45.354143 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:45.354108 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:45.354621 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:45.354236 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:46.353294 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:46.353263 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:46.353463 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:46.353261 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:46.353850 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:46.353788 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:46.353992 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:46.353920 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:47.353395 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:47.353365 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:47.353873 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:47.353500 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:48.044431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:48.044399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:48.044593 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:48.044443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:48.044593 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.044558 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:48.044593 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.044564 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:48.044795 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.044616 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret podName:6b1febaf-1350-48a6-b149-00f607eaaf3b nodeName:}" failed. No retries permitted until 2026-07-03 14:12:04.044598252 +0000 UTC m=+34.158419819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret") pod "global-pull-secret-syncer-ln6k5" (UID: "6b1febaf-1350-48a6-b149-00f607eaaf3b") : object "kube-system"/"original-pull-secret" not registered Jul 03 14:11:48.044795 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.044638 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs podName:6489d734-92c8-46a1-a4cb-c7544e4cde59 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:04.044627452 +0000 UTC m=+34.158449002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs") pod "network-metrics-daemon-7hk5x" (UID: "6489d734-92c8-46a1-a4cb-c7544e4cde59") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:11:48.145091 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:48.145044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:48.145269 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.145225 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 14:11:48.145269 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.145256 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 14:11:48.145269 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.145269 2574 projected.go:196] Error preparing data for projected volume kube-api-access-th4tl for pod openshift-network-diagnostics/network-check-target-qtwnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:48.145377 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.145338 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl podName:2e407c4f-72f7-4527-a6d7-3860240b9f36 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:04.145319029 +0000 UTC m=+34.259140584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-th4tl" (UniqueName: "kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl") pod "network-check-target-qtwnz" (UID: "2e407c4f-72f7-4527-a6d7-3860240b9f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:11:48.353732 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:48.353647 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:48.354175 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.353792 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:48.354175 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:48.353840 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:48.354175 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:48.353952 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:49.353931 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:49.353896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:49.354446 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:49.354036 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:50.356628 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:50.356599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:50.356628 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:50.356612 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:50.357159 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:50.356695 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:50.357159 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:50.356829 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:51.354238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:51.354199 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:51.354422 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:51.354339 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:52.354007 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.353981 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:52.354390 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.354012 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:52.354390 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:52.354115 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:52.354390 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:52.354234 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:52.557839 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.557684 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" event={"ID":"de48f353-bb1c-48c9-88f0-f4f64832f522","Type":"ContainerStarted","Data":"868afa1bbd7ccd76cc679f2b59223265f77a9c794de2fcfb9666155e51c26ef4"} Jul 03 14:11:52.560270 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.560192 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2hwlt" event={"ID":"b9645511-9ec8-42ad-85fb-d42ec2ba9df1","Type":"ContainerStarted","Data":"a1c5662b7d49f9bd1aa5301d4ca6791d3a2302ec5d09f6a935ab80c9fca3cf49"} Jul 03 14:11:52.562822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.562652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"b5affab394cedddfa116f0dc170e2c45d5a7df939c3615a466c7ff9aa3978199"} Jul 03 14:11:52.565025 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.564964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-grv2q" event={"ID":"291e999c-6c5c-49d6-9596-f4e025a7fd7a","Type":"ContainerStarted","Data":"c11c362c491c524fff401e8182e0c7493715075c3e2bc7a5140c161e167b9563"} Jul 03 14:11:52.568144 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.567486 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4xx8z" event={"ID":"2c2d956b-66dc-4751-8a97-69fedf0f5c14","Type":"ContainerStarted","Data":"e872b9055d1dea68d9a65988af0c3e4386989fc14374e8b7e5a9a4eff926fd0f"} Jul 03 14:11:52.569824 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.569780 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7dbgc" event={"ID":"7b7bb7a5-3be2-4080-a698-eae0a9729fb4","Type":"ContainerStarted","Data":"33bfa5728ee83520256f44dafcb1440a595f6a16528cb02ed6b5752e3de282d2"} Jul 03 14:11:52.572313 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.572287 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerStarted","Data":"6ec20c3f6e3fb2b534020a64eb92d0a84d95ea5fcefcff53ea0cd4381f64e0cd"} Jul 03 14:11:52.578670 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.578413 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l2nb8" podStartSLOduration=3.767796771 podStartE2EDuration="22.578390093s" totalImagesPullingTime="18.810593322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:52.578369916 +0000 UTC m=+22.692191489" watchObservedRunningTime="2026-07-03 14:11:52.578390093 +0000 UTC m=+22.692211667" Jul 03 14:11:52.629321 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.629128 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2hwlt" podStartSLOduration=3.825927507 podStartE2EDuration="22.629112084s" totalImagesPullingTime="18.803184577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:52.628676114 +0000 UTC m=+22.742497680" watchObservedRunningTime="2026-07-03 14:11:52.629112084 +0000 UTC m=+22.742933655" Jul 03 14:11:52.648287 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.648229 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7dbgc" podStartSLOduration=12.025243507 podStartE2EDuration="22.648212321s" totalImagesPullingTime="10.622968814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:52.648114696 +0000 UTC m=+22.761936269" watchObservedRunningTime="2026-07-03 14:11:52.648212321 +0000 UTC m=+22.762033893" Jul 03 14:11:52.671993 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:52.671951 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4xx8z" podStartSLOduration=2.8736079329999997 podStartE2EDuration="21.671934415s" totalImagesPullingTime="18.798326482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:52.671702533 +0000 UTC m=+22.785524105" watchObservedRunningTime="2026-07-03 14:11:52.671934415 +0000 UTC m=+22.785755988" Jul 03 14:11:53.353584 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.353550 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:53.353771 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:53.353661 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:53.577170 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.577130 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"5b774bbdaff705439ce87d485e63e20a42cebd8fa1b0e63486d7321c0174880b"} Jul 03 14:11:53.577863 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.577228 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"322123ee26b6b3af911c6b49d93952b3d86f49f5a373f1997bafe5c7d2aa4482"} Jul 03 14:11:53.577863 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.577286 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"2bd1dc12b02869f6dcc970c06d3e5b0bc70d9ece3f754769f72a157b6c387130"} Jul 03 14:11:53.577863 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.577332 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"220c57e3f263dc8ba63fafc6373079beee5fbc9e09a77590f62a11c53dac6f41"} Jul 03 14:11:53.577863 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.577378 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"4d77aacad24b13ec37d224fb78537c3baff72814f0a8dbb2a41291ba8cd87f48"} Jul 03 14:11:53.578584 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.578559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" event={"ID":"a81641e6-5300-4ceb-8951-36eb3750748e","Type":"ContainerStarted","Data":"8c9c9e5dc5eb475e6cf75e89d695a4f6481c437cbccc3da201d907f0750ba17f"} Jul 03 14:11:53.579895 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.579868 2574 generic.go:356] "Generic (PLEG): container finished" podID="392a12d3-84f1-42e1-b217-956ab85b6224" containerID="6ec20c3f6e3fb2b534020a64eb92d0a84d95ea5fcefcff53ea0cd4381f64e0cd" exitCode=0 Jul 03 14:11:53.579996 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.579911 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerDied","Data":"6ec20c3f6e3fb2b534020a64eb92d0a84d95ea5fcefcff53ea0cd4381f64e0cd"} Jul 03 14:11:53.606986 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.606897 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-grv2q" podStartSLOduration=3.748806825 podStartE2EDuration="22.606876627s" totalImagesPullingTime="18.858069802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:52.698488512 +0000 UTC m=+22.812310085" watchObservedRunningTime="2026-07-03 14:11:53.606876627 +0000 UTC m=+23.720698199" Jul 03 14:11:53.703210 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.703176 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:53.703815 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:53.703777 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:54.062775 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:54.062743 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 03 14:11:54.278375 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:54.278212 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T14:11:54.06276726Z","UUID":"f191d3d8-e760-4540-858d-0a4b180fc0e1","Handler":null,"Name":"","Endpoint":""} Jul 03 14:11:54.279722 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:54.279701 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 03 14:11:54.279844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:54.279738 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 03 14:11:54.357140 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:54.357108 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:54.357336 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:54.357239 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:54.357336 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:54.357294 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:54.357527 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:54.357400 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:54.583979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:54.583879 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wfhxw" event={"ID":"6c4f5574-c0c0-44d9-ba10-79a7f4284d5f","Type":"ContainerStarted","Data":"112a56a1518c9bb8f147fceef1d8200058fbb8a89837803a96bde5fd7fa08202"} Jul 03 14:11:54.585614 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:54.585592 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" event={"ID":"a81641e6-5300-4ceb-8951-36eb3750748e","Type":"ContainerStarted","Data":"78a575bb04aaa8f943254e9514a3bf6107621d21f480ef3bd6348073a38f4366"} Jul 03 14:11:55.091574 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:55.091536 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:55.092189 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:55.092165 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7dbgc" Jul 03 14:11:55.109562 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:55.109517 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wfhxw" podStartSLOduration=6.304849123 podStartE2EDuration="25.109501008s" totalImagesPullingTime="18.804651885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:54.600953609 +0000 UTC m=+24.714775182" watchObservedRunningTime="2026-07-03 14:11:55.109501008 +0000 UTC m=+25.223322580" Jul 03 14:11:55.353315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:55.353234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:55.353458 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:55.353362 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:55.590466 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:55.590427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"cc899200683465c6c64b521cc5398f3a7b264e3b01c503d1ec670692ef6f9780"} Jul 03 14:11:55.592273 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:55.592249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" event={"ID":"a81641e6-5300-4ceb-8951-36eb3750748e","Type":"ContainerStarted","Data":"c07525d3077bf02074fdb9b5240bd5669be927b5212b7ac891263adb8ba98eae"} Jul 03 14:11:56.353722 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:56.353471 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:56.353962 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:56.353471 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:56.353962 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:56.353853 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:56.353962 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:56.353890 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:56.617541 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:56.617448 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljxnj" podStartSLOduration=4.119488488 podStartE2EDuration="25.617433223s" totalImagesPullingTime="21.497944735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:56.616193303 +0000 UTC m=+26.730014877" watchObservedRunningTime="2026-07-03 14:11:56.617433223 +0000 UTC m=+26.731254847" Jul 03 14:11:57.356012 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:57.354134 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:57.356012 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:57.354281 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:57.601768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:57.601687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" event={"ID":"a265c5d5-cb5f-4251-835d-5404f228337f","Type":"ContainerStarted","Data":"28ea91523dce7b72df6e17ab4fc09c030fe7d98d8695322c042d824b97275deb"} Jul 03 14:11:57.602104 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:57.602081 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:57.602223 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:57.602157 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:57.602223 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:57.602207 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:57.621524 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:57.621492 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:57.622328 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:57.621599 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:11:57.636100 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:57.636052 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" podStartSLOduration=7.764233416 podStartE2EDuration="26.6360269s" totalImagesPullingTime="18.871793484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:11:57.63566177 +0000 UTC m=+27.749483345" watchObservedRunningTime="2026-07-03 14:11:57.6360269 +0000 UTC m=+27.749848473" Jul 03 14:11:58.357243 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:58.357054 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:58.357420 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:58.357130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:58.357420 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:58.357330 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:58.357420 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:58.357409 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:59.244357 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:59.244320 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ln6k5"] Jul 03 14:11:59.244681 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:59.244444 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:11:59.244681 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:59.244560 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:11:59.247218 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:59.247189 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qtwnz"] Jul 03 14:11:59.247315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:59.247269 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:11:59.247371 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:59.247351 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:11:59.249931 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:59.249906 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7hk5x"] Jul 03 14:11:59.250039 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:59.250013 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:11:59.250134 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:11:59.250115 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:11:59.608346 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:59.608311 2574 generic.go:356] "Generic (PLEG): container finished" podID="392a12d3-84f1-42e1-b217-956ab85b6224" containerID="015ac5b6cfa5bbc53a101c6134ee1950802c44c3bba30d5069784ac2b4c30607" exitCode=0 Jul 03 14:11:59.608499 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:11:59.608398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerDied","Data":"015ac5b6cfa5bbc53a101c6134ee1950802c44c3bba30d5069784ac2b4c30607"} Jul 03 14:12:00.354908 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:00.354863 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:12:00.355347 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:00.354993 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:12:00.355347 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:00.355043 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:12:00.355347 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:00.355149 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:12:01.353556 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:01.353529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:01.353691 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:01.353629 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:12:01.614063 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:01.613983 2574 generic.go:356] "Generic (PLEG): container finished" podID="392a12d3-84f1-42e1-b217-956ab85b6224" containerID="b87cc4a6bb0ff30274c72d1a8ebe3f6211e33032f0251ae08dec38dd172306c2" exitCode=0 Jul 03 14:12:01.614063 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:01.614023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerDied","Data":"b87cc4a6bb0ff30274c72d1a8ebe3f6211e33032f0251ae08dec38dd172306c2"} Jul 03 14:12:02.353482 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:02.353388 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:12:02.353656 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:02.353559 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:12:02.353748 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:02.353387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:12:02.353890 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:02.353868 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:12:03.354165 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:03.353967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:03.354525 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:03.354240 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:12:03.620290 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:03.620207 2574 generic.go:356] "Generic (PLEG): container finished" podID="392a12d3-84f1-42e1-b217-956ab85b6224" containerID="43a1b6956487c04df648adfd6dc40ce8cd3046c6a9d18309f17c99be96c36737" exitCode=0 Jul 03 14:12:03.620290 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:03.620249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerDied","Data":"43a1b6956487c04df648adfd6dc40ce8cd3046c6a9d18309f17c99be96c36737"} Jul 03 14:12:04.066290 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:04.066251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:12:04.066290 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:04.066295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:12:04.066497 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.066391 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 14:12:04.066497 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.066393 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:12:04.066497 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.066448 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs podName:6489d734-92c8-46a1-a4cb-c7544e4cde59 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:36.06643436 +0000 UTC m=+66.180255912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs") pod "network-metrics-daemon-7hk5x" (UID: "6489d734-92c8-46a1-a4cb-c7544e4cde59") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 14:12:04.066497 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.066461 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret podName:6b1febaf-1350-48a6-b149-00f607eaaf3b nodeName:}" failed. No retries permitted until 2026-07-03 14:12:36.066455108 +0000 UTC m=+66.180276658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret") pod "global-pull-secret-syncer-ln6k5" (UID: "6b1febaf-1350-48a6-b149-00f607eaaf3b") : object "kube-system"/"original-pull-secret" not registered Jul 03 14:12:04.167360 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:04.167267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:04.167502 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.167420 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 14:12:04.167502 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.167438 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 14:12:04.167502 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.167447 2574 projected.go:196] Error preparing data for projected volume kube-api-access-th4tl for pod openshift-network-diagnostics/network-check-target-qtwnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:12:04.167502 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.167497 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl podName:2e407c4f-72f7-4527-a6d7-3860240b9f36 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:36.167483439 +0000 UTC m=+66.281304989 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-th4tl" (UniqueName: "kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl") pod "network-check-target-qtwnz" (UID: "2e407c4f-72f7-4527-a6d7-3860240b9f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 14:12:04.357035 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:04.357004 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:12:04.357415 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.357109 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hk5x" podUID="6489d734-92c8-46a1-a4cb-c7544e4cde59" Jul 03 14:12:04.357415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:04.357158 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:12:04.357415 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:04.357249 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ln6k5" podUID="6b1febaf-1350-48a6-b149-00f607eaaf3b" Jul 03 14:12:05.353754 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:05.353718 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:05.354028 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:05.353843 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qtwnz" podUID="2e407c4f-72f7-4527-a6d7-3860240b9f36" Jul 03 14:12:06.235099 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.235008 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-36.ec2.internal" event="NodeReady" Jul 03 14:12:06.235736 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.235205 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 03 14:12:06.274127 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.274026 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f487b5f98-b84nr"] Jul 03 14:12:06.277691 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.277667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.279917 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.279890 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 03 14:12:06.279917 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.279890 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 03 14:12:06.280443 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.280355 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 03 14:12:06.282028 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.281868 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bkp7q\"" Jul 03 14:12:06.290178 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.290141 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f487b5f98-b84nr"] Jul 03 14:12:06.290178 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.290161 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 03 14:12:06.293448 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.293422 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n5jlw"] Jul 03 14:12:06.297130 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.297109 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pvzjl"] Jul 03 14:12:06.297261 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.297243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n5jlw" Jul 03 14:12:06.299605 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.299579 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 03 14:12:06.299719 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.299626 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 03 14:12:06.299719 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.299626 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gqn8m\"" Jul 03 14:12:06.299719 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.299655 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 03 14:12:06.300830 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.300813 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.302913 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.302887 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 03 14:12:06.302913 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.302910 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 03 14:12:06.303080 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.302913 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xht5n\"" Jul 03 14:12:06.311230 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.310657 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pvzjl"] Jul 03 14:12:06.311230 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.311147 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n5jlw"] Jul 03 14:12:06.356623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.356597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:12:06.356784 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.356753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:12:06.359669 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.359646 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 14:12:06.359669 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.359662 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 14:12:06.359924 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.359878 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kg466\"" Jul 03 14:12:06.385762 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.385731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-image-registry-private-configuration\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.385926 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.385768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-installation-pull-secrets\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.385926 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.385792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfnmx\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-kube-api-access-cfnmx\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.385926 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.385841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59e6d9dd-8374-4a65-bec0-20ffd23d6492-cert\") pod \"ingress-canary-n5jlw\" (UID: \"59e6d9dd-8374-4a65-bec0-20ffd23d6492\") " pod="openshift-ingress-canary/ingress-canary-n5jlw" Jul 03 14:12:06.386029 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.385927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmqf8\" (UniqueName: \"kubernetes.io/projected/dc353f9d-855e-4828-b3e9-8dc09ae85739-kube-api-access-pmqf8\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.386029 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.385951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-certificates\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.386029 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.385970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.386029 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.386020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-trusted-ca\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.386146 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.386064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc353f9d-855e-4828-b3e9-8dc09ae85739-config-volume\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.386146 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.386081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lknw\" (UniqueName: \"kubernetes.io/projected/59e6d9dd-8374-4a65-bec0-20ffd23d6492-kube-api-access-6lknw\") pod \"ingress-canary-n5jlw\" (UID: \"59e6d9dd-8374-4a65-bec0-20ffd23d6492\") " pod="openshift-ingress-canary/ingress-canary-n5jlw" Jul 03 14:12:06.386146 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.386095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc353f9d-855e-4828-b3e9-8dc09ae85739-tmp-dir\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.386146 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.386113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.386146 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.386138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d9b63d7-ed85-42dd-a810-2ad03a03504d-ca-trust-extracted\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.386288 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.386158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-bound-sa-token\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.472622 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.472584 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:06.486561 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc353f9d-855e-4828-b3e9-8dc09ae85739-config-volume\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.486561 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lknw\" (UniqueName: \"kubernetes.io/projected/59e6d9dd-8374-4a65-bec0-20ffd23d6492-kube-api-access-6lknw\") pod \"ingress-canary-n5jlw\" (UID: \"59e6d9dd-8374-4a65-bec0-20ffd23d6492\") " pod="openshift-ingress-canary/ingress-canary-n5jlw" Jul 03 14:12:06.486561 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc353f9d-855e-4828-b3e9-8dc09ae85739-tmp-dir\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.486561 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d9b63d7-ed85-42dd-a810-2ad03a03504d-ca-trust-extracted\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-bound-sa-token\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-image-registry-private-configuration\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-installation-pull-secrets\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfnmx\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-kube-api-access-cfnmx\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59e6d9dd-8374-4a65-bec0-20ffd23d6492-cert\") pod \"ingress-canary-n5jlw\" (UID: \"59e6d9dd-8374-4a65-bec0-20ffd23d6492\") " pod="openshift-ingress-canary/ingress-canary-n5jlw" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmqf8\" (UniqueName: \"kubernetes.io/projected/dc353f9d-855e-4828-b3e9-8dc09ae85739-kube-api-access-pmqf8\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-certificates\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.486979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.487388 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.486986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-trusted-ca\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.487388 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.487007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d9b63d7-ed85-42dd-a810-2ad03a03504d-ca-trust-extracted\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.487388 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.487048 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc353f9d-855e-4828-b3e9-8dc09ae85739-tmp-dir\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.487388 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.486744 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 14:12:06.487388 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.487091 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f487b5f98-b84nr: secret "image-registry-tls" not found Jul 03 14:12:06.487388 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.487146 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc353f9d-855e-4828-b3e9-8dc09ae85739-config-volume\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.487388 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.487158 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls podName:3d9b63d7-ed85-42dd-a810-2ad03a03504d nodeName:}" failed. No retries permitted until 2026-07-03 14:12:06.987138671 +0000 UTC m=+37.100960242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls") pod "image-registry-6f487b5f98-b84nr" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d") : secret "image-registry-tls" not found Jul 03 14:12:06.487727 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.487429 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 14:12:06.487727 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.487500 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls podName:dc353f9d-855e-4828-b3e9-8dc09ae85739 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:06.987481351 +0000 UTC m=+37.101302920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls") pod "dns-default-pvzjl" (UID: "dc353f9d-855e-4828-b3e9-8dc09ae85739") : secret "dns-default-metrics-tls" not found Jul 03 14:12:06.487727 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.487578 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-certificates\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.488719 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.488687 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-trusted-ca\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.491381 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.491351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-image-registry-private-configuration\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.491490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.491379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-installation-pull-secrets\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.491490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.491422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59e6d9dd-8374-4a65-bec0-20ffd23d6492-cert\") pod \"ingress-canary-n5jlw\" (UID: \"59e6d9dd-8374-4a65-bec0-20ffd23d6492\") " pod="openshift-ingress-canary/ingress-canary-n5jlw" Jul 03 14:12:06.498744 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.498711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-bound-sa-token\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.499325 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.499297 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lknw\" (UniqueName: \"kubernetes.io/projected/59e6d9dd-8374-4a65-bec0-20ffd23d6492-kube-api-access-6lknw\") pod \"ingress-canary-n5jlw\" (UID: \"59e6d9dd-8374-4a65-bec0-20ffd23d6492\") " pod="openshift-ingress-canary/ingress-canary-n5jlw" Jul 03 14:12:06.499604 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.499579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmqf8\" (UniqueName: \"kubernetes.io/projected/dc353f9d-855e-4828-b3e9-8dc09ae85739-kube-api-access-pmqf8\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.499745 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.499710 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfnmx\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-kube-api-access-cfnmx\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.562558 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.562522 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:06.608543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.608510 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n5jlw" Jul 03 14:12:06.737220 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.737121 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:06.782314 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.782280 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n5jlw"] Jul 03 14:12:06.787214 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:12:06.787184 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e6d9dd_8374_4a65_bec0_20ffd23d6492.slice/crio-82ca0c7be6c243d3b0f2ab3e5723c3bce404528d3cbdfdbba9b5021641addb77 WatchSource:0}: Error finding container 82ca0c7be6c243d3b0f2ab3e5723c3bce404528d3cbdfdbba9b5021641addb77: Status 404 returned error can't find the container with id 82ca0c7be6c243d3b0f2ab3e5723c3bce404528d3cbdfdbba9b5021641addb77 Jul 03 14:12:06.800690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.800654 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:06.989987 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.989891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:06.989987 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:06.989964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:06.990209 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.990074 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 14:12:06.990209 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.990173 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls podName:dc353f9d-855e-4828-b3e9-8dc09ae85739 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:07.990150427 +0000 UTC m=+38.103971981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls") pod "dns-default-pvzjl" (UID: "dc353f9d-855e-4828-b3e9-8dc09ae85739") : secret "dns-default-metrics-tls" not found Jul 03 14:12:06.990209 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.990078 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 14:12:06.990209 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.990193 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f487b5f98-b84nr: secret "image-registry-tls" not found Jul 03 14:12:06.990377 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:06.990243 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls podName:3d9b63d7-ed85-42dd-a810-2ad03a03504d nodeName:}" failed. No retries permitted until 2026-07-03 14:12:07.990227942 +0000 UTC m=+38.104049506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls") pod "image-registry-6f487b5f98-b84nr" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d") : secret "image-registry-tls" not found Jul 03 14:12:07.353753 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.353661 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:07.357581 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.357397 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m5fkc\"" Jul 03 14:12:07.357717 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.357401 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 14:12:07.357980 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.357956 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 14:12:07.632264 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.632232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n5jlw" event={"ID":"59e6d9dd-8374-4a65-bec0-20ffd23d6492","Type":"ContainerStarted","Data":"82ca0c7be6c243d3b0f2ab3e5723c3bce404528d3cbdfdbba9b5021641addb77"} Jul 03 14:12:07.727926 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.727885 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:07.798527 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.798494 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:07.999658 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.999567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:07.999853 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:07.999685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:07.999853 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:07.999749 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 14:12:07.999853 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:07.999771 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f487b5f98-b84nr: secret "image-registry-tls" not found Jul 03 14:12:07.999853 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:07.999846 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 14:12:08.000092 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:07.999849 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls podName:3d9b63d7-ed85-42dd-a810-2ad03a03504d nodeName:}" failed. No retries permitted until 2026-07-03 14:12:09.99983018 +0000 UTC m=+40.113651743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls") pod "image-registry-6f487b5f98-b84nr" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d") : secret "image-registry-tls" not found Jul 03 14:12:08.000092 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:07.999914 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls podName:dc353f9d-855e-4828-b3e9-8dc09ae85739 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:09.999897906 +0000 UTC m=+40.113719457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls") pod "dns-default-pvzjl" (UID: "dc353f9d-855e-4828-b3e9-8dc09ae85739") : secret "dns-default-metrics-tls" not found Jul 03 14:12:08.908961 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:08.908920 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:10.014944 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:10.014908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:10.015326 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:10.014979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:10.015326 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:10.015062 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 14:12:10.015326 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:10.015109 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls podName:dc353f9d-855e-4828-b3e9-8dc09ae85739 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:14.015096013 +0000 UTC m=+44.128917565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls") pod "dns-default-pvzjl" (UID: "dc353f9d-855e-4828-b3e9-8dc09ae85739") : secret "dns-default-metrics-tls" not found Jul 03 14:12:10.015326 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:10.015062 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 14:12:10.015326 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:10.015149 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f487b5f98-b84nr: secret "image-registry-tls" not found Jul 03 14:12:10.015326 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:10.015192 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls podName:3d9b63d7-ed85-42dd-a810-2ad03a03504d nodeName:}" failed. No retries permitted until 2026-07-03 14:12:14.015179705 +0000 UTC m=+44.129001260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls") pod "image-registry-6f487b5f98-b84nr" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d") : secret "image-registry-tls" not found Jul 03 14:12:10.849946 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:10.849906 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:10.910250 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:10.910207 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:12.646591 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:12.646555 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n5jlw" event={"ID":"59e6d9dd-8374-4a65-bec0-20ffd23d6492","Type":"ContainerStarted","Data":"50613b504a49de9db2db75b33cdc55173bdbee9c4d3a42d06fb49968a4a199eb"} Jul 03 14:12:12.649419 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:12.649393 2574 generic.go:356] "Generic (PLEG): container finished" podID="392a12d3-84f1-42e1-b217-956ab85b6224" containerID="7a6212d508e21b270cdb97ea24e1486eaee42a69d1de8ed697e4b1622816b1e4" exitCode=0 Jul 03 14:12:12.649543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:12.649429 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerDied","Data":"7a6212d508e21b270cdb97ea24e1486eaee42a69d1de8ed697e4b1622816b1e4"} Jul 03 14:12:12.663091 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:12.663050 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n5jlw" podStartSLOduration=1.5811356399999998 podStartE2EDuration="6.663036963s" totalImagesPullingTime="5.081901323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:12.662235555 +0000 UTC m=+42.776057147" watchObservedRunningTime="2026-07-03 14:12:12.663036963 +0000 UTC m=+42.776858515" Jul 03 14:12:13.260735 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:13.260694 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:13.323497 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:13.323457 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:13.654935 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:13.654903 2574 generic.go:356] "Generic (PLEG): container finished" podID="392a12d3-84f1-42e1-b217-956ab85b6224" containerID="23fe699cda39aa20f74b8bc453f31ed7360cf654308ab96857f8b25d376cccb9" exitCode=0 Jul 03 14:12:13.655343 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:13.654992 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerDied","Data":"23fe699cda39aa20f74b8bc453f31ed7360cf654308ab96857f8b25d376cccb9"} Jul 03 14:12:14.046497 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:14.046460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:14.046643 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:14.046524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:14.046643 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:14.046621 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 14:12:14.046725 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:14.046696 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls podName:dc353f9d-855e-4828-b3e9-8dc09ae85739 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:22.046680034 +0000 UTC m=+52.160501589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls") pod "dns-default-pvzjl" (UID: "dc353f9d-855e-4828-b3e9-8dc09ae85739") : secret "dns-default-metrics-tls" not found Jul 03 14:12:14.046725 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:14.046624 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 14:12:14.046793 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:14.046729 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f487b5f98-b84nr: secret "image-registry-tls" not found Jul 03 14:12:14.046793 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:14.046772 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls podName:3d9b63d7-ed85-42dd-a810-2ad03a03504d nodeName:}" failed. No retries permitted until 2026-07-03 14:12:22.04676017 +0000 UTC m=+52.160581722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls") pod "image-registry-6f487b5f98-b84nr" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d") : secret "image-registry-tls" not found Jul 03 14:12:14.531709 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:14.531626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:14.660379 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:14.660347 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvbm" event={"ID":"392a12d3-84f1-42e1-b217-956ab85b6224","Type":"ContainerStarted","Data":"a977d62ccfe0c505d3c12369d0caa31aa3441f1bdd6cf4b6da61c6208dc7628c"} Jul 03 14:12:14.687929 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:14.687872 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-grvbm" podStartSLOduration=8.827589662 podStartE2EDuration="43.687857244s" totalImagesPullingTime="34.860267582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:14.687315677 +0000 UTC m=+44.801137250" watchObservedRunningTime="2026-07-03 14:12:14.687857244 +0000 UTC m=+44.801678817" Jul 03 14:12:14.812524 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:14.812488 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:14.875401 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:14.875365 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:18.788437 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:18.788396 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:18.883547 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:18.883503 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:21.581345 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:21.581311 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:21.672304 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:21.672275 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:21.804268 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:21.804238 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:21.899196 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:21.899104 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:22.106394 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.106354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:22.106559 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.106413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:22.106559 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:22.106501 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 14:12:22.106559 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:22.106549 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 14:12:22.106659 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:22.106562 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f487b5f98-b84nr: secret "image-registry-tls" not found Jul 03 14:12:22.106659 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:22.106580 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls podName:dc353f9d-855e-4828-b3e9-8dc09ae85739 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:38.106557358 +0000 UTC m=+68.220378926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls") pod "dns-default-pvzjl" (UID: "dc353f9d-855e-4828-b3e9-8dc09ae85739") : secret "dns-default-metrics-tls" not found Jul 03 14:12:22.106659 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:22.106605 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls podName:3d9b63d7-ed85-42dd-a810-2ad03a03504d nodeName:}" failed. No retries permitted until 2026-07-03 14:12:38.106595043 +0000 UTC m=+68.220416600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls") pod "image-registry-6f487b5f98-b84nr" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d") : secret "image-registry-tls" not found Jul 03 14:12:22.257317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.257223 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988"] Jul 03 14:12:22.272874 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.272831 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988"] Jul 03 14:12:22.273062 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.272969 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:22.275783 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.275758 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 03 14:12:22.277219 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.276875 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 03 14:12:22.277219 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.276895 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 03 14:12:22.277219 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.276933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7sxvd\"" Jul 03 14:12:22.409002 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.408956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67wbj\" (UniqueName: \"kubernetes.io/projected/eb522e24-0649-467e-b165-ecf4740df512-kube-api-access-67wbj\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:22.409183 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.409046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:22.437362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.437310 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:22.510416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.510331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67wbj\" (UniqueName: \"kubernetes.io/projected/eb522e24-0649-467e-b165-ecf4740df512-kube-api-access-67wbj\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:22.510416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.510394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:22.510574 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:22.510484 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 14:12:22.510574 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:22.510547 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls podName:eb522e24-0649-467e-b165-ecf4740df512 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:23.010532959 +0000 UTC m=+53.124354511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lc988" (UID: "eb522e24-0649-467e-b165-ecf4740df512") : secret "samples-operator-tls" not found Jul 03 14:12:22.521761 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.521728 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67wbj\" (UniqueName: \"kubernetes.io/projected/eb522e24-0649-467e-b165-ecf4740df512-kube-api-access-67wbj\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:22.537215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:22.537174 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:23.013545 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:23.013503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:23.014081 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:23.013686 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 14:12:23.014081 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:23.013831 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls podName:eb522e24-0649-467e-b165-ecf4740df512 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:24.013778917 +0000 UTC m=+54.127600482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lc988" (UID: "eb522e24-0649-467e-b165-ecf4740df512") : secret "samples-operator-tls" not found Jul 03 14:12:23.855322 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:23.855286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:23.920142 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:23.920106 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:24.021362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:24.021325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:24.021768 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:24.021482 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 14:12:24.021768 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:24.021546 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls podName:eb522e24-0649-467e-b165-ecf4740df512 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:26.021531018 +0000 UTC m=+56.135352569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lc988" (UID: "eb522e24-0649-467e-b165-ecf4740df512") : secret "samples-operator-tls" not found Jul 03 14:12:25.563228 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:25.563185 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:25.627596 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:25.627561 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:26.035957 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:26.035835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:26.036132 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:26.035974 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 14:12:26.036132 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:26.036074 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls podName:eb522e24-0649-467e-b165-ecf4740df512 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:30.03605558 +0000 UTC m=+60.149877131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lc988" (UID: "eb522e24-0649-467e-b165-ecf4740df512") : secret "samples-operator-tls" not found Jul 03 14:12:27.686275 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.686237 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-swrwp"] Jul 03 14:12:27.690278 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.690254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.692751 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.692723 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 03 14:12:27.693667 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.693647 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pz6z4\"" Jul 03 14:12:27.693667 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.693664 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 03 14:12:27.693842 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.693663 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 03 14:12:27.693842 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.693651 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 03 14:12:27.702274 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.702251 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swrwp"] Jul 03 14:12:27.732854 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.732816 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:27.792319 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.792280 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:27.851470 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.851430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.851652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.851512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.851652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.851534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt72p\" (UniqueName: \"kubernetes.io/projected/6b314532-4b37-4f71-b32f-508436a20846-kube-api-access-vt72p\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.851652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.851574 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b314532-4b37-4f71-b32f-508436a20846-crio-socket\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.851765 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.851653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b314532-4b37-4f71-b32f-508436a20846-data-volume\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.952111 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.952026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b314532-4b37-4f71-b32f-508436a20846-crio-socket\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.952111 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.952079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b314532-4b37-4f71-b32f-508436a20846-data-volume\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.952111 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.952100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.952344 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.952163 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b314532-4b37-4f71-b32f-508436a20846-crio-socket\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.952344 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:27.952203 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 14:12:27.952344 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:27.952257 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:28.452243008 +0000 UTC m=+58.566064559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : secret "insights-runtime-extractor-tls" not found Jul 03 14:12:27.952344 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.952292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.952344 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.952308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt72p\" (UniqueName: \"kubernetes.io/projected/6b314532-4b37-4f71-b32f-508436a20846-kube-api-access-vt72p\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.952590 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:27.952370 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 14:12:27.952590 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:27.952444 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:28.452428041 +0000 UTC m=+58.566249613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : configmap "kube-rbac-proxy" not found Jul 03 14:12:27.952590 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.952535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b314532-4b37-4f71-b32f-508436a20846-data-volume\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:27.961175 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:27.961150 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt72p\" (UniqueName: \"kubernetes.io/projected/6b314532-4b37-4f71-b32f-508436a20846-kube-api-access-vt72p\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:28.455743 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.455690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:28.455954 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.455815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:28.455954 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:28.455861 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 14:12:28.455954 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:28.455930 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 14:12:28.456065 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:28.455937 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:29.455922871 +0000 UTC m=+59.569744422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : secret "insights-runtime-extractor-tls" not found Jul 03 14:12:28.456065 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:28.455995 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:29.45598026 +0000 UTC m=+59.569801815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : configmap "kube-rbac-proxy" not found Jul 03 14:12:28.724578 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.724492 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5"] Jul 03 14:12:28.726815 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.726788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5" Jul 03 14:12:28.729077 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.729056 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-sb9wv\"" Jul 03 14:12:28.738531 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.738504 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5"] Jul 03 14:12:28.858924 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.858889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6txzv\" (UniqueName: \"kubernetes.io/projected/bee2732d-c4df-493b-a1ec-d74fcaa854b5-kube-api-access-6txzv\") pod \"network-check-source-989f8b8dc-htwv5\" (UID: \"bee2732d-c4df-493b-a1ec-d74fcaa854b5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5" Jul 03 14:12:28.960244 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.960205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txzv\" (UniqueName: \"kubernetes.io/projected/bee2732d-c4df-493b-a1ec-d74fcaa854b5-kube-api-access-6txzv\") pod \"network-check-source-989f8b8dc-htwv5\" (UID: \"bee2732d-c4df-493b-a1ec-d74fcaa854b5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5" Jul 03 14:12:28.970907 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:28.970874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6txzv\" (UniqueName: \"kubernetes.io/projected/bee2732d-c4df-493b-a1ec-d74fcaa854b5-kube-api-access-6txzv\") pod \"network-check-source-989f8b8dc-htwv5\" (UID: \"bee2732d-c4df-493b-a1ec-d74fcaa854b5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5" Jul 03 14:12:29.035607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.035509 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5" Jul 03 14:12:29.162107 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.162077 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5"] Jul 03 14:12:29.165523 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:12:29.165495 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee2732d_c4df_493b_a1ec_d74fcaa854b5.slice/crio-7740836f367844ae3cf92a06432d928e1ffcbee8502dd1ace31277c55c638a82 WatchSource:0}: Error finding container 7740836f367844ae3cf92a06432d928e1ffcbee8502dd1ace31277c55c638a82: Status 404 returned error can't find the container with id 7740836f367844ae3cf92a06432d928e1ffcbee8502dd1ace31277c55c638a82 Jul 03 14:12:29.464500 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.464465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:29.464727 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.464543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:29.464727 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:29.464632 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 14:12:29.464727 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:29.464682 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:31.464668876 +0000 UTC m=+61.578490426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : configmap "kube-rbac-proxy" not found Jul 03 14:12:29.464727 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:29.464632 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 14:12:29.464727 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:29.464718 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:31.46470956 +0000 UTC m=+61.578531121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : secret "insights-runtime-extractor-tls" not found Jul 03 14:12:29.480962 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.480936 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4xx8z_2c2d956b-66dc-4751-8a97-69fedf0f5c14/dns-node-resolver/0.log" Jul 03 14:12:29.619295 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.619271 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwb85" Jul 03 14:12:29.697395 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.697360 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5" event={"ID":"bee2732d-c4df-493b-a1ec-d74fcaa854b5","Type":"ContainerStarted","Data":"7740836f367844ae3cf92a06432d928e1ffcbee8502dd1ace31277c55c638a82"} Jul 03 14:12:29.776301 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.776186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:29.838114 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:29.838057 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:30.064700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:30.064656 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:30.069765 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:30.069728 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:30.069936 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:30.069894 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 14:12:30.069982 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:30.069960 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls podName:eb522e24-0649-467e-b165-ecf4740df512 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:38.069941269 +0000 UTC m=+68.183762823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lc988" (UID: "eb522e24-0649-467e-b165-ecf4740df512") : secret "samples-operator-tls" not found Jul 03 14:12:30.159443 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:30.159401 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:30.479269 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:30.479192 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2hwlt_b9645511-9ec8-42ad-85fb-d42ec2ba9df1/node-ca/0.log" Jul 03 14:12:31.479627 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:31.479594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:31.480117 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:31.479693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:31.480117 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:31.479745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5jlw_59e6d9dd-8374-4a65-bec0-20ffd23d6492/serve-healthcheck-canary/0.log" Jul 03 14:12:31.480117 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:31.479783 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 14:12:31.480117 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:31.479821 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 14:12:31.480117 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:31.479868 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:35.479846532 +0000 UTC m=+65.593668088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : secret "insights-runtime-extractor-tls" not found Jul 03 14:12:31.480117 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:31.479889 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:35.479878449 +0000 UTC m=+65.593700005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : configmap "kube-rbac-proxy" not found Jul 03 14:12:32.279520 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:32.279484 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:32.422788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:32.422755 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:32.662834 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:32.662786 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:32.707543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:32.707506 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5" event={"ID":"bee2732d-c4df-493b-a1ec-d74fcaa854b5","Type":"ContainerStarted","Data":"e16ab7be6a42ba851cab015cdefad9e68fe2f52f54d8f5346651c412c496439e"} Jul 03 14:12:32.732926 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:32.730781 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-htwv5" podStartSLOduration=1.7154169160000001 podStartE2EDuration="4.730756392s" totalImagesPullingTime="3.015339476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:32.728728102 +0000 UTC m=+62.842549675" watchObservedRunningTime="2026-07-03 14:12:32.730756392 +0000 UTC m=+62.844577967" Jul 03 14:12:32.765056 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:32.765011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:32.939108 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:32.939018 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:33.035582 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:33.035547 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:34.546387 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.546355 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wdtwb"] Jul 03 14:12:34.549482 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.549466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.552217 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.552193 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 03 14:12:34.553014 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.552989 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 03 14:12:34.553014 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.552990 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 03 14:12:34.553179 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.553021 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 03 14:12:34.553179 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.553008 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sjx9l\"" Jul 03 14:12:34.563240 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.563216 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wdtwb"] Jul 03 14:12:34.593199 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.593160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:34.604263 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.604236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-signing-cabundle\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.604378 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.604280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsk2x\" (UniqueName: \"kubernetes.io/projected/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-kube-api-access-hsk2x\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.604378 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.604342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-signing-key\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.694525 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.694500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:34.704683 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.704654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsk2x\" (UniqueName: \"kubernetes.io/projected/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-kube-api-access-hsk2x\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.704886 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.704716 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-signing-key\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.704947 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.704927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-signing-cabundle\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.705517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.705499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-signing-cabundle\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.707250 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.707229 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-signing-key\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.714392 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.714369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsk2x\" (UniqueName: \"kubernetes.io/projected/4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa-kube-api-access-hsk2x\") pod \"service-ca-758f599c5-wdtwb\" (UID: \"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa\") " pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.858544 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.858448 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-wdtwb" Jul 03 14:12:34.983670 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:34.983638 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wdtwb"] Jul 03 14:12:34.987075 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:12:34.987042 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1d2f8b_d66e_4d10_92c8_93f1ca51caaa.slice/crio-4e8bb4aa5ff97e7812dd051b6d1e3778fff3c4bdf2b8240a748436800a1b5eec WatchSource:0}: Error finding container 4e8bb4aa5ff97e7812dd051b6d1e3778fff3c4bdf2b8240a748436800a1b5eec: Status 404 returned error can't find the container with id 4e8bb4aa5ff97e7812dd051b6d1e3778fff3c4bdf2b8240a748436800a1b5eec Jul 03 14:12:35.512204 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:35.512168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:35.512388 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:35.512271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:35.512388 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:35.512330 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 14:12:35.512505 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:35.512392 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:43.512375058 +0000 UTC m=+73.626196629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : secret "insights-runtime-extractor-tls" not found Jul 03 14:12:35.512505 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:35.512410 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 14:12:35.512505 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:35.512473 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:43.512458256 +0000 UTC m=+73.626279808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : configmap "kube-rbac-proxy" not found Jul 03 14:12:35.559079 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:35.559042 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:35.717349 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:35.717311 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-wdtwb" event={"ID":"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa","Type":"ContainerStarted","Data":"4e8bb4aa5ff97e7812dd051b6d1e3778fff3c4bdf2b8240a748436800a1b5eec"} Jul 03 14:12:36.118855 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.118788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:12:36.119061 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.118876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:12:36.121523 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.121498 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 14:12:36.121678 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.121581 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 14:12:36.129539 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:36.129514 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 03 14:12:36.129608 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:36.129580 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs podName:6489d734-92c8-46a1-a4cb-c7544e4cde59 nodeName:}" failed. No retries permitted until 2026-07-03 14:13:40.129562526 +0000 UTC m=+130.243384076 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs") pod "network-metrics-daemon-7hk5x" (UID: "6489d734-92c8-46a1-a4cb-c7544e4cde59") : secret "metrics-daemon-secret" not found Jul 03 14:12:36.131618 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.131598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b1febaf-1350-48a6-b149-00f607eaaf3b-original-pull-secret\") pod \"global-pull-secret-syncer-ln6k5\" (UID: \"6b1febaf-1350-48a6-b149-00f607eaaf3b\") " pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:12:36.219615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.219561 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:36.222151 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.222126 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th4tl\" (UniqueName: \"kubernetes.io/projected/2e407c4f-72f7-4527-a6d7-3860240b9f36-kube-api-access-th4tl\") pod \"network-check-target-qtwnz\" (UID: \"2e407c4f-72f7-4527-a6d7-3860240b9f36\") " pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:36.371499 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.371411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ln6k5" Jul 03 14:12:36.468582 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.468550 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m5fkc\"" Jul 03 14:12:36.476957 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.476928 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:36.962392 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.962356 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ln6k5"] Jul 03 14:12:36.965233 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:12:36.965191 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1febaf_1350_48a6_b149_00f607eaaf3b.slice/crio-69b42ebcfd9fc44ca5ae1f5f3afa65b506f43e7a90875b169567df49f2118e3e WatchSource:0}: Error finding container 69b42ebcfd9fc44ca5ae1f5f3afa65b506f43e7a90875b169567df49f2118e3e: Status 404 returned error can't find the container with id 69b42ebcfd9fc44ca5ae1f5f3afa65b506f43e7a90875b169567df49f2118e3e Jul 03 14:12:36.983435 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:36.980625 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qtwnz"] Jul 03 14:12:36.984370 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:12:36.984329 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e407c4f_72f7_4527_a6d7_3860240b9f36.slice/crio-9ab7fb8531a4beb0d38498330ead3933b0882b9776b51ec02b45d61ba118a89e WatchSource:0}: Error finding container 9ab7fb8531a4beb0d38498330ead3933b0882b9776b51ec02b45d61ba118a89e: Status 404 returned error can't find the container with id 9ab7fb8531a4beb0d38498330ead3933b0882b9776b51ec02b45d61ba118a89e Jul 03 14:12:37.724453 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:37.724393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-wdtwb" event={"ID":"4d1d2f8b-d66e-4d10-92c8-93f1ca51caaa","Type":"ContainerStarted","Data":"9cd2084e03b6fd28b5e534d1aa84b2010f874a0295ff147327fe40d5f384380c"} Jul 03 14:12:37.725813 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:37.725763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ln6k5" event={"ID":"6b1febaf-1350-48a6-b149-00f607eaaf3b","Type":"ContainerStarted","Data":"69b42ebcfd9fc44ca5ae1f5f3afa65b506f43e7a90875b169567df49f2118e3e"} Jul 03 14:12:37.727342 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:37.727318 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qtwnz" event={"ID":"2e407c4f-72f7-4527-a6d7-3860240b9f36","Type":"ContainerStarted","Data":"1a26ba6222642af24f5bcd112a94efc03b85ecf0e4c025c03bf55b31152b90af"} Jul 03 14:12:37.727449 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:37.727355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qtwnz" event={"ID":"2e407c4f-72f7-4527-a6d7-3860240b9f36","Type":"ContainerStarted","Data":"9ab7fb8531a4beb0d38498330ead3933b0882b9776b51ec02b45d61ba118a89e"} Jul 03 14:12:37.727505 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:37.727473 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:12:37.765295 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:37.765246 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qtwnz" podStartSLOduration=66.765224245 podStartE2EDuration="1m6.765224245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:37.764751824 +0000 UTC m=+67.878573398" watchObservedRunningTime="2026-07-03 14:12:37.765224245 +0000 UTC m=+67.879045819" Jul 03 14:12:37.765464 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:37.765326 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-wdtwb" podStartSLOduration=1.872234027 podStartE2EDuration="3.765320479s" totalImagesPullingTime="1.893086452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:37.745167686 +0000 UTC m=+67.858989261" watchObservedRunningTime="2026-07-03 14:12:37.765320479 +0000 UTC m=+67.879142056" Jul 03 14:12:38.136153 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:38.136108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:38.136159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:38.136218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:38.136299 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:38.136336 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:38.136350 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f487b5f98-b84nr: secret "image-registry-tls" not found Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:38.136403 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls podName:dc353f9d-855e-4828-b3e9-8dc09ae85739 nodeName:}" failed. No retries permitted until 2026-07-03 14:13:10.136354381 +0000 UTC m=+100.250175935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls") pod "dns-default-pvzjl" (UID: "dc353f9d-855e-4828-b3e9-8dc09ae85739") : secret "dns-default-metrics-tls" not found Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:38.136426 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls podName:3d9b63d7-ed85-42dd-a810-2ad03a03504d nodeName:}" failed. No retries permitted until 2026-07-03 14:13:10.136415808 +0000 UTC m=+100.250237365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls") pod "image-registry-6f487b5f98-b84nr" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d") : secret "image-registry-tls" not found Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:38.136463 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 14:12:38.136641 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:38.136521 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls podName:eb522e24-0649-467e-b165-ecf4740df512 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:54.136501438 +0000 UTC m=+84.250323002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lc988" (UID: "eb522e24-0649-467e-b165-ecf4740df512") : secret "samples-operator-tls" not found Jul 03 14:12:38.880620 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:38.880582 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:38.985988 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:38.985946 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:39.104426 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:39.104389 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:39.199509 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:39.199417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:39.320084 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:39.320043 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:39.388784 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:39.388698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:39.665734 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:39.665699 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:40.280221 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:40.280175 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:40.491706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:40.491657 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:40.880735 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:40.880699 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:41.256742 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:41.256634 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:41.648686 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:41.648647 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:41.852706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:41.852668 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:42.259491 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:42.259393 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:42.359667 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:42.359589 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:42.651319 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:42.651284 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:42.744159 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:42.744127 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ln6k5" event={"ID":"6b1febaf-1350-48a6-b149-00f607eaaf3b","Type":"ContainerStarted","Data":"198cbd069d976150208af224f60d9da9cca164b74bfba96a27b255d75f77e77d"} Jul 03 14:12:42.761109 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:42.761052 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ln6k5" podStartSLOduration=66.829582391 podStartE2EDuration="1m11.761033202s" totalImagesPullingTime="4.931450811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:42.760149889 +0000 UTC m=+72.873971465" watchObservedRunningTime="2026-07-03 14:12:42.761033202 +0000 UTC m=+72.874854774" Jul 03 14:12:43.043778 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.043745 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:43.263843 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.263786 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:43.320190 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.320094 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:43.458468 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.458425 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:43.586335 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.586254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:43.586482 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.586356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:43.586524 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:43.586509 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 14:12:43.586581 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:43.586571 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls podName:6b314532-4b37-4f71-b32f-508436a20846 nodeName:}" failed. No retries permitted until 2026-07-03 14:12:59.58655623 +0000 UTC m=+89.700377781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swrwp" (UID: "6b314532-4b37-4f71-b32f-508436a20846") : secret "insights-runtime-extractor-tls" not found Jul 03 14:12:43.586822 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.586787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b314532-4b37-4f71-b32f-508436a20846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:43.851549 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.851450 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:43.951880 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:43.951838 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:44.068243 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:44.068209 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:44.256762 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:44.256668 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:44.457459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:44.457420 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:44.559184 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:44.559149 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:44.658926 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:44.658886 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:45.064759 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:45.064729 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:45.230677 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:45.230645 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:45.338391 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:45.338315 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:45.494889 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:45.494855 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:45.713732 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:45.713624 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:45.880648 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:45.880605 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:45.980931 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:45.980836 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:46.083976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:46.083935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:46.258745 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:46.258660 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:46.438609 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:46.438572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:46.535039 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:46.534939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:46.642923 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:46.642877 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:47.258581 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:47.258545 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:47.319190 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:47.319162 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:47.868256 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:47.868223 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:48.053242 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:48.053207 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:48.456162 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:48.456125 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:48.654662 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:48.654630 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:49.256427 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:49.256396 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:49.652849 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:49.652811 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:49.849934 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:49.849901 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:50.058593 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:50.058555 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:50.483504 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:50.483419 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:54.171377 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:54.171217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:54.173849 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:54.173821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb522e24-0649-467e-b165-ecf4740df512-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lc988\" (UID: \"eb522e24-0649-467e-b165-ecf4740df512\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:54.387740 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:54.387702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7sxvd\"" Jul 03 14:12:54.396019 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:54.395985 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" Jul 03 14:12:54.525327 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:54.525293 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988"] Jul 03 14:12:54.777125 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:54.777035 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" event={"ID":"eb522e24-0649-467e-b165-ecf4740df512","Type":"ContainerStarted","Data":"e7197cb196926e2cf049c1336a98085ac1efc35ba8be43092221feaa0b6c625c"} Jul 03 14:12:56.434378 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.434209 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-tb846"] Jul 03 14:12:56.437310 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.437290 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-tb846" Jul 03 14:12:56.440525 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.440493 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 03 14:12:56.440669 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.440526 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 03 14:12:56.440669 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.440547 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cbcfb\"" Jul 03 14:12:56.451151 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.451125 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-tb846"] Jul 03 14:12:56.489405 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.489368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszgx\" (UniqueName: \"kubernetes.io/projected/8bd73305-36c7-4dbe-97a8-e202d09f3936-kube-api-access-tszgx\") pod \"downloads-685bfb5f64-tb846\" (UID: \"8bd73305-36c7-4dbe-97a8-e202d09f3936\") " pod="openshift-console/downloads-685bfb5f64-tb846" Jul 03 14:12:56.571478 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.571433 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:56.589795 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.589761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszgx\" (UniqueName: \"kubernetes.io/projected/8bd73305-36c7-4dbe-97a8-e202d09f3936-kube-api-access-tszgx\") pod \"downloads-685bfb5f64-tb846\" (UID: \"8bd73305-36c7-4dbe-97a8-e202d09f3936\") " pod="openshift-console/downloads-685bfb5f64-tb846" Jul 03 14:12:56.601517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.601480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszgx\" (UniqueName: \"kubernetes.io/projected/8bd73305-36c7-4dbe-97a8-e202d09f3936-kube-api-access-tszgx\") pod \"downloads-685bfb5f64-tb846\" (UID: \"8bd73305-36c7-4dbe-97a8-e202d09f3936\") " pod="openshift-console/downloads-685bfb5f64-tb846" Jul 03 14:12:56.667177 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.667136 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:56.746185 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.746153 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-tb846" Jul 03 14:12:56.767244 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.767207 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:56.787408 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.786841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" event={"ID":"eb522e24-0649-467e-b165-ecf4740df512","Type":"ContainerStarted","Data":"25f4edc91e1d6013ace6009b25ce9de8c13411dd73f2e47118f7930bc3f4d3c8"} Jul 03 14:12:56.787408 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.787023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" event={"ID":"eb522e24-0649-467e-b165-ecf4740df512","Type":"ContainerStarted","Data":"9e5b4988d8bfae3cd17ee539fe042286d7ad6b5a66cda98a793f67ccef6a2003"} Jul 03 14:12:56.807353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.807153 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lc988" podStartSLOduration=33.101940201 podStartE2EDuration="34.807129958s" totalImagesPullingTime="1.705189757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:12:56.804490506 +0000 UTC m=+86.918312101" watchObservedRunningTime="2026-07-03 14:12:56.807129958 +0000 UTC m=+86.920951532" Jul 03 14:12:56.866391 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.866351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:56.880345 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:56.880319 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-tb846"] Jul 03 14:12:56.883712 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:12:56.883683 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd73305_36c7_4dbe_97a8_e202d09f3936.slice/crio-6591157de1f82900c2acad1681013b02d90fba144fe31db4369faa7b74fe4c30 WatchSource:0}: Error finding container 6591157de1f82900c2acad1681013b02d90fba144fe31db4369faa7b74fe4c30: Status 404 returned error can't find the container with id 6591157de1f82900c2acad1681013b02d90fba144fe31db4369faa7b74fe4c30 Jul 03 14:12:57.684454 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.684416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:57.784934 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.784885 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:57.792202 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.792167 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-tb846" event={"ID":"8bd73305-36c7-4dbe-97a8-e202d09f3936","Type":"ContainerStarted","Data":"6591157de1f82900c2acad1681013b02d90fba144fe31db4369faa7b74fe4c30"} Jul 03 14:12:57.874150 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.874106 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:57.877487 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.877460 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh"] Jul 03 14:12:57.880888 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.880865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" Jul 03 14:12:57.883573 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.883547 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 03 14:12:57.883708 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.883611 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2w9hj\"" Jul 03 14:12:57.888721 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:57.888690 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh"] Jul 03 14:12:58.001087 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.000996 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc0f0228-48d4-491e-a3fe-1d841e4bd21c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c5wsh\" (UID: \"cc0f0228-48d4-491e-a3fe-1d841e4bd21c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" Jul 03 14:12:58.102317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.102278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc0f0228-48d4-491e-a3fe-1d841e4bd21c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c5wsh\" (UID: \"cc0f0228-48d4-491e-a3fe-1d841e4bd21c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" Jul 03 14:12:58.102502 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:58.102417 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 03 14:12:58.102550 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:12:58.102512 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc0f0228-48d4-491e-a3fe-1d841e4bd21c-tls-certificates podName:cc0f0228-48d4-491e-a3fe-1d841e4bd21c nodeName:}" failed. No retries permitted until 2026-07-03 14:12:58.60248848 +0000 UTC m=+88.716310035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/cc0f0228-48d4-491e-a3fe-1d841e4bd21c-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-c5wsh" (UID: "cc0f0228-48d4-491e-a3fe-1d841e4bd21c") : secret "prometheus-operator-admission-webhook-tls" not found Jul 03 14:12:58.165270 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.165225 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:58.268300 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.268210 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:58.324547 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.324510 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:58.605519 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.605487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc0f0228-48d4-491e-a3fe-1d841e4bd21c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c5wsh\" (UID: \"cc0f0228-48d4-491e-a3fe-1d841e4bd21c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" Jul 03 14:12:58.608367 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.608343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc0f0228-48d4-491e-a3fe-1d841e4bd21c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c5wsh\" (UID: \"cc0f0228-48d4-491e-a3fe-1d841e4bd21c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" Jul 03 14:12:58.793291 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.793250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" Jul 03 14:12:58.940551 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.940517 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh"] Jul 03 14:12:58.941919 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:58.941886 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:58.945748 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:12:58.945720 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0f0228_48d4_491e_a3fe_1d841e4bd21c.slice/crio-fba55d3ba2bb33e9218cbf99d366f82ee346e519940a302673ca2601be8db70c WatchSource:0}: Error finding container fba55d3ba2bb33e9218cbf99d366f82ee346e519940a302673ca2601be8db70c: Status 404 returned error can't find the container with id fba55d3ba2bb33e9218cbf99d366f82ee346e519940a302673ca2601be8db70c Jul 03 14:12:59.042839 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:59.042789 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:12:59.615703 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:59.615668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:59.618469 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:59.618384 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b314532-4b37-4f71-b32f-508436a20846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swrwp\" (UID: \"6b314532-4b37-4f71-b32f-508436a20846\") " pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:12:59.802455 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:59.802423 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pz6z4\"" Jul 03 14:12:59.804541 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:59.804477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" event={"ID":"cc0f0228-48d4-491e-a3fe-1d841e4bd21c","Type":"ContainerStarted","Data":"fba55d3ba2bb33e9218cbf99d366f82ee346e519940a302673ca2601be8db70c"} Jul 03 14:12:59.810002 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:12:59.809979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swrwp" Jul 03 14:13:00.082528 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.082494 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swrwp"] Jul 03 14:13:00.085941 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:13:00.085904 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b314532_4b37_4f71_b32f_508436a20846.slice/crio-76044f0369eeae3a51c77bb000f203fc554ebd1edd2edc0c009b7e9a0d1a1151 WatchSource:0}: Error finding container 76044f0369eeae3a51c77bb000f203fc554ebd1edd2edc0c009b7e9a0d1a1151: Status 404 returned error can't find the container with id 76044f0369eeae3a51c77bb000f203fc554ebd1edd2edc0c009b7e9a0d1a1151 Jul 03 14:13:00.264830 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.264717 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:00.282020 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.281988 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6dcb5986-4nmrd"] Jul 03 14:13:00.285448 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.285425 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.288327 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.288305 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 03 14:13:00.288464 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.288387 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 03 14:13:00.288554 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.288541 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 03 14:13:00.288622 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.288608 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4q2ln\"" Jul 03 14:13:00.289284 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.289268 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 03 14:13:00.293256 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.289817 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 03 14:13:00.297135 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.297108 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6dcb5986-4nmrd"] Jul 03 14:13:00.398566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.398515 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:00.422432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.422389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zg6v\" (UniqueName: \"kubernetes.io/projected/4022fc39-f507-4062-a1ae-d814417cca28-kube-api-access-7zg6v\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.422623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.422453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-oauth-config\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.422623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.422479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-console-config\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.422623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.422514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-serving-cert\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.422623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.422552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-service-ca\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.422623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.422591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-oauth-serving-cert\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.523631 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.523543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-service-ca\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.523631 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.523601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-oauth-serving-cert\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.523890 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.523697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zg6v\" (UniqueName: \"kubernetes.io/projected/4022fc39-f507-4062-a1ae-d814417cca28-kube-api-access-7zg6v\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.523890 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.523736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-oauth-config\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.523890 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.523761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-console-config\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.523890 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.523794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-serving-cert\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.524404 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.524377 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-service-ca\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.524505 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.524377 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-oauth-serving-cert\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.524961 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.524934 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-console-config\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.527501 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.527476 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-oauth-config\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.528218 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.528192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-serving-cert\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.534612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.534580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zg6v\" (UniqueName: \"kubernetes.io/projected/4022fc39-f507-4062-a1ae-d814417cca28-kube-api-access-7zg6v\") pod \"console-6c6dcb5986-4nmrd\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.598882 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.598844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:00.791744 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.791704 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6dcb5986-4nmrd"] Jul 03 14:13:00.798967 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:13:00.798928 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4022fc39_f507_4062_a1ae_d814417cca28.slice/crio-c81cf1069461ac50ea2ccafed5e45351830ed467d80b10af379c92a24b37e0bc WatchSource:0}: Error finding container c81cf1069461ac50ea2ccafed5e45351830ed467d80b10af379c92a24b37e0bc: Status 404 returned error can't find the container with id c81cf1069461ac50ea2ccafed5e45351830ed467d80b10af379c92a24b37e0bc Jul 03 14:13:00.810871 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.810740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swrwp" event={"ID":"6b314532-4b37-4f71-b32f-508436a20846","Type":"ContainerStarted","Data":"76044f0369eeae3a51c77bb000f203fc554ebd1edd2edc0c009b7e9a0d1a1151"} Jul 03 14:13:00.815372 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.813174 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" event={"ID":"cc0f0228-48d4-491e-a3fe-1d841e4bd21c","Type":"ContainerStarted","Data":"b63834227055c0d5eafba2a5612bff7ca1d8251ffba78dcab0c0ae54243139d4"} Jul 03 14:13:00.815372 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.814224 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" Jul 03 14:13:00.815860 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.815831 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6dcb5986-4nmrd" event={"ID":"4022fc39-f507-4062-a1ae-d814417cca28","Type":"ContainerStarted","Data":"c81cf1069461ac50ea2ccafed5e45351830ed467d80b10af379c92a24b37e0bc"} Jul 03 14:13:00.820886 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.820841 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" Jul 03 14:13:00.839693 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:00.838890 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c5wsh" podStartSLOduration=2.8202651789999997 podStartE2EDuration="3.838864644s" totalImagesPullingTime="1.018599465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:00.838762964 +0000 UTC m=+90.952584539" watchObservedRunningTime="2026-07-03 14:13:00.838864644 +0000 UTC m=+90.952686219" Jul 03 14:13:01.860731 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.860696 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:01.951905 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.951868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:01.952081 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.951878 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6"] Jul 03 14:13:01.971889 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.971855 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6"] Jul 03 14:13:01.972064 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.971977 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:01.975248 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.975220 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 03 14:13:01.976241 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.976219 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 03 14:13:01.976973 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.976410 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tfn8z\"" Jul 03 14:13:01.976973 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.976452 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 03 14:13:01.976973 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.976604 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 03 14:13:01.976973 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:01.976709 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 03 14:13:02.038533 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.038492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wmq\" (UniqueName: \"kubernetes.io/projected/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-kube-api-access-k5wmq\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.038728 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.038543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.038728 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.038694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.038872 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.038747 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.140150 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.140053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.140320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.140140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.140320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.140256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wmq\" (UniqueName: \"kubernetes.io/projected/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-kube-api-access-k5wmq\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.140320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.140285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.140320 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:13:02.140303 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 03 14:13:02.140592 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:13:02.140379 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-tls podName:2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c nodeName:}" failed. No retries permitted until 2026-07-03 14:13:02.640360171 +0000 UTC m=+92.754181748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-9rxn6" (UID: "2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c") : secret "prometheus-operator-tls" not found Jul 03 14:13:02.141092 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.141018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.146245 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.146069 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.154602 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.154537 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wmq\" (UniqueName: \"kubernetes.io/projected/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-kube-api-access-k5wmq\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.332585 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.332547 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:02.643838 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.643771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.648179 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.648123 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9rxn6\" (UID: \"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:02.884292 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:02.884259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" Jul 03 14:13:03.710564 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:03.710516 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:03.794187 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:03.794135 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:04.099542 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:04.099506 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:04.210843 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:04.210782 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:06.092959 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:06.092875 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6"] Jul 03 14:13:06.097612 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:13:06.097504 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8d4401_f6bb_4c7b_bcda_db4ba0c6249c.slice/crio-fed7bd8f0973ae525cb88c37ba2366713c77f420c402cfeeca0450760dd74ba1 WatchSource:0}: Error finding container fed7bd8f0973ae525cb88c37ba2366713c77f420c402cfeeca0450760dd74ba1: Status 404 returned error can't find the container with id fed7bd8f0973ae525cb88c37ba2366713c77f420c402cfeeca0450760dd74ba1 Jul 03 14:13:06.845272 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:06.845242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swrwp" event={"ID":"6b314532-4b37-4f71-b32f-508436a20846","Type":"ContainerStarted","Data":"c1d37319bde2adce538a9f7dc7c5b9b37771bc0524ee84716585dd4f1fd3ac79"} Jul 03 14:13:06.847099 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:06.847066 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6dcb5986-4nmrd" event={"ID":"4022fc39-f507-4062-a1ae-d814417cca28","Type":"ContainerStarted","Data":"b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593"} Jul 03 14:13:06.848485 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:06.848458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" event={"ID":"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c","Type":"ContainerStarted","Data":"fed7bd8f0973ae525cb88c37ba2366713c77f420c402cfeeca0450760dd74ba1"} Jul 03 14:13:06.866096 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:06.866040 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6dcb5986-4nmrd" podStartSLOduration=1.727256395 podStartE2EDuration="6.866019663s" totalImagesPullingTime="5.138763268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:06.86548004 +0000 UTC m=+96.979301614" watchObservedRunningTime="2026-07-03 14:13:06.866019663 +0000 UTC m=+96.979841237" Jul 03 14:13:07.054451 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:07.054345 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:07.855265 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:07.855223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swrwp" event={"ID":"6b314532-4b37-4f71-b32f-508436a20846","Type":"ContainerStarted","Data":"88d3351403b1d03ebf5aed0f0f060dabd3ab4645c6c2b6cddba34f9b67d58b52"} Jul 03 14:13:08.733923 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:08.733888 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qtwnz" Jul 03 14:13:10.215346 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.215304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:13:10.215346 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.215360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:13:10.217852 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.217820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc353f9d-855e-4828-b3e9-8dc09ae85739-metrics-tls\") pod \"dns-default-pvzjl\" (UID: \"dc353f9d-855e-4828-b3e9-8dc09ae85739\") " pod="openshift-dns/dns-default-pvzjl" Jul 03 14:13:10.218024 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.218004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"image-registry-6f487b5f98-b84nr\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:13:10.496721 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.496637 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bkp7q\"" Jul 03 14:13:10.503930 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.503903 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:13:10.518183 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.518153 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xht5n\"" Jul 03 14:13:10.525336 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.525295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pvzjl" Jul 03 14:13:10.599612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.599577 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:10.599818 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.599637 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:10.605099 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.605075 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:10.694473 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.694437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:10.746918 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.746821 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:10.872601 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:10.872570 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:12.256361 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:12.256314 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:12.315836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:12.315784 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:13.456962 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:13.456904 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:13.530725 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:13.530687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:14.926020 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:14.925986 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6dcb5986-4nmrd"] Jul 03 14:13:15.081705 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:15.081672 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:15.148006 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:15.147963 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:15.659991 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:15.659953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:15.729670 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:15.729627 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:16.502258 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.502226 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f487b5f98-b84nr"] Jul 03 14:13:16.506792 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:13:16.506764 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9b63d7_ed85_42dd_a810_2ad03a03504d.slice/crio-36b82d38e4cf13e49bfc7ef606d260d0f676fa1060fca2288f6b931d9645ebd5 WatchSource:0}: Error finding container 36b82d38e4cf13e49bfc7ef606d260d0f676fa1060fca2288f6b931d9645ebd5: Status 404 returned error can't find the container with id 36b82d38e4cf13e49bfc7ef606d260d0f676fa1060fca2288f6b931d9645ebd5 Jul 03 14:13:16.516842 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.516772 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pvzjl"] Jul 03 14:13:16.521402 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:13:16.521370 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc353f9d_855e_4828_b3e9_8dc09ae85739.slice/crio-3cd4acd502015da943070bc80f309840a534a53dc65b34cc1ef8ba0149ed383a WatchSource:0}: Error finding container 3cd4acd502015da943070bc80f309840a534a53dc65b34cc1ef8ba0149ed383a: Status 404 returned error can't find the container with id 3cd4acd502015da943070bc80f309840a534a53dc65b34cc1ef8ba0149ed383a Jul 03 14:13:16.643343 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.643297 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:16.748176 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.748139 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:16.892588 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.892497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-tb846" event={"ID":"8bd73305-36c7-4dbe-97a8-e202d09f3936","Type":"ContainerStarted","Data":"f4c7715e777bea0370aeefe5499470b4439c66f48dc066a34928270f011dbd49"} Jul 03 14:13:16.892894 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.892866 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-tb846" Jul 03 14:13:16.895455 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.895426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swrwp" event={"ID":"6b314532-4b37-4f71-b32f-508436a20846","Type":"ContainerStarted","Data":"6d0625021d8c7d97230e179d39b8ea1a94fc8afd747aa289397c6f5958447a39"} Jul 03 14:13:16.896685 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.896660 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvzjl" event={"ID":"dc353f9d-855e-4828-b3e9-8dc09ae85739","Type":"ContainerStarted","Data":"3cd4acd502015da943070bc80f309840a534a53dc65b34cc1ef8ba0149ed383a"} Jul 03 14:13:16.898512 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.898486 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" event={"ID":"3d9b63d7-ed85-42dd-a810-2ad03a03504d","Type":"ContainerStarted","Data":"146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3"} Jul 03 14:13:16.898624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.898567 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" event={"ID":"3d9b63d7-ed85-42dd-a810-2ad03a03504d","Type":"ContainerStarted","Data":"36b82d38e4cf13e49bfc7ef606d260d0f676fa1060fca2288f6b931d9645ebd5"} Jul 03 14:13:16.898688 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.898628 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:13:16.905093 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.905054 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" event={"ID":"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c","Type":"ContainerStarted","Data":"aa84994a4e89eb05c75c99e00e70dbf3e8da03f2a0df87440870874219bcf957"} Jul 03 14:13:16.905233 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.905144 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" event={"ID":"2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c","Type":"ContainerStarted","Data":"8f537dfe14ebf99804413cb14e28897983506310cbbff5fe6420364a535ca11b"} Jul 03 14:13:16.908297 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.908275 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-tb846" Jul 03 14:13:16.931453 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.931388 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-tb846" podStartSLOduration=1.433965357 podStartE2EDuration="20.931367014s" totalImagesPullingTime="19.497401657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:16.911581591 +0000 UTC m=+107.025403190" watchObservedRunningTime="2026-07-03 14:13:16.931367014 +0000 UTC m=+107.045188588" Jul 03 14:13:16.932425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.932370 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" podStartSLOduration=105.932354386 podStartE2EDuration="1m45.932354386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:16.93115588 +0000 UTC m=+107.044977454" watchObservedRunningTime="2026-07-03 14:13:16.932354386 +0000 UTC m=+107.046175959" Jul 03 14:13:16.966141 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.965892 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9rxn6" podStartSLOduration=5.73256432 podStartE2EDuration="15.965868374s" totalImagesPullingTime="10.233304054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:16.96497281 +0000 UTC m=+107.078794383" watchObservedRunningTime="2026-07-03 14:13:16.965868374 +0000 UTC m=+107.079689951" Jul 03 14:13:16.985313 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:16.985262 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-swrwp" podStartSLOduration=33.893834196 podStartE2EDuration="49.985242896s" totalImagesPullingTime="16.0914087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:12:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:16.984114036 +0000 UTC m=+107.097935614" watchObservedRunningTime="2026-07-03 14:13:16.985242896 +0000 UTC m=+107.099064484" Jul 03 14:13:19.098367 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.098292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:19.274957 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.274912 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:19.341894 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.340451 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9grgn"] Jul 03 14:13:19.365879 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.365755 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:19.372669 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.372641 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.377913 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.377084 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 03 14:13:19.377913 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.377350 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l7pjz\"" Jul 03 14:13:19.377913 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.377516 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 03 14:13:19.377913 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.377709 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 03 14:13:19.456786 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.456745 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:19.500788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.500747 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-sys\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.501001 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.500831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-textfile\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.501001 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.500864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nsfg\" (UniqueName: \"kubernetes.io/projected/f043d7b1-832c-4ba2-b339-81aca5d6e6af-kube-api-access-9nsfg\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.501001 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.500899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-accelerators-collector-config\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.501001 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.500941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.501205 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.501004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-tls\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.501205 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.501040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-wtmp\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.501205 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.501095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-root\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.501205 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.501127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f043d7b1-832c-4ba2-b339-81aca5d6e6af-metrics-client-ca\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.561373 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.561337 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:19.602561 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-root\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.602836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f043d7b1-832c-4ba2-b339-81aca5d6e6af-metrics-client-ca\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.602836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-sys\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.602836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-textfile\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.602836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nsfg\" (UniqueName: \"kubernetes.io/projected/f043d7b1-832c-4ba2-b339-81aca5d6e6af-kube-api-access-9nsfg\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.602836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-sys\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.602836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602684 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-accelerators-collector-config\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.602836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602632 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-root\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.603215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.602985 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-textfile\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.603215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.603057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.603215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.603105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-tls\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.603215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.603148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-wtmp\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.603430 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.603350 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-wtmp\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.603430 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.603381 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-accelerators-collector-config\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.603537 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:13:19.603493 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 03 14:13:19.603591 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:13:19.603556 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-tls podName:f043d7b1-832c-4ba2-b339-81aca5d6e6af nodeName:}" failed. No retries permitted until 2026-07-03 14:13:20.103536033 +0000 UTC m=+110.217357598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-tls") pod "node-exporter-9grgn" (UID: "f043d7b1-832c-4ba2-b339-81aca5d6e6af") : secret "node-exporter-tls" not found Jul 03 14:13:19.603657 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.603611 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f043d7b1-832c-4ba2-b339-81aca5d6e6af-metrics-client-ca\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.606201 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.606171 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.625585 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.625549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nsfg\" (UniqueName: \"kubernetes.io/projected/f043d7b1-832c-4ba2-b339-81aca5d6e6af-kube-api-access-9nsfg\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:19.657706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.657616 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f487b5f98-b84nr"] Jul 03 14:13:19.699518 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.699480 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:19.787664 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.787621 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:19.878215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.878174 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:19.924515 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.924416 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvzjl" event={"ID":"dc353f9d-855e-4828-b3e9-8dc09ae85739","Type":"ContainerStarted","Data":"1823a8628e74e931b123a9affc3b033517ad0be27bd55ea00a6506d0abf204d0"} Jul 03 14:13:19.924515 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.924516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvzjl" event={"ID":"dc353f9d-855e-4828-b3e9-8dc09ae85739","Type":"ContainerStarted","Data":"5141690b83bbd1fed938ef9364f2a06fe8a7b2257f17220e7775b3e49fedf479"} Jul 03 14:13:19.924745 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.924547 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pvzjl" Jul 03 14:13:19.944131 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:19.944059 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pvzjl" podStartSLOduration=71.616806524 podStartE2EDuration="1m13.944035878s" totalImagesPullingTime="2.327229354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:19.943271609 +0000 UTC m=+110.057093183" watchObservedRunningTime="2026-07-03 14:13:19.944035878 +0000 UTC m=+110.057857453" Jul 03 14:13:20.108563 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.108514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-tls\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:20.111443 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.111405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f043d7b1-832c-4ba2-b339-81aca5d6e6af-node-exporter-tls\") pod \"node-exporter-9grgn\" (UID: \"f043d7b1-832c-4ba2-b339-81aca5d6e6af\") " pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:20.284475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.284357 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:20.290619 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.290588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9grgn" Jul 03 14:13:20.334661 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:13:20.334627 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf043d7b1_832c_4ba2_b339_81aca5d6e6af.slice/crio-700be5cffbc36a46878493aabe4e2ed05a3d3abd20b63bf337e7662c206dbbfa WatchSource:0}: Error finding container 700be5cffbc36a46878493aabe4e2ed05a3d3abd20b63bf337e7662c206dbbfa: Status 404 returned error can't find the container with id 700be5cffbc36a46878493aabe4e2ed05a3d3abd20b63bf337e7662c206dbbfa Jul 03 14:13:20.376678 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.376643 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:13:20.381583 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.381532 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:20.406726 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.404654 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:13:20.406726 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.404796 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.408251 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.408229 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 14:13:20.408651 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.408627 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 14:13:20.408912 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.408895 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j25tn\"" Jul 03 14:13:20.409013 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.408927 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 14:13:20.409118 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.409103 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 14:13:20.409187 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.409160 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 14:13:20.409317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.409302 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 14:13:20.409484 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.409428 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 14:13:20.409758 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.409737 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 14:13:20.409869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.409465 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 14:13:20.487510 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.487476 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:20.511317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crk4q\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-kube-api-access-crk4q\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511539 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511539 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511539 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511539 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-out\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511539 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-web-config\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.511788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.511744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613180 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613375 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613375 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613484 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613406 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-out\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613484 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-web-config\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613484 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613468 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613956 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613956 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.613956 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crk4q\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-kube-api-access-crk4q\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.614099 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.613984 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.614761 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.614730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.615687 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.615658 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.616652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.616204 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-out\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.616652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.616608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.617823 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.617572 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.618033 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.617941 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-web-config\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.618033 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.617957 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.618197 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.618147 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.618325 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.618296 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.619109 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.619085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.619513 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.619437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.624294 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.624272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crk4q\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-kube-api-access-crk4q\") pod \"alertmanager-main-0\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.628149 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.628105 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:20.715607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.715574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:20.718395 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.718371 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:13:20.924984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.924931 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:13:20.927940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:13:20.927906 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4b45ba_d59d_441f_8ff5_4df599b81c63.slice/crio-3ba2f87b7666da695bb2905cdb18c73185f3af93b8d7656a25fa6c581efeca7e WatchSource:0}: Error finding container 3ba2f87b7666da695bb2905cdb18c73185f3af93b8d7656a25fa6c581efeca7e: Status 404 returned error can't find the container with id 3ba2f87b7666da695bb2905cdb18c73185f3af93b8d7656a25fa6c581efeca7e Jul 03 14:13:20.932924 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:20.932835 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9grgn" event={"ID":"f043d7b1-832c-4ba2-b339-81aca5d6e6af","Type":"ContainerStarted","Data":"700be5cffbc36a46878493aabe4e2ed05a3d3abd20b63bf337e7662c206dbbfa"} Jul 03 14:13:21.939095 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:21.939051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9grgn" event={"ID":"f043d7b1-832c-4ba2-b339-81aca5d6e6af","Type":"ContainerStarted","Data":"25ec4d1ce64fc3c009064575b2aaf259e3b22380ae668f0a499a7ad0f4119b3a"} Jul 03 14:13:21.940564 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:21.940533 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerStarted","Data":"3ba2f87b7666da695bb2905cdb18c73185f3af93b8d7656a25fa6c581efeca7e"} Jul 03 14:13:22.246731 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:22.246691 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:22.347984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:22.347919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:22.447520 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:22.447486 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:22.806830 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:22.806719 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:22.949493 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:22.949464 2574 generic.go:356] "Generic (PLEG): container finished" podID="f043d7b1-832c-4ba2-b339-81aca5d6e6af" containerID="25ec4d1ce64fc3c009064575b2aaf259e3b22380ae668f0a499a7ad0f4119b3a" exitCode=0 Jul 03 14:13:22.949947 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:22.949541 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9grgn" event={"ID":"f043d7b1-832c-4ba2-b339-81aca5d6e6af","Type":"ContainerDied","Data":"25ec4d1ce64fc3c009064575b2aaf259e3b22380ae668f0a499a7ad0f4119b3a"} Jul 03 14:13:23.957187 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:23.956912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9grgn" event={"ID":"f043d7b1-832c-4ba2-b339-81aca5d6e6af","Type":"ContainerStarted","Data":"009ec09bcc42a67b306771e8ac4d78acbf1edf8bc30c67a62e3251f53df908ff"} Jul 03 14:13:23.957187 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:23.956977 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9grgn" event={"ID":"f043d7b1-832c-4ba2-b339-81aca5d6e6af","Type":"ContainerStarted","Data":"8476b42882f01b2ff7eb98b56b61cec94d86365cbef8b43507493df5572d780d"} Jul 03 14:13:23.958833 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:23.958785 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerID="218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842" exitCode=0 Jul 03 14:13:23.958964 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:23.958848 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerDied","Data":"218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842"} Jul 03 14:13:23.978402 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:23.978346 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9grgn" podStartSLOduration=3.441531016 podStartE2EDuration="4.97832662s" totalImagesPullingTime="1.426360651s" totalInitContainerRuntime="110.434953ms" isStatefulPod=true podCreationTimestamp="2026-07-03 14:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:23.976119116 +0000 UTC m=+114.089940694" watchObservedRunningTime="2026-07-03 14:13:23.97832662 +0000 UTC m=+114.092148192" Jul 03 14:13:24.108236 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:24.108197 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:24.236013 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:24.235927 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:24.330647 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:24.330613 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:24.430559 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:24.430522 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:25.701657 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:25.701616 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:26.160787 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:26.160748 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:26.260329 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:26.260282 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:26.975116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:26.975029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerStarted","Data":"74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc"} Jul 03 14:13:26.975116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:26.975102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerStarted","Data":"d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e"} Jul 03 14:13:26.975571 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:26.975129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerStarted","Data":"3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba"} Jul 03 14:13:26.975571 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:26.975154 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerStarted","Data":"7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece"} Jul 03 14:13:26.975571 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:26.975177 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerStarted","Data":"e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836"} Jul 03 14:13:27.982151 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:27.982111 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerStarted","Data":"099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5"} Jul 03 14:13:28.010339 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:28.010274 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.82065615 podStartE2EDuration="8.010249253s" totalImagesPullingTime="5.163001885s" totalInitContainerRuntime="26.591218ms" isStatefulPod=false podCreationTimestamp="2026-07-03 14:13:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:28.008729393 +0000 UTC m=+118.122550967" watchObservedRunningTime="2026-07-03 14:13:28.010249253 +0000 UTC m=+118.124070829" Jul 03 14:13:28.262088 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:28.262034 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:28.362556 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:28.362513 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:28.775451 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:28.775413 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:28.883524 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:28.883485 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:29.935258 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:29.935223 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pvzjl" Jul 03 14:13:31.020767 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:31.020723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:33.845558 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:33.845520 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:33.900516 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:33.900481 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:35.145297 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:35.145260 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:35.246343 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:35.246294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:35.303305 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:35.303271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:39.088404 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:39.088368 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:39.181455 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:39.181416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:39.664102 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:39.664076 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:13:39.946067 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:39.945966 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c6dcb5986-4nmrd" podUID="4022fc39-f507-4062-a1ae-d814417cca28" containerName="console" containerID="cri-o://b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593" gracePeriod=15 Jul 03 14:13:40.187952 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.187856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:13:40.190337 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.190311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6489d734-92c8-46a1-a4cb-c7544e4cde59-metrics-certs\") pod \"network-metrics-daemon-7hk5x\" (UID: \"6489d734-92c8-46a1-a4cb-c7544e4cde59\") " pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:13:40.233820 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.233770 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:40.268333 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.268307 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kg466\"" Jul 03 14:13:40.276840 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.276818 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hk5x" Jul 03 14:13:40.288286 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.288259 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-serving-cert\") pod \"4022fc39-f507-4062-a1ae-d814417cca28\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " Jul 03 14:13:40.288439 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.288304 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-oauth-serving-cert\") pod \"4022fc39-f507-4062-a1ae-d814417cca28\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " Jul 03 14:13:40.288439 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.288347 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zg6v\" (UniqueName: \"kubernetes.io/projected/4022fc39-f507-4062-a1ae-d814417cca28-kube-api-access-7zg6v\") pod \"4022fc39-f507-4062-a1ae-d814417cca28\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " Jul 03 14:13:40.288439 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.288379 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-service-ca\") pod \"4022fc39-f507-4062-a1ae-d814417cca28\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " Jul 03 14:13:40.288439 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.288427 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-console-config\") pod \"4022fc39-f507-4062-a1ae-d814417cca28\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " Jul 03 14:13:40.288644 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.288464 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-oauth-config\") pod \"4022fc39-f507-4062-a1ae-d814417cca28\" (UID: \"4022fc39-f507-4062-a1ae-d814417cca28\") " Jul 03 14:13:40.289028 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.288689 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4022fc39-f507-4062-a1ae-d814417cca28" (UID: "4022fc39-f507-4062-a1ae-d814417cca28"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:13:40.290911 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.289281 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-service-ca" (OuterVolumeSpecName: "service-ca") pod "4022fc39-f507-4062-a1ae-d814417cca28" (UID: "4022fc39-f507-4062-a1ae-d814417cca28"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:13:40.290911 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.289505 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-console-config" (OuterVolumeSpecName: "console-config") pod "4022fc39-f507-4062-a1ae-d814417cca28" (UID: "4022fc39-f507-4062-a1ae-d814417cca28"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:13:40.295018 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.291496 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4022fc39-f507-4062-a1ae-d814417cca28" (UID: "4022fc39-f507-4062-a1ae-d814417cca28"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:13:40.295018 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.291743 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4022fc39-f507-4062-a1ae-d814417cca28-kube-api-access-7zg6v" (OuterVolumeSpecName: "kube-api-access-7zg6v") pod "4022fc39-f507-4062-a1ae-d814417cca28" (UID: "4022fc39-f507-4062-a1ae-d814417cca28"). InnerVolumeSpecName "kube-api-access-7zg6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:13:40.295371 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.295295 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4022fc39-f507-4062-a1ae-d814417cca28" (UID: "4022fc39-f507-4062-a1ae-d814417cca28"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:13:40.389241 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.389213 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-serving-cert\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:40.389241 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.389238 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-oauth-serving-cert\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:40.389241 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.389247 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zg6v\" (UniqueName: \"kubernetes.io/projected/4022fc39-f507-4062-a1ae-d814417cca28-kube-api-access-7zg6v\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:40.389501 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.389257 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-service-ca\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:40.389501 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.389267 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4022fc39-f507-4062-a1ae-d814417cca28-console-config\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:40.389501 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.389274 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4022fc39-f507-4062-a1ae-d814417cca28-console-oauth-config\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:40.424838 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:40.424790 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7hk5x"] Jul 03 14:13:40.427648 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:13:40.427625 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6489d734_92c8_46a1_a4cb_c7544e4cde59.slice/crio-564d0cda65dd7dcae02aef04287a369e8e5cbaa6905f8c69e4a02c91f2fd9e6d WatchSource:0}: Error finding container 564d0cda65dd7dcae02aef04287a369e8e5cbaa6905f8c69e4a02c91f2fd9e6d: Status 404 returned error can't find the container with id 564d0cda65dd7dcae02aef04287a369e8e5cbaa6905f8c69e4a02c91f2fd9e6d Jul 03 14:13:41.034032 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.033983 2574 generic.go:356] "Generic (PLEG): container finished" podID="4022fc39-f507-4062-a1ae-d814417cca28" containerID="b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593" exitCode=0 Jul 03 14:13:41.034310 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.034046 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6dcb5986-4nmrd" Jul 03 14:13:41.034310 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.034072 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6dcb5986-4nmrd" event={"ID":"4022fc39-f507-4062-a1ae-d814417cca28","Type":"ContainerDied","Data":"b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593"} Jul 03 14:13:41.034310 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.034132 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6dcb5986-4nmrd" event={"ID":"4022fc39-f507-4062-a1ae-d814417cca28","Type":"ContainerDied","Data":"c81cf1069461ac50ea2ccafed5e45351830ed467d80b10af379c92a24b37e0bc"} Jul 03 14:13:41.034310 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.034163 2574 scope.go:117] "RemoveContainer" containerID="b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593" Jul 03 14:13:41.035968 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.035648 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hk5x" event={"ID":"6489d734-92c8-46a1-a4cb-c7544e4cde59","Type":"ContainerStarted","Data":"564d0cda65dd7dcae02aef04287a369e8e5cbaa6905f8c69e4a02c91f2fd9e6d"} Jul 03 14:13:41.043842 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.043821 2574 scope.go:117] "RemoveContainer" containerID="b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593" Jul 03 14:13:41.044191 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:13:41.044162 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593\": container with ID starting with b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593 not found: ID does not exist" containerID="b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593" Jul 03 14:13:41.044256 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.044201 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593"} err="failed to get container status \"b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593\": rpc error: code = NotFound desc = could not find container \"b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593\": container with ID starting with b787c90df488610081c1c601587bb4e4b895450b45d99d24e9c5bf361a91e593 not found: ID does not exist" Jul 03 14:13:41.053787 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.053761 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6dcb5986-4nmrd"] Jul 03 14:13:41.058735 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:41.058713 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c6dcb5986-4nmrd"] Jul 03 14:13:42.042369 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:42.042340 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hk5x" event={"ID":"6489d734-92c8-46a1-a4cb-c7544e4cde59","Type":"ContainerStarted","Data":"ec807f8de290ca6a90aa57fafcb78cf36732c330f6fb00c3bfea766ab2fa181c"} Jul 03 14:13:42.042858 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:42.042402 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hk5x" event={"ID":"6489d734-92c8-46a1-a4cb-c7544e4cde59","Type":"ContainerStarted","Data":"dfe5456eb6bb7ec136ff6b3099f84cb53cd013f91ac4959d65058e2a158750d6"} Jul 03 14:13:42.060057 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:42.060006 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7hk5x" podStartSLOduration=129.653044062 podStartE2EDuration="2m11.059988057s" totalImagesPullingTime="1.406943995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:13:42.059947273 +0000 UTC m=+132.173768848" watchObservedRunningTime="2026-07-03 14:13:42.059988057 +0000 UTC m=+132.173809629" Jul 03 14:13:42.177883 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:42.177766 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:42.239508 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:42.239473 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:42.359258 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:42.359224 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4022fc39-f507-4062-a1ae-d814417cca28" path="/var/lib/kubelet/pods/4022fc39-f507-4062-a1ae-d814417cca28/volumes" Jul 03 14:13:43.039338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:43.039299 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:43.139522 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:43.139485 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:43.204058 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:43.204023 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:44.682284 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:44.682245 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" podUID="3d9b63d7-ed85-42dd-a810-2ad03a03504d" containerName="registry" containerID="cri-o://146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3" gracePeriod=30 Jul 03 14:13:44.933240 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:44.933178 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:13:45.024747 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.024715 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-certificates\") pod \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " Jul 03 14:13:45.024950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.024770 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-installation-pull-secrets\") pod \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " Jul 03 14:13:45.024950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.024816 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-image-registry-private-configuration\") pod \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " Jul 03 14:13:45.024950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.024845 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfnmx\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-kube-api-access-cfnmx\") pod \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " Jul 03 14:13:45.024950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.024880 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d9b63d7-ed85-42dd-a810-2ad03a03504d-ca-trust-extracted\") pod \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " Jul 03 14:13:45.024950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.024901 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-bound-sa-token\") pod \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " Jul 03 14:13:45.024950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.024942 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-trusted-ca\") pod \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " Jul 03 14:13:45.025267 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.024970 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") pod \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\" (UID: \"3d9b63d7-ed85-42dd-a810-2ad03a03504d\") " Jul 03 14:13:45.025267 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.025207 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3d9b63d7-ed85-42dd-a810-2ad03a03504d" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:13:45.025566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.025540 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3d9b63d7-ed85-42dd-a810-2ad03a03504d" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:13:45.027772 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.027743 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3d9b63d7-ed85-42dd-a810-2ad03a03504d" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:13:45.028017 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.027835 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3d9b63d7-ed85-42dd-a810-2ad03a03504d" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:13:45.028017 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.027859 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3d9b63d7-ed85-42dd-a810-2ad03a03504d" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:13:45.028017 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.027978 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3d9b63d7-ed85-42dd-a810-2ad03a03504d" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:13:45.028017 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.027994 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-kube-api-access-cfnmx" (OuterVolumeSpecName: "kube-api-access-cfnmx") pod "3d9b63d7-ed85-42dd-a810-2ad03a03504d" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d"). InnerVolumeSpecName "kube-api-access-cfnmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:13:45.034664 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.034630 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d9b63d7-ed85-42dd-a810-2ad03a03504d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3d9b63d7-ed85-42dd-a810-2ad03a03504d" (UID: "3d9b63d7-ed85-42dd-a810-2ad03a03504d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:13:45.056315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.056275 2574 generic.go:356] "Generic (PLEG): container finished" podID="3d9b63d7-ed85-42dd-a810-2ad03a03504d" containerID="146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3" exitCode=0 Jul 03 14:13:45.056496 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.056332 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" Jul 03 14:13:45.056496 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.056350 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" event={"ID":"3d9b63d7-ed85-42dd-a810-2ad03a03504d","Type":"ContainerDied","Data":"146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3"} Jul 03 14:13:45.056496 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.056399 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f487b5f98-b84nr" event={"ID":"3d9b63d7-ed85-42dd-a810-2ad03a03504d","Type":"ContainerDied","Data":"36b82d38e4cf13e49bfc7ef606d260d0f676fa1060fca2288f6b931d9645ebd5"} Jul 03 14:13:45.056496 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.056420 2574 scope.go:117] "RemoveContainer" containerID="146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3" Jul 03 14:13:45.065265 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.065241 2574 scope.go:117] "RemoveContainer" containerID="146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3" Jul 03 14:13:45.065553 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:13:45.065532 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3\": container with ID starting with 146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3 not found: ID does not exist" containerID="146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3" Jul 03 14:13:45.065604 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.065562 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3"} err="failed to get container status \"146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3\": rpc error: code = NotFound desc = could not find container \"146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3\": container with ID starting with 146e56c929336494eae4eec7a0b272605ef5c7a4dfd2145ad43e48a89a8be5c3 not found: ID does not exist" Jul 03 14:13:45.088718 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.088688 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f487b5f98-b84nr"] Jul 03 14:13:45.103099 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.103064 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f487b5f98-b84nr"] Jul 03 14:13:45.126052 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.126023 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-trusted-ca\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:45.126052 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.126049 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-tls\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:45.126234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.126059 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d9b63d7-ed85-42dd-a810-2ad03a03504d-registry-certificates\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:45.126234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.126070 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-installation-pull-secrets\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:45.126234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.126080 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d9b63d7-ed85-42dd-a810-2ad03a03504d-image-registry-private-configuration\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:45.126234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.126088 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfnmx\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-kube-api-access-cfnmx\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:45.126234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.126097 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d9b63d7-ed85-42dd-a810-2ad03a03504d-ca-trust-extracted\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:45.126234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:45.126105 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d9b63d7-ed85-42dd-a810-2ad03a03504d-bound-sa-token\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:13:46.357786 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:46.357753 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d9b63d7-ed85-42dd-a810-2ad03a03504d" path="/var/lib/kubelet/pods/3d9b63d7-ed85-42dd-a810-2ad03a03504d/volumes" Jul 03 14:13:49.916739 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:49.916703 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:49.985193 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:49.985157 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:58.256509 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:58.256474 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:13:58.325700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:13:58.325668 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:33.218978 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:33.218936 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:38.696423 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:38.696388 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:38.898412 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:38.898367 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:39.734109 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:39.734074 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:14:39.734527 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:39.734426 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="alertmanager" containerID="cri-o://e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836" gracePeriod=120 Jul 03 14:14:39.734527 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:39.734474 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy-metric" containerID="cri-o://74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc" gracePeriod=120 Jul 03 14:14:39.734527 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:39.734494 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy-web" containerID="cri-o://3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba" gracePeriod=120 Jul 03 14:14:39.734696 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:39.734517 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy" containerID="cri-o://d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e" gracePeriod=120 Jul 03 14:14:39.734696 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:39.734587 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="prom-label-proxy" containerID="cri-o://099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5" gracePeriod=120 Jul 03 14:14:39.734696 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:39.734509 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="config-reloader" containerID="cri-o://7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece" gracePeriod=120 Jul 03 14:14:40.263063 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263022 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerID="099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5" exitCode=0 Jul 03 14:14:40.263063 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263049 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerID="74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc" exitCode=0 Jul 03 14:14:40.263063 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263056 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerID="d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e" exitCode=0 Jul 03 14:14:40.263063 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263063 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerID="7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece" exitCode=0 Jul 03 14:14:40.263063 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263068 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerID="e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836" exitCode=0 Jul 03 14:14:40.263421 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerDied","Data":"099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5"} Jul 03 14:14:40.263421 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263172 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerDied","Data":"74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc"} Jul 03 14:14:40.263421 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263212 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerDied","Data":"d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e"} Jul 03 14:14:40.263421 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerDied","Data":"7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece"} Jul 03 14:14:40.263421 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.263284 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerDied","Data":"e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836"} Jul 03 14:14:40.983128 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:40.983100 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.046743 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.046643 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.046936 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.046773 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-trusted-ca-bundle\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.046936 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.046835 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-web-config\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.046936 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.046870 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.046936 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.046897 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-cluster-tls-config\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.046936 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.046929 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crk4q\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-kube-api-access-crk4q\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.047212 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.046953 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-out\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.047212 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.046976 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-volume\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.047212 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047018 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-metrics-client-ca\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.047212 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047061 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.047212 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047089 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-main-tls\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.047212 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047120 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-tls-assets\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.047212 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047156 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-main-db\") pod \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\" (UID: \"8c4b45ba-d59d-441f-8ff5-4df599b81c63\") " Jul 03 14:14:41.047212 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047192 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:14:41.047591 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047355 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.047647 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047596 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:14:41.047853 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.047787 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:14:41.050891 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.050845 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-out" (OuterVolumeSpecName: "config-out") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:14:41.051289 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.051259 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:14:41.051414 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.051300 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:14:41.051533 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.051482 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:14:41.051612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.051554 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:14:41.053220 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.053195 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-kube-api-access-crk4q" (OuterVolumeSpecName: "kube-api-access-crk4q") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "kube-api-access-crk4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:14:41.053220 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.053206 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-volume" (OuterVolumeSpecName: "config-volume") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:14:41.053394 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.053339 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:14:41.054980 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.054868 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:14:41.062242 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.062043 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-web-config" (OuterVolumeSpecName: "web-config") pod "8c4b45ba-d59d-441f-8ff5-4df599b81c63" (UID: "8c4b45ba-d59d-441f-8ff5-4df599b81c63"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:14:41.148390 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148345 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148390 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148377 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-web-config\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148390 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148392 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148390 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148405 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-cluster-tls-config\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148671 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148419 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crk4q\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-kube-api-access-crk4q\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148671 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148432 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-out\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148671 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148443 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-config-volume\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148671 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148453 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b45ba-d59d-441f-8ff5-4df599b81c63-metrics-client-ca\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148671 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148464 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148671 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148476 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c4b45ba-d59d-441f-8ff5-4df599b81c63-secret-alertmanager-main-tls\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148671 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148487 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c4b45ba-d59d-441f-8ff5-4df599b81c63-tls-assets\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.148671 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.148499 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c4b45ba-d59d-441f-8ff5-4df599b81c63-alertmanager-main-db\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:14:41.269777 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.269743 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerID="3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba" exitCode=0 Jul 03 14:14:41.269953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.269856 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerDied","Data":"3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba"} Jul 03 14:14:41.269953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.269885 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.269953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.269917 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c4b45ba-d59d-441f-8ff5-4df599b81c63","Type":"ContainerDied","Data":"3ba2f87b7666da695bb2905cdb18c73185f3af93b8d7656a25fa6c581efeca7e"} Jul 03 14:14:41.269953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.269952 2574 scope.go:117] "RemoveContainer" containerID="099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5" Jul 03 14:14:41.277962 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.277943 2574 scope.go:117] "RemoveContainer" containerID="74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc" Jul 03 14:14:41.285539 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.285517 2574 scope.go:117] "RemoveContainer" containerID="d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e" Jul 03 14:14:41.293130 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.293109 2574 scope.go:117] "RemoveContainer" containerID="3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba" Jul 03 14:14:41.294900 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.294873 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:14:41.300630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.300612 2574 scope.go:117] "RemoveContainer" containerID="7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece" Jul 03 14:14:41.305216 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.305189 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:14:41.308609 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.308586 2574 scope.go:117] "RemoveContainer" containerID="e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836" Jul 03 14:14:41.316143 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.316120 2574 scope.go:117] "RemoveContainer" containerID="218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842" Jul 03 14:14:41.323594 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.323574 2574 scope.go:117] "RemoveContainer" containerID="099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5" Jul 03 14:14:41.324008 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:14:41.323983 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5\": container with ID starting with 099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5 not found: ID does not exist" containerID="099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5" Jul 03 14:14:41.324099 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.324015 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5"} err="failed to get container status \"099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5\": rpc error: code = NotFound desc = could not find container \"099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5\": container with ID starting with 099da7326163cc5f82a035b2521084433d8ac1aeca5dc5a5d2b8a11578ac52d5 not found: ID does not exist" Jul 03 14:14:41.324099 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.324038 2574 scope.go:117] "RemoveContainer" containerID="74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc" Jul 03 14:14:41.324496 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:14:41.324476 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc\": container with ID starting with 74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc not found: ID does not exist" containerID="74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc" Jul 03 14:14:41.324570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.324502 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc"} err="failed to get container status \"74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc\": rpc error: code = NotFound desc = could not find container \"74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc\": container with ID starting with 74dc7205301fc6fb5e053fc343ce3ea8c460e04514060a0b83c4c151bd95c8cc not found: ID does not exist" Jul 03 14:14:41.324570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.324519 2574 scope.go:117] "RemoveContainer" containerID="d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e" Jul 03 14:14:41.324774 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:14:41.324756 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e\": container with ID starting with d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e not found: ID does not exist" containerID="d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e" Jul 03 14:14:41.324864 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.324779 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e"} err="failed to get container status \"d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e\": rpc error: code = NotFound desc = could not find container \"d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e\": container with ID starting with d555a6f4d28880f02008249dcaaf9cde7456fccc61cd7a6d8c36699070a9263e not found: ID does not exist" Jul 03 14:14:41.324864 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.324791 2574 scope.go:117] "RemoveContainer" containerID="3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba" Jul 03 14:14:41.325110 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:14:41.325092 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba\": container with ID starting with 3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba not found: ID does not exist" containerID="3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba" Jul 03 14:14:41.325147 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.325117 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba"} err="failed to get container status \"3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba\": rpc error: code = NotFound desc = could not find container \"3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba\": container with ID starting with 3ff77fc28818e22e46471cf27ce3b51c60e0f71759e5cfcf08da822e460f68ba not found: ID does not exist" Jul 03 14:14:41.325147 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.325133 2574 scope.go:117] "RemoveContainer" containerID="7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece" Jul 03 14:14:41.325379 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:14:41.325358 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece\": container with ID starting with 7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece not found: ID does not exist" containerID="7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece" Jul 03 14:14:41.325449 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.325386 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece"} err="failed to get container status \"7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece\": rpc error: code = NotFound desc = could not find container \"7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece\": container with ID starting with 7e932cbc5752f0bace1d6d5fcf51e266e76454cb62079d5ec878ddddc705eece not found: ID does not exist" Jul 03 14:14:41.325449 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.325410 2574 scope.go:117] "RemoveContainer" containerID="e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836" Jul 03 14:14:41.325651 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:14:41.325635 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836\": container with ID starting with e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836 not found: ID does not exist" containerID="e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836" Jul 03 14:14:41.325711 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.325668 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836"} err="failed to get container status \"e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836\": rpc error: code = NotFound desc = could not find container \"e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836\": container with ID starting with e4f484d62b30de167436d1ebc137bcbe863567c8ace65208556a11f8cbd8d836 not found: ID does not exist" Jul 03 14:14:41.325711 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.325689 2574 scope.go:117] "RemoveContainer" containerID="218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842" Jul 03 14:14:41.325945 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:14:41.325925 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842\": container with ID starting with 218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842 not found: ID does not exist" containerID="218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842" Jul 03 14:14:41.326013 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.325949 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842"} err="failed to get container status \"218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842\": rpc error: code = NotFound desc = could not find container \"218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842\": container with ID starting with 218d3c7224b4e21b19bed01afb1e7906a78a0b8b94c0b48511e55ef297b65842 not found: ID does not exist" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.334866 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335509 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="alertmanager" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335528 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="alertmanager" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335542 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335552 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335574 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d9b63d7-ed85-42dd-a810-2ad03a03504d" containerName="registry" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335583 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d9b63d7-ed85-42dd-a810-2ad03a03504d" containerName="registry" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335607 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy-web" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335615 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy-web" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335626 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="init-config-reloader" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335634 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="init-config-reloader" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335643 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="prom-label-proxy" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335653 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="prom-label-proxy" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335673 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4022fc39-f507-4062-a1ae-d814417cca28" containerName="console" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335682 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4022fc39-f507-4062-a1ae-d814417cca28" containerName="console" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335699 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy-metric" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335707 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy-metric" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335726 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="config-reloader" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335734 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="config-reloader" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335866 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d9b63d7-ed85-42dd-a810-2ad03a03504d" containerName="registry" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335880 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="alertmanager" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335892 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="config-reloader" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335909 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy-web" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335918 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335926 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="kube-rbac-proxy-metric" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335935 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4022fc39-f507-4062-a1ae-d814417cca28" containerName="console" Jul 03 14:14:41.338457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.335948 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" containerName="prom-label-proxy" Jul 03 14:14:41.342923 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.342896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.345724 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.345698 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 14:14:41.345724 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.345718 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j25tn\"" Jul 03 14:14:41.345976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.345718 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 14:14:41.345976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.345777 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 14:14:41.345976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.345720 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 14:14:41.346112 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.346072 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 14:14:41.346167 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.346114 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 14:14:41.346167 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.346118 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 14:14:41.346267 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.346249 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 14:14:41.349478 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349525 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2778f628-cbd1-4262-859e-a61e83ebf594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nnvz\" (UniqueName: \"kubernetes.io/projected/2778f628-cbd1-4262-859e-a61e83ebf594-kube-api-access-7nnvz\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-config-volume\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2778f628-cbd1-4262-859e-a61e83ebf594-config-out\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-web-config\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2778f628-cbd1-4262-859e-a61e83ebf594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2778f628-cbd1-4262-859e-a61e83ebf594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.349903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.349877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2778f628-cbd1-4262-859e-a61e83ebf594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.351040 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.351019 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 14:14:41.353591 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.353568 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:14:41.450331 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.450331 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.450566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450361 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.450566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.450566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2778f628-cbd1-4262-859e-a61e83ebf594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.450566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nnvz\" (UniqueName: \"kubernetes.io/projected/2778f628-cbd1-4262-859e-a61e83ebf594-kube-api-access-7nnvz\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.450566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-config-volume\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.450566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2778f628-cbd1-4262-859e-a61e83ebf594-config-out\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.452316 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450651 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.452316 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-web-config\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.452316 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2778f628-cbd1-4262-859e-a61e83ebf594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.452316 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2778f628-cbd1-4262-859e-a61e83ebf594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.452316 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.450879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2778f628-cbd1-4262-859e-a61e83ebf594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.452316 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.451620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2778f628-cbd1-4262-859e-a61e83ebf594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.452316 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.451767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2778f628-cbd1-4262-859e-a61e83ebf594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.452676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.452548 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2778f628-cbd1-4262-859e-a61e83ebf594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.453687 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.453597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2778f628-cbd1-4262-859e-a61e83ebf594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.453850 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.453838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-config-volume\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.454032 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.454005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.454142 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.454113 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2778f628-cbd1-4262-859e-a61e83ebf594-config-out\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.454235 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.454216 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.454329 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.454309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.454648 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.454630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-web-config\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.454870 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.454853 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.455141 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.455120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2778f628-cbd1-4262-859e-a61e83ebf594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.461231 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.461209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nnvz\" (UniqueName: \"kubernetes.io/projected/2778f628-cbd1-4262-859e-a61e83ebf594-kube-api-access-7nnvz\") pod \"alertmanager-main-0\" (UID: \"2778f628-cbd1-4262-859e-a61e83ebf594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.653427 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.653303 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 14:14:41.802369 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:41.802321 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 14:14:41.806709 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:14:41.806680 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2778f628_cbd1_4262_859e_a61e83ebf594.slice/crio-0881d58ddb5af55cf265950e38c474763cd1f373ea3c99e2887f4ee4c39e873d WatchSource:0}: Error finding container 0881d58ddb5af55cf265950e38c474763cd1f373ea3c99e2887f4ee4c39e873d: Status 404 returned error can't find the container with id 0881d58ddb5af55cf265950e38c474763cd1f373ea3c99e2887f4ee4c39e873d Jul 03 14:14:42.276441 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:42.276401 2574 generic.go:356] "Generic (PLEG): container finished" podID="2778f628-cbd1-4262-859e-a61e83ebf594" containerID="79219d3d1f3bc91fc5696e6cbf89641ec5bec72ebfe11426453dadc975931951" exitCode=0 Jul 03 14:14:42.276837 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:42.276468 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2778f628-cbd1-4262-859e-a61e83ebf594","Type":"ContainerDied","Data":"79219d3d1f3bc91fc5696e6cbf89641ec5bec72ebfe11426453dadc975931951"} Jul 03 14:14:42.276837 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:42.276534 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2778f628-cbd1-4262-859e-a61e83ebf594","Type":"ContainerStarted","Data":"0881d58ddb5af55cf265950e38c474763cd1f373ea3c99e2887f4ee4c39e873d"} Jul 03 14:14:42.359678 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:42.359641 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c4b45ba-d59d-441f-8ff5-4df599b81c63" path="/var/lib/kubelet/pods/8c4b45ba-d59d-441f-8ff5-4df599b81c63/volumes" Jul 03 14:14:43.282988 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.282949 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2778f628-cbd1-4262-859e-a61e83ebf594","Type":"ContainerStarted","Data":"aa80f30e4bf3dc3656252ee46b6adfa54bf37ebbba3719bc0b98e129d520016e"} Jul 03 14:14:43.283475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.283061 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2778f628-cbd1-4262-859e-a61e83ebf594","Type":"ContainerStarted","Data":"4a62789b246f1b3f1510363995519dfa3728196b5b804b572afbc8aacbd99f29"} Jul 03 14:14:43.283475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.283107 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2778f628-cbd1-4262-859e-a61e83ebf594","Type":"ContainerStarted","Data":"708fa119c5dadc286e2cbb56abc0d3292c99eceef2ba65fa52e65bed51992cf1"} Jul 03 14:14:43.283475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.283158 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2778f628-cbd1-4262-859e-a61e83ebf594","Type":"ContainerStarted","Data":"290e69a1e0fefe57cfcd9b9da3b0135ced4fe1ddd2b890b9369819c1f479dab0"} Jul 03 14:14:43.283475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.283196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2778f628-cbd1-4262-859e-a61e83ebf594","Type":"ContainerStarted","Data":"0a9aef2199f130adc4d813857a0a00251437961e8f6672dd32114ca32499ddce"} Jul 03 14:14:43.283475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.283233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2778f628-cbd1-4262-859e-a61e83ebf594","Type":"ContainerStarted","Data":"c70010b667eefae4b8b8e24151e646bc7d3a910baf63aa05b3c7acf8dc276c5c"} Jul 03 14:14:43.313315 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.313254 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.294833218 podStartE2EDuration="2.313237639s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.404421ms" isStatefulPod=false podCreationTimestamp="2026-07-03 14:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:14:43.311597866 +0000 UTC m=+193.425419450" watchObservedRunningTime="2026-07-03 14:14:43.313237639 +0000 UTC m=+193.427059212" Jul 03 14:14:43.790774 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.790729 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d94454b75-fqp8f"] Jul 03 14:14:43.794540 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.794513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.801933 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.801863 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 03 14:14:43.801933 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.801863 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 03 14:14:43.802177 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.802074 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-b248v\"" Jul 03 14:14:43.802514 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.802189 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 03 14:14:43.802514 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.802271 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 03 14:14:43.802514 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.802484 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 03 14:14:43.809598 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.809560 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d94454b75-fqp8f"] Jul 03 14:14:43.809775 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.809660 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 03 14:14:43.872871 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.872833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-metrics-client-ca\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.872871 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.872873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-secret-telemeter-client\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.873062 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.872903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.873062 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.872924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.873062 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.872969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-serving-certs-ca-bundle\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.873062 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.873004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-telemeter-client-tls\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.873062 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.873046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-federate-client-tls\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.873236 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.873067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgwh9\" (UniqueName: \"kubernetes.io/projected/bccf4a83-ea9c-430f-94ec-1f697ae99724-kube-api-access-pgwh9\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.973757 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.973714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-federate-client-tls\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.973975 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.973771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgwh9\" (UniqueName: \"kubernetes.io/projected/bccf4a83-ea9c-430f-94ec-1f697ae99724-kube-api-access-pgwh9\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.973975 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.973847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-metrics-client-ca\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.973975 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.973881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-secret-telemeter-client\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.973975 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.973933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.973975 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.973969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.974264 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.973998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-serving-certs-ca-bundle\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.974264 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.974019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-telemeter-client-tls\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.974705 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.974671 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-metrics-client-ca\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.974984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.974953 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-serving-certs-ca-bundle\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.975107 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.975001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccf4a83-ea9c-430f-94ec-1f697ae99724-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.976602 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.976579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-telemeter-client-tls\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.976690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.976659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-secret-telemeter-client\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.977010 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.976993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.977090 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.977076 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bccf4a83-ea9c-430f-94ec-1f697ae99724-federate-client-tls\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:43.983140 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:43.983106 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgwh9\" (UniqueName: \"kubernetes.io/projected/bccf4a83-ea9c-430f-94ec-1f697ae99724-kube-api-access-pgwh9\") pod \"telemeter-client-6d94454b75-fqp8f\" (UID: \"bccf4a83-ea9c-430f-94ec-1f697ae99724\") " pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:44.105646 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:44.105547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" Jul 03 14:14:44.288159 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:44.288116 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d94454b75-fqp8f"] Jul 03 14:14:44.292906 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:14:44.292864 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbccf4a83_ea9c_430f_94ec_1f697ae99724.slice/crio-4988f91968639930d16d4183ab966b9a6b2aa3cae3746589dd8af1fad49199c9 WatchSource:0}: Error finding container 4988f91968639930d16d4183ab966b9a6b2aa3cae3746589dd8af1fad49199c9: Status 404 returned error can't find the container with id 4988f91968639930d16d4183ab966b9a6b2aa3cae3746589dd8af1fad49199c9 Jul 03 14:14:45.296311 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:45.296272 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" event={"ID":"bccf4a83-ea9c-430f-94ec-1f697ae99724","Type":"ContainerStarted","Data":"4988f91968639930d16d4183ab966b9a6b2aa3cae3746589dd8af1fad49199c9"} Jul 03 14:14:46.043631 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:46.043597 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:46.303150 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:46.303047 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" event={"ID":"bccf4a83-ea9c-430f-94ec-1f697ae99724","Type":"ContainerStarted","Data":"727dee864d90c2f2d3f76224c059b575a2bd6936e09c16e5f158ea89d3b2992c"} Jul 03 14:14:46.303634 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:46.303175 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" event={"ID":"bccf4a83-ea9c-430f-94ec-1f697ae99724","Type":"ContainerStarted","Data":"3a1ee50e66319fef9e84e987df3ba8560d30fb8d8739465f5764596db0822950"} Jul 03 14:14:46.303634 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:46.303209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" event={"ID":"bccf4a83-ea9c-430f-94ec-1f697ae99724","Type":"ContainerStarted","Data":"ca150247aefcc9eb74cadcd567a4fefdd2388bb872ba16acf13bbe685842be9b"} Jul 03 14:14:46.328994 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:46.328934 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d94454b75-fqp8f" podStartSLOduration=1.530276279 podStartE2EDuration="3.328915687s" totalImagesPullingTime="1.798639408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:14:46.327411809 +0000 UTC m=+196.441233384" watchObservedRunningTime="2026-07-03 14:14:46.328915687 +0000 UTC m=+196.442737260" Jul 03 14:14:47.305525 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.305492 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f5bbdfbb9-hs9b7"] Jul 03 14:14:47.308814 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.308786 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.313869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.313842 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 03 14:14:47.313869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.313859 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4q2ln\"" Jul 03 14:14:47.314083 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.313860 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 03 14:14:47.314083 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.313994 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 03 14:14:47.314979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.314960 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 03 14:14:47.315069 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.314965 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 03 14:14:47.320206 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.320182 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 03 14:14:47.326172 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.326137 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5bbdfbb9-hs9b7"] Jul 03 14:14:47.376951 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.376916 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:47.400152 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.400112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-config\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.400266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.400214 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-oauth-config\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.400343 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.400277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-service-ca\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.400343 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.400316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-serving-cert\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.400465 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.400334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-trusted-ca-bundle\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.400518 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.400478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpk2q\" (UniqueName: \"kubernetes.io/projected/bc58b684-1953-4cc3-b351-49c8c5e5f384-kube-api-access-zpk2q\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.400563 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.400540 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-oauth-serving-cert\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.466595 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.466549 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:47.500970 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.500934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-config\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.501119 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.500983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-oauth-config\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.501119 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.501095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-service-ca\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.501242 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.501144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-serving-cert\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.501299 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.501247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-trusted-ca-bundle\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.501352 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.501304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpk2q\" (UniqueName: \"kubernetes.io/projected/bc58b684-1953-4cc3-b351-49c8c5e5f384-kube-api-access-zpk2q\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.501352 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.501343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-oauth-serving-cert\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.501911 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.501880 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-service-ca\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.502014 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.501918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-config\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.502058 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.502013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-oauth-serving-cert\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.502332 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.502306 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-trusted-ca-bundle\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.503667 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.503648 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-serving-cert\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.504027 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.504007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-oauth-config\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.512985 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.512963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpk2q\" (UniqueName: \"kubernetes.io/projected/bc58b684-1953-4cc3-b351-49c8c5e5f384-kube-api-access-zpk2q\") pod \"console-6f5bbdfbb9-hs9b7\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.618301 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.618216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:47.754294 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:47.754264 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5bbdfbb9-hs9b7"] Jul 03 14:14:47.757268 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:14:47.757239 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc58b684_1953_4cc3_b351_49c8c5e5f384.slice/crio-00a305996054c9fd133a3fa800d4ed07262e3dc7a1beea5e7d6f3df26cc7c50f WatchSource:0}: Error finding container 00a305996054c9fd133a3fa800d4ed07262e3dc7a1beea5e7d6f3df26cc7c50f: Status 404 returned error can't find the container with id 00a305996054c9fd133a3fa800d4ed07262e3dc7a1beea5e7d6f3df26cc7c50f Jul 03 14:14:48.312323 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:48.312279 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5bbdfbb9-hs9b7" event={"ID":"bc58b684-1953-4cc3-b351-49c8c5e5f384","Type":"ContainerStarted","Data":"3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7"} Jul 03 14:14:48.312833 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:48.312338 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5bbdfbb9-hs9b7" event={"ID":"bc58b684-1953-4cc3-b351-49c8c5e5f384","Type":"ContainerStarted","Data":"00a305996054c9fd133a3fa800d4ed07262e3dc7a1beea5e7d6f3df26cc7c50f"} Jul 03 14:14:48.333858 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:48.333786 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f5bbdfbb9-hs9b7" podStartSLOduration=1.333769193 podStartE2EDuration="1.333769193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:14:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:14:48.332453253 +0000 UTC m=+198.446274825" watchObservedRunningTime="2026-07-03 14:14:48.333769193 +0000 UTC m=+198.447590766" Jul 03 14:14:57.619228 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:57.619191 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:57.619681 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:57.619262 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:57.624331 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:57.624299 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:58.358438 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:58.358398 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:14:58.522319 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:58.522286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:58.585733 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:58.585693 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:14:58.642483 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:14:58.642388 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:15:17.993000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:15:17.992945 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:15:53.959333 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:15:53.959241 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:15:54.051284 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:15:54.051254 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:15:57.525429 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:15:57.525391 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:15:57.584859 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:15:57.584826 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:05.917413 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:05.917379 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:05.978016 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:05.977980 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:08.603635 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:08.603605 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5bbdfbb9-hs9b7"] Jul 03 14:16:08.714385 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:08.714351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:08.815943 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:08.815911 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:08.916651 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:08.916581 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:13.264541 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:13.264505 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:13.367045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:13.367006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:13.424359 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:13.424331 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:15.999016 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:15.998981 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:16.091254 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:16.091209 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:22.915007 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:22.914968 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:30.216908 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:30.216880 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 03 14:16:31.031733 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.031699 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj"] Jul 03 14:16:31.034740 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.034720 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" Jul 03 14:16:31.034884 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.034772 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:31.038614 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.038594 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 03 14:16:31.038614 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.038611 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 03 14:16:31.038780 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.038596 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 03 14:16:31.038780 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.038664 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m8pk5\"" Jul 03 14:16:31.038780 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.038736 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 03 14:16:31.044055 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.044035 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj"] Jul 03 14:16:31.081816 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.081772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46429a6a-2193-4dd5-8e64-962cfd196245-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj\" (UID: \"46429a6a-2193-4dd5-8e64-962cfd196245\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" Jul 03 14:16:31.081930 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.081860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfxfh\" (UniqueName: \"kubernetes.io/projected/46429a6a-2193-4dd5-8e64-962cfd196245-kube-api-access-lfxfh\") pod \"managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj\" (UID: \"46429a6a-2193-4dd5-8e64-962cfd196245\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" Jul 03 14:16:31.123323 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.123294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:31.126624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.126602 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4"] Jul 03 14:16:31.129815 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.129789 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.132301 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.132278 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 03 14:16:31.132460 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.132443 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 03 14:16:31.132517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.132450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 03 14:16:31.132558 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.132531 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 03 14:16:31.141427 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.141407 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4"] Jul 03 14:16:31.183119 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.183091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfxfh\" (UniqueName: \"kubernetes.io/projected/46429a6a-2193-4dd5-8e64-962cfd196245-kube-api-access-lfxfh\") pod \"managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj\" (UID: \"46429a6a-2193-4dd5-8e64-962cfd196245\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" Jul 03 14:16:31.183119 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.183125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46429a6a-2193-4dd5-8e64-962cfd196245-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj\" (UID: \"46429a6a-2193-4dd5-8e64-962cfd196245\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" Jul 03 14:16:31.183362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.183151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-ca\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.183362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.183179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.183362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.183269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.183362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.183301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-hub\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.183362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.183330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.183362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.183347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjjdt\" (UniqueName: \"kubernetes.io/projected/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-kube-api-access-gjjdt\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.185631 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.185609 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46429a6a-2193-4dd5-8e64-962cfd196245-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj\" (UID: \"46429a6a-2193-4dd5-8e64-962cfd196245\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" Jul 03 14:16:31.192090 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.192065 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfxfh\" (UniqueName: \"kubernetes.io/projected/46429a6a-2193-4dd5-8e64-962cfd196245-kube-api-access-lfxfh\") pod \"managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj\" (UID: \"46429a6a-2193-4dd5-8e64-962cfd196245\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" Jul 03 14:16:31.197398 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.197370 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:16:31.284513 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.284435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-ca\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.284513 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.284472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.284513 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.284510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.285089 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.284530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-hub\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.285089 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.284551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.285089 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.284567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjjdt\" (UniqueName: \"kubernetes.io/projected/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-kube-api-access-gjjdt\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.285379 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.285352 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.287081 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.287060 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-hub\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.287192 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.287142 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-ca\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.287192 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.287165 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.287269 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.287197 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.293978 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.293953 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjjdt\" (UniqueName: \"kubernetes.io/projected/9871aa89-4e4a-42a9-a1a7-76f6fabe3792-kube-api-access-gjjdt\") pod \"cluster-proxy-proxy-agent-b6b744df5-9knm4\" (UID: \"9871aa89-4e4a-42a9-a1a7-76f6fabe3792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.349778 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.349755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" Jul 03 14:16:31.439105 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.439072 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" Jul 03 14:16:31.478232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.478205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj"] Jul 03 14:16:31.482955 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:16:31.482914 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46429a6a_2193_4dd5_8e64_962cfd196245.slice/crio-00bee8c2109dbe34c4843d898ee1af8686c705f3181cb54073513b3e6fa7f95d WatchSource:0}: Error finding container 00bee8c2109dbe34c4843d898ee1af8686c705f3181cb54073513b3e6fa7f95d: Status 404 returned error can't find the container with id 00bee8c2109dbe34c4843d898ee1af8686c705f3181cb54073513b3e6fa7f95d Jul 03 14:16:31.485147 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.485130 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 14:16:31.572881 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.572852 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4"] Jul 03 14:16:31.575818 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:16:31.575784 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9871aa89_4e4a_42a9_a1a7_76f6fabe3792.slice/crio-257b4b25f262680025be0993a0474c5306e3577b5fd8178311f6e566f9ebaa4b WatchSource:0}: Error finding container 257b4b25f262680025be0993a0474c5306e3577b5fd8178311f6e566f9ebaa4b: Status 404 returned error can't find the container with id 257b4b25f262680025be0993a0474c5306e3577b5fd8178311f6e566f9ebaa4b Jul 03 14:16:31.685508 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.685471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" event={"ID":"9871aa89-4e4a-42a9-a1a7-76f6fabe3792","Type":"ContainerStarted","Data":"257b4b25f262680025be0993a0474c5306e3577b5fd8178311f6e566f9ebaa4b"} Jul 03 14:16:31.686533 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:31.686505 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" event={"ID":"46429a6a-2193-4dd5-8e64-962cfd196245","Type":"ContainerStarted","Data":"00bee8c2109dbe34c4843d898ee1af8686c705f3181cb54073513b3e6fa7f95d"} Jul 03 14:16:33.623473 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:33.623328 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f5bbdfbb9-hs9b7" podUID="bc58b684-1953-4cc3-b351-49c8c5e5f384" containerName="console" containerID="cri-o://3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7" gracePeriod=15 Jul 03 14:16:34.472072 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.472045 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:16:34.613936 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.613906 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-oauth-serving-cert\") pod \"bc58b684-1953-4cc3-b351-49c8c5e5f384\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " Jul 03 14:16:34.614067 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.613947 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-oauth-config\") pod \"bc58b684-1953-4cc3-b351-49c8c5e5f384\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " Jul 03 14:16:34.614067 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.613996 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-config\") pod \"bc58b684-1953-4cc3-b351-49c8c5e5f384\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " Jul 03 14:16:34.614067 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614025 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpk2q\" (UniqueName: \"kubernetes.io/projected/bc58b684-1953-4cc3-b351-49c8c5e5f384-kube-api-access-zpk2q\") pod \"bc58b684-1953-4cc3-b351-49c8c5e5f384\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " Jul 03 14:16:34.614289 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614085 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-serving-cert\") pod \"bc58b684-1953-4cc3-b351-49c8c5e5f384\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " Jul 03 14:16:34.614289 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614147 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-service-ca\") pod \"bc58b684-1953-4cc3-b351-49c8c5e5f384\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " Jul 03 14:16:34.614378 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614327 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-trusted-ca-bundle\") pod \"bc58b684-1953-4cc3-b351-49c8c5e5f384\" (UID: \"bc58b684-1953-4cc3-b351-49c8c5e5f384\") " Jul 03 14:16:34.614577 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614345 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bc58b684-1953-4cc3-b351-49c8c5e5f384" (UID: "bc58b684-1953-4cc3-b351-49c8c5e5f384"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:16:34.614685 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614590 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-config" (OuterVolumeSpecName: "console-config") pod "bc58b684-1953-4cc3-b351-49c8c5e5f384" (UID: "bc58b684-1953-4cc3-b351-49c8c5e5f384"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:16:34.614685 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614602 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-oauth-serving-cert\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:16:34.614818 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614661 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-service-ca" (OuterVolumeSpecName: "service-ca") pod "bc58b684-1953-4cc3-b351-49c8c5e5f384" (UID: "bc58b684-1953-4cc3-b351-49c8c5e5f384"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:16:34.614884 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.614863 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bc58b684-1953-4cc3-b351-49c8c5e5f384" (UID: "bc58b684-1953-4cc3-b351-49c8c5e5f384"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:16:34.617353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.617066 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc58b684-1953-4cc3-b351-49c8c5e5f384-kube-api-access-zpk2q" (OuterVolumeSpecName: "kube-api-access-zpk2q") pod "bc58b684-1953-4cc3-b351-49c8c5e5f384" (UID: "bc58b684-1953-4cc3-b351-49c8c5e5f384"). InnerVolumeSpecName "kube-api-access-zpk2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:16:34.617353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.617066 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bc58b684-1953-4cc3-b351-49c8c5e5f384" (UID: "bc58b684-1953-4cc3-b351-49c8c5e5f384"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:16:34.617353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.617116 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bc58b684-1953-4cc3-b351-49c8c5e5f384" (UID: "bc58b684-1953-4cc3-b351-49c8c5e5f384"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:16:34.703238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.703120 2574 generic.go:356] "Generic (PLEG): container finished" podID="bc58b684-1953-4cc3-b351-49c8c5e5f384" containerID="3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7" exitCode=0 Jul 03 14:16:34.703238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.703176 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5bbdfbb9-hs9b7" Jul 03 14:16:34.703238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.703224 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5bbdfbb9-hs9b7" event={"ID":"bc58b684-1953-4cc3-b351-49c8c5e5f384","Type":"ContainerDied","Data":"3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7"} Jul 03 14:16:34.703788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.703281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5bbdfbb9-hs9b7" event={"ID":"bc58b684-1953-4cc3-b351-49c8c5e5f384","Type":"ContainerDied","Data":"00a305996054c9fd133a3fa800d4ed07262e3dc7a1beea5e7d6f3df26cc7c50f"} Jul 03 14:16:34.703788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.703308 2574 scope.go:117] "RemoveContainer" containerID="3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7" Jul 03 14:16:34.705134 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.705108 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" event={"ID":"46429a6a-2193-4dd5-8e64-962cfd196245","Type":"ContainerStarted","Data":"0446adfa5e330d25ff7c2d613db3c41dcdb43ecfd5685bb697a5479e95bdf500"} Jul 03 14:16:34.713694 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.713670 2574 scope.go:117] "RemoveContainer" containerID="3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7" Jul 03 14:16:34.714021 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:16:34.713997 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7\": container with ID starting with 3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7 not found: ID does not exist" containerID="3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7" Jul 03 14:16:34.714116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.714033 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7"} err="failed to get container status \"3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7\": rpc error: code = NotFound desc = could not find container \"3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7\": container with ID starting with 3fa5169fffed6d8bdf1c5b7dc0f0059fa6b110d1acde1608f1a2a414318c0ff7 not found: ID does not exist" Jul 03 14:16:34.715334 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.715312 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-service-ca\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:16:34.715424 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.715341 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-trusted-ca-bundle\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:16:34.715424 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.715354 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-oauth-config\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:16:34.715424 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.715367 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-config\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:16:34.715424 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.715382 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpk2q\" (UniqueName: \"kubernetes.io/projected/bc58b684-1953-4cc3-b351-49c8c5e5f384-kube-api-access-zpk2q\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:16:34.715424 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.715395 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc58b684-1953-4cc3-b351-49c8c5e5f384-console-serving-cert\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:16:34.726700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.726655 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7ff5c84b-rkqkj" podStartSLOduration=0.700997861 podStartE2EDuration="3.726638439s" totalImagesPullingTime="3.025640578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:16:34.724696596 +0000 UTC m=+304.838518186" watchObservedRunningTime="2026-07-03 14:16:34.726638439 +0000 UTC m=+304.840460014" Jul 03 14:16:34.738236 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.738215 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5bbdfbb9-hs9b7"] Jul 03 14:16:34.744058 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:34.744031 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f5bbdfbb9-hs9b7"] Jul 03 14:16:36.358606 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:36.358578 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc58b684-1953-4cc3-b351-49c8c5e5f384" path="/var/lib/kubelet/pods/bc58b684-1953-4cc3-b351-49c8c5e5f384/volumes" Jul 03 14:16:36.715517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:36.715432 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" event={"ID":"9871aa89-4e4a-42a9-a1a7-76f6fabe3792","Type":"ContainerStarted","Data":"30af89c8e1e458a5dd610190ad6dfae12d155f96429cf4021249649354e44c90"} Jul 03 14:16:36.715517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:36.715471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" event={"ID":"9871aa89-4e4a-42a9-a1a7-76f6fabe3792","Type":"ContainerStarted","Data":"7aaffdca6b61eeec8d404ddf7efe67bb3b43dc5ceae1478531e7d30e0abef85b"} Jul 03 14:16:36.715517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:36.715484 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" event={"ID":"9871aa89-4e4a-42a9-a1a7-76f6fabe3792","Type":"ContainerStarted","Data":"38200bdce4a7e44546fa72e83b33a6ee2746c04d55ad9e26c5871d0e7b4f0613"} Jul 03 14:16:36.734457 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:36.734406 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b744df5-9knm4" podStartSLOduration=1.3307418819999999 podStartE2EDuration="5.734391652s" totalImagesPullingTime="4.40364977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:16:36.733050017 +0000 UTC m=+306.846871600" watchObservedRunningTime="2026-07-03 14:16:36.734391652 +0000 UTC m=+306.848213234" Jul 03 14:16:58.535492 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:16:58.535457 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:00.008990 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:00.008946 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:20.300341 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:20.300306 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:21.245684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:21.245653 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:23.907304 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:23.907218 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:23.976010 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:23.975982 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:26.455634 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:26.455602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:26.575313 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:26.575286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:28.793279 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:28.793233 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:28.987711 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:28.987680 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:30.866783 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:30.866748 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:30.928893 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:30.928861 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:35.986630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:35.986590 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:37.075249 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:37.075218 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:37.175195 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:37.175167 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:43.367113 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:43.367078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:43.430222 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:43.430189 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:45.399360 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:45.399327 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:48.565025 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:48.564992 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:17:48.664785 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:17:48.664755 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:01.284081 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:01.284043 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:02.299910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:02.299876 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:02.405569 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:02.405538 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:02.893055 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:02.893024 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:03.140749 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.140716 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:03.275087 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.275006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:03.311088 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.311062 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l"] Jul 03 14:18:03.311459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.311419 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc58b684-1953-4cc3-b351-49c8c5e5f384" containerName="console" Jul 03 14:18:03.311459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.311433 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc58b684-1953-4cc3-b351-49c8c5e5f384" containerName="console" Jul 03 14:18:03.311529 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.311491 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc58b684-1953-4cc3-b351-49c8c5e5f384" containerName="console" Jul 03 14:18:03.314417 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.314398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.317068 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.317045 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 03 14:18:03.317328 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.317312 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 03 14:18:03.317615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.317601 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kf7mt\"" Jul 03 14:18:03.317984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.317959 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 03 14:18:03.318156 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.318143 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 03 14:18:03.332054 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.332032 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l"] Jul 03 14:18:03.335184 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.335164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86951c11-f206-484d-b67d-f76fd7482834-tmp\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.335271 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.335199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86951c11-f206-484d-b67d-f76fd7482834-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.335271 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.335216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86951c11-f206-484d-b67d-f76fd7482834-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.335271 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.335230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzxn\" (UniqueName: \"kubernetes.io/projected/86951c11-f206-484d-b67d-f76fd7482834-kube-api-access-jzzxn\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.335405 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.335282 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86951c11-f206-484d-b67d-f76fd7482834-manifests\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.436203 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.436175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86951c11-f206-484d-b67d-f76fd7482834-tmp\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.436338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.436213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86951c11-f206-484d-b67d-f76fd7482834-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.436338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.436230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86951c11-f206-484d-b67d-f76fd7482834-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.436338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.436244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzxn\" (UniqueName: \"kubernetes.io/projected/86951c11-f206-484d-b67d-f76fd7482834-kube-api-access-jzzxn\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.436338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.436270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86951c11-f206-484d-b67d-f76fd7482834-manifests\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.436662 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.436641 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86951c11-f206-484d-b67d-f76fd7482834-manifests\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.438459 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.438434 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86951c11-f206-484d-b67d-f76fd7482834-tmp\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.438833 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.438795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86951c11-f206-484d-b67d-f76fd7482834-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.438833 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.438827 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86951c11-f206-484d-b67d-f76fd7482834-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.447048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.447030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzxn\" (UniqueName: \"kubernetes.io/projected/86951c11-f206-484d-b67d-f76fd7482834-kube-api-access-jzzxn\") pod \"opendatahub-operator-controller-manager-6c6554f4cb-ktn5l\" (UID: \"86951c11-f206-484d-b67d-f76fd7482834\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.514066 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.514042 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:03.624423 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.624402 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:03.635056 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.635029 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:03.727359 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.727330 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:03.764897 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.764870 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l"] Jul 03 14:18:03.769485 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:18:03.769460 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86951c11_f206_484d_b67d_f76fd7482834.slice/crio-1fd3c67846590473ba511a220e9c6a58d36e88ef29a460ddb2559b37ea3ceb8a WatchSource:0}: Error finding container 1fd3c67846590473ba511a220e9c6a58d36e88ef29a460ddb2559b37ea3ceb8a: Status 404 returned error can't find the container with id 1fd3c67846590473ba511a220e9c6a58d36e88ef29a460ddb2559b37ea3ceb8a Jul 03 14:18:03.812223 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.812200 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:03.879945 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.879876 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:03.978932 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:03.978903 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:04.033386 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:04.033358 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" event={"ID":"86951c11-f206-484d-b67d-f76fd7482834","Type":"ContainerStarted","Data":"1fd3c67846590473ba511a220e9c6a58d36e88ef29a460ddb2559b37ea3ceb8a"} Jul 03 14:18:04.077439 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:04.077414 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:04.185313 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:04.185237 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:07.049742 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:07.049707 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" event={"ID":"86951c11-f206-484d-b67d-f76fd7482834","Type":"ContainerStarted","Data":"6bf167d89b2aafc6ad5ccd1e9e8d3fba98cab2a211118290c761f80fbc530dbe"} Jul 03 14:18:08.055268 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:08.055237 2574 generic.go:356] "Generic (PLEG): container finished" podID="86951c11-f206-484d-b67d-f76fd7482834" containerID="6bf167d89b2aafc6ad5ccd1e9e8d3fba98cab2a211118290c761f80fbc530dbe" exitCode=0 Jul 03 14:18:08.055594 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:08.055295 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" event={"ID":"86951c11-f206-484d-b67d-f76fd7482834","Type":"ContainerDied","Data":"6bf167d89b2aafc6ad5ccd1e9e8d3fba98cab2a211118290c761f80fbc530dbe"} Jul 03 14:18:09.061137 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:09.061095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" event={"ID":"86951c11-f206-484d-b67d-f76fd7482834","Type":"ContainerStarted","Data":"3e83625b09825baa3da874179e0df18696e492fd01ba37740101f61c9a1ec6d1"} Jul 03 14:18:09.061519 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:09.061211 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:09.083554 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:09.083468 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" podStartSLOduration=1.904068836 podStartE2EDuration="6.083452225s" totalImagesPullingTime="3.1761486s" totalInitContainerRuntime="1.003234789s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:09.081489287 +0000 UTC m=+399.195310891" watchObservedRunningTime="2026-07-03 14:18:09.083452225 +0000 UTC m=+399.197273797" Jul 03 14:18:11.682854 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:11.682823 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:11.766302 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:11.766263 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:15.097017 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:15.096987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:15.201591 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:15.201561 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:20.067726 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:20.067700 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6554f4cb-ktn5l" Jul 03 14:18:21.753352 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:21.753315 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:21.856940 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:21.856908 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:22.092353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.092323 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:22.141203 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.141175 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75b86bc795-nghdw"] Jul 03 14:18:22.153967 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.153946 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.157231 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.157208 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 03 14:18:22.157231 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.157221 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 03 14:18:22.157397 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.157278 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t5tq5\"" Jul 03 14:18:22.157397 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.157205 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 03 14:18:22.157676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.157660 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 03 14:18:22.158721 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.158703 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75b86bc795-nghdw"] Jul 03 14:18:22.282594 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.282562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adcf49e0-31e4-481b-89be-2732174ebbdf-tls-certs\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.282594 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.282597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcf49e0-31e4-481b-89be-2732174ebbdf-tmp\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.282770 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.282642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzs65\" (UniqueName: \"kubernetes.io/projected/adcf49e0-31e4-481b-89be-2732174ebbdf-kube-api-access-xzs65\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.384032 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.383964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adcf49e0-31e4-481b-89be-2732174ebbdf-tls-certs\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.384032 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.383998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcf49e0-31e4-481b-89be-2732174ebbdf-tmp\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.384032 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.384024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzs65\" (UniqueName: \"kubernetes.io/projected/adcf49e0-31e4-481b-89be-2732174ebbdf-kube-api-access-xzs65\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.384221 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:18:22.384121 2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 03 14:18:22.384221 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:18:22.384195 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adcf49e0-31e4-481b-89be-2732174ebbdf-tls-certs podName:adcf49e0-31e4-481b-89be-2732174ebbdf nodeName:}" failed. No retries permitted until 2026-07-03 14:18:22.884176194 +0000 UTC m=+412.997997754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/adcf49e0-31e4-481b-89be-2732174ebbdf-tls-certs") pod "kube-auth-proxy-75b86bc795-nghdw" (UID: "adcf49e0-31e4-481b-89be-2732174ebbdf") : secret "kube-auth-proxy-tls" not found Jul 03 14:18:22.386068 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.386045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcf49e0-31e4-481b-89be-2732174ebbdf-tmp\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.399291 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.399269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzs65\" (UniqueName: \"kubernetes.io/projected/adcf49e0-31e4-481b-89be-2732174ebbdf-kube-api-access-xzs65\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.598266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.598236 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:22.648530 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.648465 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5mlqh"] Jul 03 14:18:22.651641 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.651627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:22.654527 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.654508 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gpdsd\"" Jul 03 14:18:22.654718 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.654706 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 03 14:18:22.663292 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.663271 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5mlqh"] Jul 03 14:18:22.701886 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.701858 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:22.787637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.787610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mqv8\" (UniqueName: \"kubernetes.io/projected/c5c89fc2-cc4e-4101-997d-f427d187d4de-kube-api-access-6mqv8\") pod \"odh-model-controller-7998c67dc4-5mlqh\" (UID: \"c5c89fc2-cc4e-4101-997d-f427d187d4de\") " pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:22.788002 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.787650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5c89fc2-cc4e-4101-997d-f427d187d4de-cert\") pod \"odh-model-controller-7998c67dc4-5mlqh\" (UID: \"c5c89fc2-cc4e-4101-997d-f427d187d4de\") " pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:22.881788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.881741 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:22.888694 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.888667 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5c89fc2-cc4e-4101-997d-f427d187d4de-cert\") pod \"odh-model-controller-7998c67dc4-5mlqh\" (UID: \"c5c89fc2-cc4e-4101-997d-f427d187d4de\") " pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:22.888856 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.888751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adcf49e0-31e4-481b-89be-2732174ebbdf-tls-certs\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.888856 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:18:22.888784 2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 03 14:18:22.888856 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.888789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mqv8\" (UniqueName: \"kubernetes.io/projected/c5c89fc2-cc4e-4101-997d-f427d187d4de-kube-api-access-6mqv8\") pod \"odh-model-controller-7998c67dc4-5mlqh\" (UID: \"c5c89fc2-cc4e-4101-997d-f427d187d4de\") " pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:22.889020 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:18:22.888866 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c89fc2-cc4e-4101-997d-f427d187d4de-cert podName:c5c89fc2-cc4e-4101-997d-f427d187d4de nodeName:}" failed. No retries permitted until 2026-07-03 14:18:23.388849071 +0000 UTC m=+413.502670633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5c89fc2-cc4e-4101-997d-f427d187d4de-cert") pod "odh-model-controller-7998c67dc4-5mlqh" (UID: "c5c89fc2-cc4e-4101-997d-f427d187d4de") : secret "odh-model-controller-webhook-cert" not found Jul 03 14:18:22.891167 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.891140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adcf49e0-31e4-481b-89be-2732174ebbdf-tls-certs\") pod \"kube-auth-proxy-75b86bc795-nghdw\" (UID: \"adcf49e0-31e4-481b-89be-2732174ebbdf\") " pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:22.911137 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.911090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mqv8\" (UniqueName: \"kubernetes.io/projected/c5c89fc2-cc4e-4101-997d-f427d187d4de-kube-api-access-6mqv8\") pod \"odh-model-controller-7998c67dc4-5mlqh\" (UID: \"c5c89fc2-cc4e-4101-997d-f427d187d4de\") " pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:22.995170 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:22.995142 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:23.065266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.065246 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" Jul 03 14:18:23.209679 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.209635 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75b86bc795-nghdw"] Jul 03 14:18:23.210069 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.209952 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:23.212600 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:18:23.212575 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadcf49e0_31e4_481b_89be_2732174ebbdf.slice/crio-0dba804c46d429fba58aaf112047c68d2031293746ab4c1673e63478f8b4c406 WatchSource:0}: Error finding container 0dba804c46d429fba58aaf112047c68d2031293746ab4c1673e63478f8b4c406: Status 404 returned error can't find the container with id 0dba804c46d429fba58aaf112047c68d2031293746ab4c1673e63478f8b4c406 Jul 03 14:18:23.393134 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.393105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5c89fc2-cc4e-4101-997d-f427d187d4de-cert\") pod \"odh-model-controller-7998c67dc4-5mlqh\" (UID: \"c5c89fc2-cc4e-4101-997d-f427d187d4de\") " pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:23.395527 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.395501 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5c89fc2-cc4e-4101-997d-f427d187d4de-cert\") pod \"odh-model-controller-7998c67dc4-5mlqh\" (UID: \"c5c89fc2-cc4e-4101-997d-f427d187d4de\") " pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:23.561833 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.561787 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:23.666136 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.666068 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:23.672354 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.672331 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf"] Jul 03 14:18:23.675926 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.675906 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.678433 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.678411 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 03 14:18:23.678634 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.678615 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 03 14:18:23.678739 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.678686 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g48vm\"" Jul 03 14:18:23.678952 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.678933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 03 14:18:23.679067 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.678976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 03 14:18:23.689146 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.689123 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf"] Jul 03 14:18:23.695435 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.695415 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5mlqh"] Jul 03 14:18:23.698998 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:18:23.698973 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c89fc2_cc4e_4101_997d_f427d187d4de.slice/crio-cb726894c1f30967e1303feccd0a6e908109c586ac7b6532661f01c2c6647baf WatchSource:0}: Error finding container cb726894c1f30967e1303feccd0a6e908109c586ac7b6532661f01c2c6647baf: Status 404 returned error can't find the container with id cb726894c1f30967e1303feccd0a6e908109c586ac7b6532661f01c2c6647baf Jul 03 14:18:23.764771 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.764744 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:23.796443 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.796422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52r8q\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-kube-api-access-52r8q\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.796730 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.796461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.796730 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.796479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.796730 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.796499 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-istio-token\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.796730 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.796555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/375618c7-2463-4881-9e06-e69dd18511e1-local-certs\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.796730 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.796593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-cacerts\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.796730 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.796616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.864253 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.864186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:23.897181 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.897160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-istio-token\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.897266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.897189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/375618c7-2463-4881-9e06-e69dd18511e1-local-certs\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.897266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.897214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-cacerts\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.897266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.897231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.897411 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.897267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52r8q\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-kube-api-access-52r8q\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.897411 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.897321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.897411 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.897343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.897937 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.897914 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.899379 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.899362 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/375618c7-2463-4881-9e06-e69dd18511e1-local-certs\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.899504 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.899489 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-cacerts\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.899910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.899876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.899981 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.899913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.905502 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.905484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-istio-token\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.905728 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.905712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52r8q\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-kube-api-access-52r8q\") pod \"istiod-openshift-gateway-7574459656-rqwlf\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:23.986317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:23.986298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:24.122926 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:24.122843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" event={"ID":"adcf49e0-31e4-481b-89be-2732174ebbdf","Type":"ContainerStarted","Data":"0dba804c46d429fba58aaf112047c68d2031293746ab4c1673e63478f8b4c406"} Jul 03 14:18:24.124132 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:24.124095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" event={"ID":"c5c89fc2-cc4e-4101-997d-f427d187d4de","Type":"ContainerStarted","Data":"cb726894c1f30967e1303feccd0a6e908109c586ac7b6532661f01c2c6647baf"} Jul 03 14:18:24.131522 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:24.131500 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf"] Jul 03 14:18:24.134082 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:18:24.134058 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375618c7_2463_4881_9e06_e69dd18511e1.slice/crio-d612cd82cbe23ddbacfe953f3740081cc6473d02ca98b9e7251532b46d8f3c60 WatchSource:0}: Error finding container d612cd82cbe23ddbacfe953f3740081cc6473d02ca98b9e7251532b46d8f3c60: Status 404 returned error can't find the container with id d612cd82cbe23ddbacfe953f3740081cc6473d02ca98b9e7251532b46d8f3c60 Jul 03 14:18:24.828027 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:24.827977 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:25.132608 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:25.132531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" event={"ID":"375618c7-2463-4881-9e06-e69dd18511e1","Type":"ContainerStarted","Data":"d612cd82cbe23ddbacfe953f3740081cc6473d02ca98b9e7251532b46d8f3c60"} Jul 03 14:18:27.145358 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:27.145314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" event={"ID":"adcf49e0-31e4-481b-89be-2732174ebbdf","Type":"ContainerStarted","Data":"39f87ec46ec93ceb282835f925aba3aff6f0273c2fbe291096c524ff84ad026a"} Jul 03 14:18:27.147570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:27.147545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" event={"ID":"c5c89fc2-cc4e-4101-997d-f427d187d4de","Type":"ContainerStarted","Data":"dc070b7073e0ee770fcc31e045bf05fa718e06c7cb8cc7dc802c6b61dce1ae45"} Jul 03 14:18:27.147953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:27.147935 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:27.164641 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:27.164592 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75b86bc795-nghdw" podStartSLOduration=1.381077391 podStartE2EDuration="5.164573421s" totalImagesPullingTime="3.78349603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:27.163635492 +0000 UTC m=+417.277457075" watchObservedRunningTime="2026-07-03 14:18:27.164573421 +0000 UTC m=+417.278394995" Jul 03 14:18:27.181317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:27.181266 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" podStartSLOduration=1.878419201 podStartE2EDuration="5.181247286s" totalImagesPullingTime="3.302828085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:27.178468001 +0000 UTC m=+417.292289573" watchObservedRunningTime="2026-07-03 14:18:27.181247286 +0000 UTC m=+417.295068858" Jul 03 14:18:28.771099 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:28.771058 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 14:18:28.771419 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:28.771129 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 14:18:29.157053 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:29.157019 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" event={"ID":"375618c7-2463-4881-9e06-e69dd18511e1","Type":"ContainerStarted","Data":"75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856"} Jul 03 14:18:29.157319 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:29.157297 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:29.158486 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:29.158457 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-rqwlf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 03 14:18:29.158589 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:29.158512 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" podUID="375618c7-2463-4881-9e06-e69dd18511e1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 03 14:18:29.181143 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:29.181092 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" podStartSLOduration=1.5464252790000002 podStartE2EDuration="6.181073739s" totalImagesPullingTime="4.63464846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:29.17933475 +0000 UTC m=+419.293156348" watchObservedRunningTime="2026-07-03 14:18:29.181073739 +0000 UTC m=+419.294895314" Jul 03 14:18:29.587653 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:29.587611 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:29.681178 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:29.681137 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:29.953234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:29.953131 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:30.081643 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:30.081602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:30.167943 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:30.167917 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:30.393654 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:30.393623 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:32.430921 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.430887 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:32.513616 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.513588 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb"] Jul 03 14:18:32.518116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.518099 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:32.520597 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.520573 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 03 14:18:32.520711 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.520646 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hc422\"" Jul 03 14:18:32.527500 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.527475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:32.528150 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.528128 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb"] Jul 03 14:18:32.639166 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.639102 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:32.676494 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.676468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsxzq\" (UniqueName: \"kubernetes.io/projected/c31c7962-fad8-45bb-80a8-bec7420d0fea-kube-api-access-hsxzq\") pod \"llmisvc-controller-manager-777c6bd7d5-wj9sb\" (UID: \"c31c7962-fad8-45bb-80a8-bec7420d0fea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:32.676620 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.676505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c31c7962-fad8-45bb-80a8-bec7420d0fea-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wj9sb\" (UID: \"c31c7962-fad8-45bb-80a8-bec7420d0fea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:32.740999 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.740934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:32.777519 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.777497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsxzq\" (UniqueName: \"kubernetes.io/projected/c31c7962-fad8-45bb-80a8-bec7420d0fea-kube-api-access-hsxzq\") pod \"llmisvc-controller-manager-777c6bd7d5-wj9sb\" (UID: \"c31c7962-fad8-45bb-80a8-bec7420d0fea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:32.777626 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.777528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c31c7962-fad8-45bb-80a8-bec7420d0fea-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wj9sb\" (UID: \"c31c7962-fad8-45bb-80a8-bec7420d0fea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:32.777679 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:18:32.777639 2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 03 14:18:32.777734 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:18:32.777685 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31c7962-fad8-45bb-80a8-bec7420d0fea-cert podName:c31c7962-fad8-45bb-80a8-bec7420d0fea nodeName:}" failed. No retries permitted until 2026-07-03 14:18:33.277671689 +0000 UTC m=+423.391493241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c31c7962-fad8-45bb-80a8-bec7420d0fea-cert") pod "llmisvc-controller-manager-777c6bd7d5-wj9sb" (UID: "c31c7962-fad8-45bb-80a8-bec7420d0fea") : secret "llmisvc-webhook-server-cert" not found Jul 03 14:18:32.794256 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.794226 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsxzq\" (UniqueName: \"kubernetes.io/projected/c31c7962-fad8-45bb-80a8-bec7420d0fea-kube-api-access-hsxzq\") pod \"llmisvc-controller-manager-777c6bd7d5-wj9sb\" (UID: \"c31c7962-fad8-45bb-80a8-bec7420d0fea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:32.863741 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.863717 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:32.996831 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:32.996730 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:33.090551 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:33.090518 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:33.281633 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:33.281552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c31c7962-fad8-45bb-80a8-bec7420d0fea-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wj9sb\" (UID: \"c31c7962-fad8-45bb-80a8-bec7420d0fea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:33.283812 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:33.283775 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c31c7962-fad8-45bb-80a8-bec7420d0fea-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wj9sb\" (UID: \"c31c7962-fad8-45bb-80a8-bec7420d0fea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:33.430722 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:33.430696 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:33.573043 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:33.573016 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb"] Jul 03 14:18:33.576196 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:18:33.576173 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc31c7962_fad8_45bb_80a8_bec7420d0fea.slice/crio-98f4d061ed4fe4fcb86033ce0f861df8cef2b8eea8525a0fb866b14f2ecdf489 WatchSource:0}: Error finding container 98f4d061ed4fe4fcb86033ce0f861df8cef2b8eea8525a0fb866b14f2ecdf489: Status 404 returned error can't find the container with id 98f4d061ed4fe4fcb86033ce0f861df8cef2b8eea8525a0fb866b14f2ecdf489 Jul 03 14:18:34.180697 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.180663 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" event={"ID":"c31c7962-fad8-45bb-80a8-bec7420d0fea","Type":"ContainerStarted","Data":"98f4d061ed4fe4fcb86033ce0f861df8cef2b8eea8525a0fb866b14f2ecdf489"} Jul 03 14:18:34.346511 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.346478 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf"] Jul 03 14:18:34.346693 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.346672 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" podUID="375618c7-2463-4881-9e06-e69dd18511e1" containerName="discovery" containerID="cri-o://75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856" gracePeriod=30 Jul 03 14:18:34.682603 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.682551 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:34.797470 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.797443 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52r8q\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-kube-api-access-52r8q\") pod \"375618c7-2463-4881-9e06-e69dd18511e1\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " Jul 03 14:18:34.797624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.797475 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-kubeconfig\") pod \"375618c7-2463-4881-9e06-e69dd18511e1\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " Jul 03 14:18:34.797624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.797504 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/375618c7-2463-4881-9e06-e69dd18511e1-local-certs\") pod \"375618c7-2463-4881-9e06-e69dd18511e1\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " Jul 03 14:18:34.797624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.797523 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-istio-token\") pod \"375618c7-2463-4881-9e06-e69dd18511e1\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " Jul 03 14:18:34.797624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.797543 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-ca-configmap\") pod \"375618c7-2463-4881-9e06-e69dd18511e1\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " Jul 03 14:18:34.797624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.797603 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-cacerts\") pod \"375618c7-2463-4881-9e06-e69dd18511e1\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " Jul 03 14:18:34.797963 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.797673 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-dns-cert\") pod \"375618c7-2463-4881-9e06-e69dd18511e1\" (UID: \"375618c7-2463-4881-9e06-e69dd18511e1\") " Jul 03 14:18:34.798053 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.798019 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "375618c7-2463-4881-9e06-e69dd18511e1" (UID: "375618c7-2463-4881-9e06-e69dd18511e1"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:18:34.799711 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.799669 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/375618c7-2463-4881-9e06-e69dd18511e1-local-certs" (OuterVolumeSpecName: "local-certs") pod "375618c7-2463-4881-9e06-e69dd18511e1" (UID: "375618c7-2463-4881-9e06-e69dd18511e1"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:18:34.799940 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.799916 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "375618c7-2463-4881-9e06-e69dd18511e1" (UID: "375618c7-2463-4881-9e06-e69dd18511e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:18:34.800143 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.800121 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "375618c7-2463-4881-9e06-e69dd18511e1" (UID: "375618c7-2463-4881-9e06-e69dd18511e1"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:18:34.800238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.800119 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-kube-api-access-52r8q" (OuterVolumeSpecName: "kube-api-access-52r8q") pod "375618c7-2463-4881-9e06-e69dd18511e1" (UID: "375618c7-2463-4881-9e06-e69dd18511e1"). InnerVolumeSpecName "kube-api-access-52r8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:18:34.800279 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.800248 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "375618c7-2463-4881-9e06-e69dd18511e1" (UID: "375618c7-2463-4881-9e06-e69dd18511e1"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:18:34.800279 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.800262 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-cacerts" (OuterVolumeSpecName: "cacerts") pod "375618c7-2463-4881-9e06-e69dd18511e1" (UID: "375618c7-2463-4881-9e06-e69dd18511e1"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:18:34.899165 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.899130 2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-cacerts\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:18:34.899165 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.899166 2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-dns-cert\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:18:34.899349 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.899184 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52r8q\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-kube-api-access-52r8q\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:18:34.899349 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.899198 2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/375618c7-2463-4881-9e06-e69dd18511e1-istio-kubeconfig\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:18:34.899349 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.899210 2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/375618c7-2463-4881-9e06-e69dd18511e1-local-certs\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:18:34.899349 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.899222 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375618c7-2463-4881-9e06-e69dd18511e1-istio-token\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:18:34.899349 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:34.899234 2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/375618c7-2463-4881-9e06-e69dd18511e1-istio-csr-ca-configmap\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:18:35.187317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.187237 2574 generic.go:356] "Generic (PLEG): container finished" podID="375618c7-2463-4881-9e06-e69dd18511e1" containerID="75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856" exitCode=0 Jul 03 14:18:35.187317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.187286 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" Jul 03 14:18:35.187317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.187313 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" event={"ID":"375618c7-2463-4881-9e06-e69dd18511e1","Type":"ContainerDied","Data":"75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856"} Jul 03 14:18:35.187552 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.187359 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf" event={"ID":"375618c7-2463-4881-9e06-e69dd18511e1","Type":"ContainerDied","Data":"d612cd82cbe23ddbacfe953f3740081cc6473d02ca98b9e7251532b46d8f3c60"} Jul 03 14:18:35.187552 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.187384 2574 scope.go:117] "RemoveContainer" containerID="75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856" Jul 03 14:18:35.196832 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.196741 2574 scope.go:117] "RemoveContainer" containerID="75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856" Jul 03 14:18:35.197190 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:18:35.197168 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856\": container with ID starting with 75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856 not found: ID does not exist" containerID="75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856" Jul 03 14:18:35.197279 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.197197 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856"} err="failed to get container status \"75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856\": rpc error: code = NotFound desc = could not find container \"75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856\": container with ID starting with 75842ec32ddea28e667d6663490ce112d049fde214aaaec22a06faac1a9dc856 not found: ID does not exist" Jul 03 14:18:35.215213 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.215186 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf"] Jul 03 14:18:35.219332 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:35.219312 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rqwlf"] Jul 03 14:18:36.358670 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:36.358645 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="375618c7-2463-4881-9e06-e69dd18511e1" path="/var/lib/kubelet/pods/375618c7-2463-4881-9e06-e69dd18511e1/volumes" Jul 03 14:18:37.198940 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:37.198910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" event={"ID":"c31c7962-fad8-45bb-80a8-bec7420d0fea","Type":"ContainerStarted","Data":"79647921f7e75478b5a48d18c46d6359c9fd027e68602c8715ebb1860db9bca6"} Jul 03 14:18:37.199131 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:37.199114 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:18:37.219090 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:37.219049 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" podStartSLOduration=2.5734028110000002 podStartE2EDuration="5.219035455s" totalImagesPullingTime="2.645632644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:18:37.217571918 +0000 UTC m=+427.331393490" watchObservedRunningTime="2026-07-03 14:18:37.219035455 +0000 UTC m=+427.332857025" Jul 03 14:18:39.159593 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:39.159561 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5mlqh" Jul 03 14:18:39.219652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:39.219611 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:18:39.347156 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:18:39.347127 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:19:08.205304 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:08.205276 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wj9sb" Jul 03 14:19:23.240215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:23.240180 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:19:23.342327 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:23.342288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:19:24.719384 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.719354 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n85zp"] Jul 03 14:19:24.719725 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.719657 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375618c7-2463-4881-9e06-e69dd18511e1" containerName="discovery" Jul 03 14:19:24.719725 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.719668 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="375618c7-2463-4881-9e06-e69dd18511e1" containerName="discovery" Jul 03 14:19:24.719725 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.719724 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="375618c7-2463-4881-9e06-e69dd18511e1" containerName="discovery" Jul 03 14:19:24.722578 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.722564 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" Jul 03 14:19:24.725208 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.725187 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8ftq9\"" Jul 03 14:19:24.725361 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.725339 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 03 14:19:24.726009 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.725991 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 03 14:19:24.734518 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.734496 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n85zp"] Jul 03 14:19:24.755700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.755681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzcll\" (UniqueName: \"kubernetes.io/projected/d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf-kube-api-access-mzcll\") pod \"kuadrant-operator-catalog-n85zp\" (UID: \"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf\") " pod="kuadrant-system/kuadrant-operator-catalog-n85zp" Jul 03 14:19:24.765490 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.765469 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:19:24.856695 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.856672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzcll\" (UniqueName: \"kubernetes.io/projected/d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf-kube-api-access-mzcll\") pod \"kuadrant-operator-catalog-n85zp\" (UID: \"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf\") " pod="kuadrant-system/kuadrant-operator-catalog-n85zp" Jul 03 14:19:24.864888 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:24.864869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzcll\" (UniqueName: \"kubernetes.io/projected/d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf-kube-api-access-mzcll\") pod \"kuadrant-operator-catalog-n85zp\" (UID: \"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf\") " pod="kuadrant-system/kuadrant-operator-catalog-n85zp" Jul 03 14:19:25.032740 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.032682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" Jul 03 14:19:25.093917 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.093887 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n85zp"] Jul 03 14:19:25.156993 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.156969 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n85zp"] Jul 03 14:19:25.159415 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:19:25.159387 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7afd0f4_dd42_4d96_a1b8_ceb1f30cbecf.slice/crio-7a87340c8bf7302bef740f43a85a3d51dcc6b3d5785e4c572c35bc3dbed76d6a WatchSource:0}: Error finding container 7a87340c8bf7302bef740f43a85a3d51dcc6b3d5785e4c572c35bc3dbed76d6a: Status 404 returned error can't find the container with id 7a87340c8bf7302bef740f43a85a3d51dcc6b3d5785e4c572c35bc3dbed76d6a Jul 03 14:19:25.295957 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.295931 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m9dks"] Jul 03 14:19:25.300402 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.300387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:25.307896 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.307877 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m9dks"] Jul 03 14:19:25.361015 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.360986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2jfs\" (UniqueName: \"kubernetes.io/projected/a03087dc-6075-40d3-b629-58b7f37f5b07-kube-api-access-b2jfs\") pod \"kuadrant-operator-catalog-m9dks\" (UID: \"a03087dc-6075-40d3-b629-58b7f37f5b07\") " pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:25.392991 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.392966 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" event={"ID":"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf","Type":"ContainerStarted","Data":"7a87340c8bf7302bef740f43a85a3d51dcc6b3d5785e4c572c35bc3dbed76d6a"} Jul 03 14:19:25.461518 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.461486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2jfs\" (UniqueName: \"kubernetes.io/projected/a03087dc-6075-40d3-b629-58b7f37f5b07-kube-api-access-b2jfs\") pod \"kuadrant-operator-catalog-m9dks\" (UID: \"a03087dc-6075-40d3-b629-58b7f37f5b07\") " pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:25.470786 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.470758 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2jfs\" (UniqueName: \"kubernetes.io/projected/a03087dc-6075-40d3-b629-58b7f37f5b07-kube-api-access-b2jfs\") pod \"kuadrant-operator-catalog-m9dks\" (UID: \"a03087dc-6075-40d3-b629-58b7f37f5b07\") " pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:25.610314 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.610244 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:25.737862 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:25.737835 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m9dks"] Jul 03 14:19:25.739770 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:19:25.739744 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03087dc_6075_40d3_b629_58b7f37f5b07.slice/crio-870b0a7ea8e1821d8ebeeb2804ec27433bcdd0eac8771432939b99cdc81514bb WatchSource:0}: Error finding container 870b0a7ea8e1821d8ebeeb2804ec27433bcdd0eac8771432939b99cdc81514bb: Status 404 returned error can't find the container with id 870b0a7ea8e1821d8ebeeb2804ec27433bcdd0eac8771432939b99cdc81514bb Jul 03 14:19:26.398153 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:26.398090 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" event={"ID":"a03087dc-6075-40d3-b629-58b7f37f5b07","Type":"ContainerStarted","Data":"870b0a7ea8e1821d8ebeeb2804ec27433bcdd0eac8771432939b99cdc81514bb"} Jul 03 14:19:27.404811 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.404706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" event={"ID":"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf","Type":"ContainerStarted","Data":"f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457"} Jul 03 14:19:27.405227 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.404771 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" podUID="d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf" containerName="registry-server" containerID="cri-o://f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457" gracePeriod=2 Jul 03 14:19:27.406341 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.406316 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" event={"ID":"a03087dc-6075-40d3-b629-58b7f37f5b07","Type":"ContainerStarted","Data":"1eeb5c77eec3927bed69191da7e76bc3023992f0a1d37da8897031ca2671034f"} Jul 03 14:19:27.421462 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.421425 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" podStartSLOduration=1.471438823 podStartE2EDuration="3.421412079s" totalImagesPullingTime="1.949973256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:19:27.421107179 +0000 UTC m=+477.534928750" watchObservedRunningTime="2026-07-03 14:19:27.421412079 +0000 UTC m=+477.535233675" Jul 03 14:19:27.437392 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.437357 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" podStartSLOduration=1.067260911 podStartE2EDuration="2.437344938s" totalImagesPullingTime="1.370084027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:19:27.436281887 +0000 UTC m=+477.550103477" watchObservedRunningTime="2026-07-03 14:19:27.437344938 +0000 UTC m=+477.551166509" Jul 03 14:19:27.638903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.638866 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" Jul 03 14:19:27.682022 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.681967 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzcll\" (UniqueName: \"kubernetes.io/projected/d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf-kube-api-access-mzcll\") pod \"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf\" (UID: \"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf\") " Jul 03 14:19:27.683910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.683883 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf-kube-api-access-mzcll" (OuterVolumeSpecName: "kube-api-access-mzcll") pod "d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf" (UID: "d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf"). InnerVolumeSpecName "kube-api-access-mzcll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:19:27.783017 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:27.782996 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzcll\" (UniqueName: \"kubernetes.io/projected/d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf-kube-api-access-mzcll\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:28.411765 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.411695 2574 generic.go:356] "Generic (PLEG): container finished" podID="d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf" containerID="f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457" exitCode=0 Jul 03 14:19:28.411765 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.411738 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" Jul 03 14:19:28.412193 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.411778 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" event={"ID":"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf","Type":"ContainerDied","Data":"f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457"} Jul 03 14:19:28.412193 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.411844 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n85zp" event={"ID":"d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf","Type":"ContainerDied","Data":"7a87340c8bf7302bef740f43a85a3d51dcc6b3d5785e4c572c35bc3dbed76d6a"} Jul 03 14:19:28.412193 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.411866 2574 scope.go:117] "RemoveContainer" containerID="f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457" Jul 03 14:19:28.420204 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.420175 2574 scope.go:117] "RemoveContainer" containerID="f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457" Jul 03 14:19:28.420428 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:19:28.420409 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457\": container with ID starting with f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457 not found: ID does not exist" containerID="f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457" Jul 03 14:19:28.420503 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.420438 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457"} err="failed to get container status \"f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457\": rpc error: code = NotFound desc = could not find container \"f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457\": container with ID starting with f450d10e6b7d7846377a9b4a0a0ccd3a7ad0c62bc9fb623edb825c99311d2457 not found: ID does not exist" Jul 03 14:19:28.429871 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.429852 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n85zp"] Jul 03 14:19:28.433980 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:28.433960 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n85zp"] Jul 03 14:19:30.359654 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:30.359624 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf" path="/var/lib/kubelet/pods/d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf/volumes" Jul 03 14:19:32.258181 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:32.258154 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:19:32.359637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:32.359600 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:19:35.610766 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:35.610730 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:35.611169 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:35.610820 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:35.632763 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:35.632737 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:36.468180 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:36.468152 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-m9dks" Jul 03 14:19:40.120795 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.120764 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj"] Jul 03 14:19:40.121320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.121104 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf" containerName="registry-server" Jul 03 14:19:40.121320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.121117 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf" containerName="registry-server" Jul 03 14:19:40.121320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.121186 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7afd0f4-dd42-4d96-a1b8-ceb1f30cbecf" containerName="registry-server" Jul 03 14:19:40.125352 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.125336 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.127918 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.127900 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gxvzb\"" Jul 03 14:19:40.134358 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.134332 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj"] Jul 03 14:19:40.182373 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.182339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f727f\" (UniqueName: \"kubernetes.io/projected/31ec4b14-c858-41b1-915c-73ed5dc393b6-kube-api-access-f727f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.182518 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.182388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.182518 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.182426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.283293 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.283259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f727f\" (UniqueName: \"kubernetes.io/projected/31ec4b14-c858-41b1-915c-73ed5dc393b6-kube-api-access-f727f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.283436 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.283329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.283436 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.283383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.283704 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.283685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.283752 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.283730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.292690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.292655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f727f\" (UniqueName: \"kubernetes.io/projected/31ec4b14-c858-41b1-915c-73ed5dc393b6-kube-api-access-f727f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.434384 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.434283 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:40.515670 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.515640 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8"] Jul 03 14:19:40.520316 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.520294 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.530566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.530537 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8"] Jul 03 14:19:40.573450 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.573425 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj"] Jul 03 14:19:40.576144 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:19:40.576115 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ec4b14_c858_41b1_915c_73ed5dc393b6.slice/crio-def5893ff975b8eb9464eafed60612c21335a80ce5952407499d9a3bf6784ce1 WatchSource:0}: Error finding container def5893ff975b8eb9464eafed60612c21335a80ce5952407499d9a3bf6784ce1: Status 404 returned error can't find the container with id def5893ff975b8eb9464eafed60612c21335a80ce5952407499d9a3bf6784ce1 Jul 03 14:19:40.585133 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.585108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.585243 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.585150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.585291 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.585265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6mk4\" (UniqueName: \"kubernetes.io/projected/4a65e02d-ec9f-4127-bab7-852cd2fe4009-kube-api-access-b6mk4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.686162 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.686082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6mk4\" (UniqueName: \"kubernetes.io/projected/4a65e02d-ec9f-4127-bab7-852cd2fe4009-kube-api-access-b6mk4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.686162 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.686130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.686391 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.686164 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.686550 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.686527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.686614 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.686552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.695767 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.695745 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6mk4\" (UniqueName: \"kubernetes.io/projected/4a65e02d-ec9f-4127-bab7-852cd2fe4009-kube-api-access-b6mk4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.834413 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.834382 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:40.911088 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.911050 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8"] Jul 03 14:19:40.914816 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.914780 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:40.923200 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.923173 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8"] Jul 03 14:19:40.987886 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.987732 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8"] Jul 03 14:19:40.988139 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.988115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tmpp\" (UniqueName: \"kubernetes.io/projected/ca556750-9d1a-4434-812b-7f3fa6868544-kube-api-access-7tmpp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:40.988267 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.988200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:40.988267 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:40.988246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:40.990518 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:19:40.990490 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a65e02d_ec9f_4127_bab7_852cd2fe4009.slice/crio-1ca6eab6b1633f90c72c21ad6c35a32e863b0112322863c5c20a61264c9b9341 WatchSource:0}: Error finding container 1ca6eab6b1633f90c72c21ad6c35a32e863b0112322863c5c20a61264c9b9341: Status 404 returned error can't find the container with id 1ca6eab6b1633f90c72c21ad6c35a32e863b0112322863c5c20a61264c9b9341 Jul 03 14:19:41.089188 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.089151 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tmpp\" (UniqueName: \"kubernetes.io/projected/ca556750-9d1a-4434-812b-7f3fa6868544-kube-api-access-7tmpp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:41.089385 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.089213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:41.089385 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.089263 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:41.089688 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.089663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:41.089783 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.089688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:41.099817 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.099778 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tmpp\" (UniqueName: \"kubernetes.io/projected/ca556750-9d1a-4434-812b-7f3fa6868544-kube-api-access-7tmpp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:41.228272 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.228233 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:41.380480 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.380448 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8"] Jul 03 14:19:41.384206 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:19:41.384180 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca556750_9d1a_4434_812b_7f3fa6868544.slice/crio-d65ea7cb40d43f0865acc61bb0359648b3739bad036e6fc2f92088ef435f783f WatchSource:0}: Error finding container d65ea7cb40d43f0865acc61bb0359648b3739bad036e6fc2f92088ef435f783f: Status 404 returned error can't find the container with id d65ea7cb40d43f0865acc61bb0359648b3739bad036e6fc2f92088ef435f783f Jul 03 14:19:41.472796 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.472753 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" event={"ID":"ca556750-9d1a-4434-812b-7f3fa6868544","Type":"ContainerStarted","Data":"d65ea7cb40d43f0865acc61bb0359648b3739bad036e6fc2f92088ef435f783f"} Jul 03 14:19:41.474432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.474400 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" event={"ID":"31ec4b14-c858-41b1-915c-73ed5dc393b6","Type":"ContainerStarted","Data":"def5893ff975b8eb9464eafed60612c21335a80ce5952407499d9a3bf6784ce1"} Jul 03 14:19:41.476019 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.475992 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" event={"ID":"4a65e02d-ec9f-4127-bab7-852cd2fe4009","Type":"ContainerStarted","Data":"1ca6eab6b1633f90c72c21ad6c35a32e863b0112322863c5c20a61264c9b9341"} Jul 03 14:19:41.513348 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.513268 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2"] Jul 03 14:19:41.517272 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.517251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.527270 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.527249 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2"] Jul 03 14:19:41.593834 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.593786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.594028 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.593878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grwl5\" (UniqueName: \"kubernetes.io/projected/a4bb0c38-feab-4f94-beb1-39c56551dd70-kube-api-access-grwl5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.594028 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.593936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.695204 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.695159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.695390 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.695253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.695390 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.695298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grwl5\" (UniqueName: \"kubernetes.io/projected/a4bb0c38-feab-4f94-beb1-39c56551dd70-kube-api-access-grwl5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.695652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.695621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.695771 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.695682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.706563 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.706534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grwl5\" (UniqueName: \"kubernetes.io/projected/a4bb0c38-feab-4f94-beb1-39c56551dd70-kube-api-access-grwl5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:41.830625 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:41.830586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:42.018763 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:42.018728 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2"] Jul 03 14:19:42.024890 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:19:42.024858 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bb0c38_feab_4f94_beb1_39c56551dd70.slice/crio-543e04624fc0888caa175b1b6248364a6ad65dd3b3de479f005de15b17612e60 WatchSource:0}: Error finding container 543e04624fc0888caa175b1b6248364a6ad65dd3b3de479f005de15b17612e60: Status 404 returned error can't find the container with id 543e04624fc0888caa175b1b6248364a6ad65dd3b3de479f005de15b17612e60 Jul 03 14:19:42.485900 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:42.485814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" event={"ID":"a4bb0c38-feab-4f94-beb1-39c56551dd70","Type":"ContainerStarted","Data":"543e04624fc0888caa175b1b6248364a6ad65dd3b3de479f005de15b17612e60"} Jul 03 14:19:47.520025 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:47.519990 2574 generic.go:356] "Generic (PLEG): container finished" podID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerID="1627d74c75aff10a98699eb8737c12c053d1a383b82b46aae619ee9eed2f59f2" exitCode=0 Jul 03 14:19:47.520432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:47.520062 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" event={"ID":"31ec4b14-c858-41b1-915c-73ed5dc393b6","Type":"ContainerDied","Data":"1627d74c75aff10a98699eb8737c12c053d1a383b82b46aae619ee9eed2f59f2"} Jul 03 14:19:47.521630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:47.521600 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" event={"ID":"4a65e02d-ec9f-4127-bab7-852cd2fe4009","Type":"ContainerStarted","Data":"15ece79ff296546770c699c6c56b8c11787219b5698f5c4f27713f93cd2eea9f"} Jul 03 14:19:48.527313 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:48.527283 2574 generic.go:356] "Generic (PLEG): container finished" podID="ca556750-9d1a-4434-812b-7f3fa6868544" containerID="f548fa09b9baf397dbda06b992d512ad6e85552a02bd0e5eb0b1ae057ff12043" exitCode=0 Jul 03 14:19:48.527791 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:48.527335 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" event={"ID":"ca556750-9d1a-4434-812b-7f3fa6868544","Type":"ContainerDied","Data":"f548fa09b9baf397dbda06b992d512ad6e85552a02bd0e5eb0b1ae057ff12043"} Jul 03 14:19:48.529196 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:48.529177 2574 generic.go:356] "Generic (PLEG): container finished" podID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerID="a831f6b50cd3d91edc3542a8cc3a936fb3d4bbf6ba88b1dbf097299968564496" exitCode=0 Jul 03 14:19:48.529275 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:48.529253 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" event={"ID":"31ec4b14-c858-41b1-915c-73ed5dc393b6","Type":"ContainerDied","Data":"a831f6b50cd3d91edc3542a8cc3a936fb3d4bbf6ba88b1dbf097299968564496"} Jul 03 14:19:48.530849 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:48.530783 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerID="15ece79ff296546770c699c6c56b8c11787219b5698f5c4f27713f93cd2eea9f" exitCode=0 Jul 03 14:19:48.530949 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:48.530836 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" event={"ID":"4a65e02d-ec9f-4127-bab7-852cd2fe4009","Type":"ContainerDied","Data":"15ece79ff296546770c699c6c56b8c11787219b5698f5c4f27713f93cd2eea9f"} Jul 03 14:19:48.532610 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:48.532587 2574 generic.go:356] "Generic (PLEG): container finished" podID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerID="5ae9166801662cbae59ba03ff1a336b184f21998c1ebc64c0331052618a554f8" exitCode=0 Jul 03 14:19:48.532712 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:48.532613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" event={"ID":"a4bb0c38-feab-4f94-beb1-39c56551dd70","Type":"ContainerDied","Data":"5ae9166801662cbae59ba03ff1a336b184f21998c1ebc64c0331052618a554f8"} Jul 03 14:19:50.544483 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:50.544443 2574 generic.go:356] "Generic (PLEG): container finished" podID="ca556750-9d1a-4434-812b-7f3fa6868544" containerID="6c15772bf40d6aa067d46a3508fd26015d1f134a0904e7bc8769c6b13b31542a" exitCode=0 Jul 03 14:19:50.545069 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:50.544530 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" event={"ID":"ca556750-9d1a-4434-812b-7f3fa6868544","Type":"ContainerDied","Data":"6c15772bf40d6aa067d46a3508fd26015d1f134a0904e7bc8769c6b13b31542a"} Jul 03 14:19:50.546858 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:50.546836 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerID="d9563f0b9b6bc752a12cf5d618cc302d903e1e1703f8059948170c2b446e7b40" exitCode=0 Jul 03 14:19:50.546974 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:50.546918 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" event={"ID":"4a65e02d-ec9f-4127-bab7-852cd2fe4009","Type":"ContainerDied","Data":"d9563f0b9b6bc752a12cf5d618cc302d903e1e1703f8059948170c2b446e7b40"} Jul 03 14:19:50.549358 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:50.549338 2574 generic.go:356] "Generic (PLEG): container finished" podID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerID="3034b811a6295854f842550d1d16eb480e9a317c2509c05e81d02b8dc10160a9" exitCode=0 Jul 03 14:19:50.549467 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:50.549375 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" event={"ID":"a4bb0c38-feab-4f94-beb1-39c56551dd70","Type":"ContainerDied","Data":"3034b811a6295854f842550d1d16eb480e9a317c2509c05e81d02b8dc10160a9"} Jul 03 14:19:53.262009 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:53.261972 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:19:53.340287 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:53.340254 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:19:57.607124 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:57.607089 2574 generic.go:356] "Generic (PLEG): container finished" podID="ca556750-9d1a-4434-812b-7f3fa6868544" containerID="2f2f1ed9da61e76bfbfdd123ed55206dc6e9d98a7644145124bc3cda0480c6d5" exitCode=0 Jul 03 14:19:57.607738 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:57.607154 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" event={"ID":"ca556750-9d1a-4434-812b-7f3fa6868544","Type":"ContainerDied","Data":"2f2f1ed9da61e76bfbfdd123ed55206dc6e9d98a7644145124bc3cda0480c6d5"} Jul 03 14:19:57.609363 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:57.609335 2574 generic.go:356] "Generic (PLEG): container finished" podID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerID="93d6adbf11484a07a06109177c4c5d44e882393f3c8f74779659968981983861" exitCode=0 Jul 03 14:19:57.609495 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:57.609426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" event={"ID":"31ec4b14-c858-41b1-915c-73ed5dc393b6","Type":"ContainerDied","Data":"93d6adbf11484a07a06109177c4c5d44e882393f3c8f74779659968981983861"} Jul 03 14:19:57.611836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:57.611813 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerID="5d2c81424f0bbf4410e69ba146f528ae04ba27659836ed11b875d9576ec3f899" exitCode=0 Jul 03 14:19:57.611932 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:57.611883 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" event={"ID":"4a65e02d-ec9f-4127-bab7-852cd2fe4009","Type":"ContainerDied","Data":"5d2c81424f0bbf4410e69ba146f528ae04ba27659836ed11b875d9576ec3f899"} Jul 03 14:19:57.614285 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:57.614259 2574 generic.go:356] "Generic (PLEG): container finished" podID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerID="4af3f391b54fe5b03aa50569f4f872653d50d0a6e474f686f96afba5b4cefd8a" exitCode=0 Jul 03 14:19:57.614378 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:57.614345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" event={"ID":"a4bb0c38-feab-4f94-beb1-39c56551dd70","Type":"ContainerDied","Data":"4af3f391b54fe5b03aa50569f4f872653d50d0a6e474f686f96afba5b4cefd8a"} Jul 03 14:19:58.779415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.779077 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:58.815946 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.815781 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:58.823695 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.823677 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:58.826772 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.826750 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:58.853820 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.853784 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tmpp\" (UniqueName: \"kubernetes.io/projected/ca556750-9d1a-4434-812b-7f3fa6868544-kube-api-access-7tmpp\") pod \"ca556750-9d1a-4434-812b-7f3fa6868544\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " Jul 03 14:19:58.853940 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.853848 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-bundle\") pod \"ca556750-9d1a-4434-812b-7f3fa6868544\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " Jul 03 14:19:58.853940 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.853922 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-bundle\") pod \"31ec4b14-c858-41b1-915c-73ed5dc393b6\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " Jul 03 14:19:58.854051 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.853954 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-util\") pod \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " Jul 03 14:19:58.854051 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.853988 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-bundle\") pod \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " Jul 03 14:19:58.854051 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854010 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-util\") pod \"ca556750-9d1a-4434-812b-7f3fa6868544\" (UID: \"ca556750-9d1a-4434-812b-7f3fa6868544\") " Jul 03 14:19:58.854051 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854036 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-bundle\") pod \"a4bb0c38-feab-4f94-beb1-39c56551dd70\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " Jul 03 14:19:58.854252 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854066 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-util\") pod \"a4bb0c38-feab-4f94-beb1-39c56551dd70\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " Jul 03 14:19:58.854252 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854109 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-util\") pod \"31ec4b14-c858-41b1-915c-73ed5dc393b6\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " Jul 03 14:19:58.854252 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854134 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6mk4\" (UniqueName: \"kubernetes.io/projected/4a65e02d-ec9f-4127-bab7-852cd2fe4009-kube-api-access-b6mk4\") pod \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\" (UID: \"4a65e02d-ec9f-4127-bab7-852cd2fe4009\") " Jul 03 14:19:58.854252 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854171 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f727f\" (UniqueName: \"kubernetes.io/projected/31ec4b14-c858-41b1-915c-73ed5dc393b6-kube-api-access-f727f\") pod \"31ec4b14-c858-41b1-915c-73ed5dc393b6\" (UID: \"31ec4b14-c858-41b1-915c-73ed5dc393b6\") " Jul 03 14:19:58.854252 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854203 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grwl5\" (UniqueName: \"kubernetes.io/projected/a4bb0c38-feab-4f94-beb1-39c56551dd70-kube-api-access-grwl5\") pod \"a4bb0c38-feab-4f94-beb1-39c56551dd70\" (UID: \"a4bb0c38-feab-4f94-beb1-39c56551dd70\") " Jul 03 14:19:58.855690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854494 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-bundle" (OuterVolumeSpecName: "bundle") pod "a4bb0c38-feab-4f94-beb1-39c56551dd70" (UID: "a4bb0c38-feab-4f94-beb1-39c56551dd70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:19:58.855690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.854642 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-bundle" (OuterVolumeSpecName: "bundle") pod "4a65e02d-ec9f-4127-bab7-852cd2fe4009" (UID: "4a65e02d-ec9f-4127-bab7-852cd2fe4009"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:19:58.855690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.855260 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-bundle" (OuterVolumeSpecName: "bundle") pod "31ec4b14-c858-41b1-915c-73ed5dc393b6" (UID: "31ec4b14-c858-41b1-915c-73ed5dc393b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:19:58.856576 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.856527 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-bundle" (OuterVolumeSpecName: "bundle") pod "ca556750-9d1a-4434-812b-7f3fa6868544" (UID: "ca556750-9d1a-4434-812b-7f3fa6868544"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:19:58.861260 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.861225 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-util" (OuterVolumeSpecName: "util") pod "31ec4b14-c858-41b1-915c-73ed5dc393b6" (UID: "31ec4b14-c858-41b1-915c-73ed5dc393b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:19:58.861260 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.861242 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-util" (OuterVolumeSpecName: "util") pod "ca556750-9d1a-4434-812b-7f3fa6868544" (UID: "ca556750-9d1a-4434-812b-7f3fa6868544"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:19:58.861602 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.861580 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca556750-9d1a-4434-812b-7f3fa6868544-kube-api-access-7tmpp" (OuterVolumeSpecName: "kube-api-access-7tmpp") pod "ca556750-9d1a-4434-812b-7f3fa6868544" (UID: "ca556750-9d1a-4434-812b-7f3fa6868544"). InnerVolumeSpecName "kube-api-access-7tmpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:19:58.861887 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.861849 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a65e02d-ec9f-4127-bab7-852cd2fe4009-kube-api-access-b6mk4" (OuterVolumeSpecName: "kube-api-access-b6mk4") pod "4a65e02d-ec9f-4127-bab7-852cd2fe4009" (UID: "4a65e02d-ec9f-4127-bab7-852cd2fe4009"). InnerVolumeSpecName "kube-api-access-b6mk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:19:58.861887 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.861870 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ec4b14-c858-41b1-915c-73ed5dc393b6-kube-api-access-f727f" (OuterVolumeSpecName: "kube-api-access-f727f") pod "31ec4b14-c858-41b1-915c-73ed5dc393b6" (UID: "31ec4b14-c858-41b1-915c-73ed5dc393b6"). InnerVolumeSpecName "kube-api-access-f727f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:19:58.862173 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.862118 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4bb0c38-feab-4f94-beb1-39c56551dd70-kube-api-access-grwl5" (OuterVolumeSpecName: "kube-api-access-grwl5") pod "a4bb0c38-feab-4f94-beb1-39c56551dd70" (UID: "a4bb0c38-feab-4f94-beb1-39c56551dd70"). InnerVolumeSpecName "kube-api-access-grwl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:19:58.863563 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.863540 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-util" (OuterVolumeSpecName: "util") pod "4a65e02d-ec9f-4127-bab7-852cd2fe4009" (UID: "4a65e02d-ec9f-4127-bab7-852cd2fe4009"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:19:58.863824 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.863786 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-util" (OuterVolumeSpecName: "util") pod "a4bb0c38-feab-4f94-beb1-39c56551dd70" (UID: "a4bb0c38-feab-4f94-beb1-39c56551dd70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:19:58.955416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955347 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-bundle\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955370 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-util\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955381 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a65e02d-ec9f-4127-bab7-852cd2fe4009-bundle\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955391 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-util\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955402 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-bundle\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955413 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bb0c38-feab-4f94-beb1-39c56551dd70-util\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955425 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ec4b14-c858-41b1-915c-73ed5dc393b6-util\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955436 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6mk4\" (UniqueName: \"kubernetes.io/projected/4a65e02d-ec9f-4127-bab7-852cd2fe4009-kube-api-access-b6mk4\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955451 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f727f\" (UniqueName: \"kubernetes.io/projected/31ec4b14-c858-41b1-915c-73ed5dc393b6-kube-api-access-f727f\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955464 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grwl5\" (UniqueName: \"kubernetes.io/projected/a4bb0c38-feab-4f94-beb1-39c56551dd70-kube-api-access-grwl5\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955476 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tmpp\" (UniqueName: \"kubernetes.io/projected/ca556750-9d1a-4434-812b-7f3fa6868544-kube-api-access-7tmpp\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:58.955684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:58.955489 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca556750-9d1a-4434-812b-7f3fa6868544-bundle\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:19:59.625086 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.625060 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" Jul 03 14:19:59.625255 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.625057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8" event={"ID":"ca556750-9d1a-4434-812b-7f3fa6868544","Type":"ContainerDied","Data":"d65ea7cb40d43f0865acc61bb0359648b3739bad036e6fc2f92088ef435f783f"} Jul 03 14:19:59.625255 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.625182 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d65ea7cb40d43f0865acc61bb0359648b3739bad036e6fc2f92088ef435f783f" Jul 03 14:19:59.626758 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.626740 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" Jul 03 14:19:59.626758 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.626746 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj" event={"ID":"31ec4b14-c858-41b1-915c-73ed5dc393b6","Type":"ContainerDied","Data":"def5893ff975b8eb9464eafed60612c21335a80ce5952407499d9a3bf6784ce1"} Jul 03 14:19:59.626905 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.626781 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="def5893ff975b8eb9464eafed60612c21335a80ce5952407499d9a3bf6784ce1" Jul 03 14:19:59.628467 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.628443 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" Jul 03 14:19:59.628550 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.628470 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8" event={"ID":"4a65e02d-ec9f-4127-bab7-852cd2fe4009","Type":"ContainerDied","Data":"1ca6eab6b1633f90c72c21ad6c35a32e863b0112322863c5c20a61264c9b9341"} Jul 03 14:19:59.628550 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.628505 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ca6eab6b1633f90c72c21ad6c35a32e863b0112322863c5c20a61264c9b9341" Jul 03 14:19:59.630369 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.630345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" event={"ID":"a4bb0c38-feab-4f94-beb1-39c56551dd70","Type":"ContainerDied","Data":"543e04624fc0888caa175b1b6248364a6ad65dd3b3de479f005de15b17612e60"} Jul 03 14:19:59.630451 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.630378 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2" Jul 03 14:19:59.630451 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.630385 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="543e04624fc0888caa175b1b6248364a6ad65dd3b3de479f005de15b17612e60" Jul 03 14:19:59.896352 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896276 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-867884bcc7-pzwln"] Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896572 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerName="extract" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896582 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerName="extract" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896593 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerName="util" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896598 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerName="util" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896609 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerName="pull" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896614 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerName="pull" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896621 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerName="extract" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896627 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerName="extract" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896634 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca556750-9d1a-4434-812b-7f3fa6868544" containerName="extract" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896639 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca556750-9d1a-4434-812b-7f3fa6868544" containerName="extract" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896648 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerName="pull" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896653 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerName="pull" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896659 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca556750-9d1a-4434-812b-7f3fa6868544" containerName="pull" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896664 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca556750-9d1a-4434-812b-7f3fa6868544" containerName="pull" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896669 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerName="extract" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896674 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerName="extract" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896679 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerName="util" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896684 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerName="util" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896690 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerName="pull" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896695 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerName="pull" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896706 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerName="util" Jul 03 14:19:59.896700 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896712 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerName="util" Jul 03 14:19:59.897353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896720 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca556750-9d1a-4434-812b-7f3fa6868544" containerName="util" Jul 03 14:19:59.897353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896725 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca556750-9d1a-4434-812b-7f3fa6868544" containerName="util" Jul 03 14:19:59.897353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896772 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a65e02d-ec9f-4127-bab7-852cd2fe4009" containerName="extract" Jul 03 14:19:59.897353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896780 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ec4b14-c858-41b1-915c-73ed5dc393b6" containerName="extract" Jul 03 14:19:59.897353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896787 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4bb0c38-feab-4f94-beb1-39c56551dd70" containerName="extract" Jul 03 14:19:59.897353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.896794 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca556750-9d1a-4434-812b-7f3fa6868544" containerName="extract" Jul 03 14:19:59.902354 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.902337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:19:59.906699 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.906679 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 03 14:19:59.906826 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.906679 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4q2ln\"" Jul 03 14:19:59.906966 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.906952 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 03 14:19:59.907461 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.907446 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 03 14:19:59.907577 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.907560 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 03 14:19:59.907637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.907587 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 03 14:19:59.912440 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.912416 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 03 14:19:59.917489 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.917470 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867884bcc7-pzwln"] Jul 03 14:19:59.964464 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.964433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-trusted-ca-bundle\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:19:59.964637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.964480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-serving-cert\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:19:59.964637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.964534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-oauth-config\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:19:59.964637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.964556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7sph\" (UniqueName: \"kubernetes.io/projected/4d313fd3-8e2d-4830-a9e5-aca0da100246-kube-api-access-r7sph\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:19:59.964637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.964593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-oauth-serving-cert\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:19:59.964637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.964621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-config\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:19:59.964877 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.964675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-service-ca\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:19:59.977970 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:19:59.977938 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:00.065236 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.065208 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-oauth-config\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.065360 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.065241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7sph\" (UniqueName: \"kubernetes.io/projected/4d313fd3-8e2d-4830-a9e5-aca0da100246-kube-api-access-r7sph\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.065360 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.065263 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-oauth-serving-cert\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.065360 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.065288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-config\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.065360 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.065340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-service-ca\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.065545 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.065370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-trusted-ca-bundle\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.065545 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.065435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-serving-cert\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.066140 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.066115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-oauth-serving-cert\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.066241 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.066194 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-service-ca\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.066624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.066600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-config\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.066723 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.066701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d313fd3-8e2d-4830-a9e5-aca0da100246-trusted-ca-bundle\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.067859 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.067840 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-serving-cert\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.067944 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.067879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d313fd3-8e2d-4830-a9e5-aca0da100246-console-oauth-config\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.075631 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.075592 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:00.077026 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.077000 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7sph\" (UniqueName: \"kubernetes.io/projected/4d313fd3-8e2d-4830-a9e5-aca0da100246-kube-api-access-r7sph\") pod \"console-867884bcc7-pzwln\" (UID: \"4d313fd3-8e2d-4830-a9e5-aca0da100246\") " pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.181424 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.181335 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:00.212567 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.212536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:00.345882 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.345836 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867884bcc7-pzwln"] Jul 03 14:20:00.348268 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:00.348242 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d313fd3_8e2d_4830_a9e5_aca0da100246.slice/crio-f8ded617a936c90eb063c00cc4557909548bdfd736421b2500dd3823414864ef WatchSource:0}: Error finding container f8ded617a936c90eb063c00cc4557909548bdfd736421b2500dd3823414864ef: Status 404 returned error can't find the container with id f8ded617a936c90eb063c00cc4557909548bdfd736421b2500dd3823414864ef Jul 03 14:20:00.641404 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.641367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867884bcc7-pzwln" event={"ID":"4d313fd3-8e2d-4830-a9e5-aca0da100246","Type":"ContainerStarted","Data":"0003a21e5de23e05d752d72cc8b5b96c0527dcc8d15b9d64017ca9c0d1d2cd90"} Jul 03 14:20:00.641606 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.641436 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867884bcc7-pzwln" event={"ID":"4d313fd3-8e2d-4830-a9e5-aca0da100246","Type":"ContainerStarted","Data":"f8ded617a936c90eb063c00cc4557909548bdfd736421b2500dd3823414864ef"} Jul 03 14:20:00.666487 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.666439 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-867884bcc7-pzwln" podStartSLOduration=1.6664236749999999 podStartE2EDuration="1.666423675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:00.664683693 +0000 UTC m=+510.778505268" watchObservedRunningTime="2026-07-03 14:20:00.666423675 +0000 UTC m=+510.780245247" Jul 03 14:20:00.691105 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.691072 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:00.766529 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:00.766492 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:03.879514 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:03.879474 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:06.521248 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.521213 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk"] Jul 03 14:20:06.524140 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.524118 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:06.526815 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.526764 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tmnfd\"" Jul 03 14:20:06.536127 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.536103 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk"] Jul 03 14:20:06.619828 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.619763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psdw9\" (UniqueName: \"kubernetes.io/projected/2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb-kube-api-access-psdw9\") pod \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" (UID: \"2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:06.721318 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.721275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdw9\" (UniqueName: \"kubernetes.io/projected/2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb-kube-api-access-psdw9\") pod \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" (UID: \"2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:06.735005 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.734969 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psdw9\" (UniqueName: \"kubernetes.io/projected/2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb-kube-api-access-psdw9\") pod \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" (UID: \"2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:06.834034 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.833990 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:06.969324 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:06.969297 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk"] Jul 03 14:20:06.971256 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:06.971231 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a09d5f5_0abb_47a3_9dfe_1d46bb5762eb.slice/crio-f1e8b0ff8e23df1aa7399d9d23e88a8012564d0aa5e6b1eb02090dd0cd792949 WatchSource:0}: Error finding container f1e8b0ff8e23df1aa7399d9d23e88a8012564d0aa5e6b1eb02090dd0cd792949: Status 404 returned error can't find the container with id f1e8b0ff8e23df1aa7399d9d23e88a8012564d0aa5e6b1eb02090dd0cd792949 Jul 03 14:20:07.500832 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:07.500753 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:07.606844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:07.606780 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:07.673529 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:07.673500 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" event={"ID":"2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb","Type":"ContainerStarted","Data":"f1e8b0ff8e23df1aa7399d9d23e88a8012564d0aa5e6b1eb02090dd0cd792949"} Jul 03 14:20:09.685328 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:09.685291 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" event={"ID":"2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb","Type":"ContainerStarted","Data":"fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558"} Jul 03 14:20:09.685730 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:09.685362 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:09.703130 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:09.703079 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" podStartSLOduration=1.91572116 podStartE2EDuration="3.703060487s" totalImagesPullingTime="1.787339327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:09.701946946 +0000 UTC m=+519.815768519" watchObservedRunningTime="2026-07-03 14:20:09.703060487 +0000 UTC m=+519.816882059" Jul 03 14:20:10.213164 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:10.213124 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:10.213386 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:10.213186 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:10.218022 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:10.217998 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:10.694148 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:10.694115 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-867884bcc7-pzwln" Jul 03 14:20:10.869753 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:10.869722 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:10.971080 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:10.970999 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:11.033257 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.033221 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:11.612923 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.612894 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q"] Jul 03 14:20:11.620837 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.620783 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:11.623577 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.623553 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dhz9f\"" Jul 03 14:20:11.633768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.633735 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q"] Jul 03 14:20:11.664827 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.664753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmknr\" (UniqueName: \"kubernetes.io/projected/5343eeea-4e62-4a12-be09-4bd2915f9095-kube-api-access-nmknr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" (UID: \"5343eeea-4e62-4a12-be09-4bd2915f9095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:11.664827 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.664833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5343eeea-4e62-4a12-be09-4bd2915f9095-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" (UID: \"5343eeea-4e62-4a12-be09-4bd2915f9095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:11.765375 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.765333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmknr\" (UniqueName: \"kubernetes.io/projected/5343eeea-4e62-4a12-be09-4bd2915f9095-kube-api-access-nmknr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" (UID: \"5343eeea-4e62-4a12-be09-4bd2915f9095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:11.765880 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.765410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5343eeea-4e62-4a12-be09-4bd2915f9095-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" (UID: \"5343eeea-4e62-4a12-be09-4bd2915f9095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:11.765880 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.765783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5343eeea-4e62-4a12-be09-4bd2915f9095-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" (UID: \"5343eeea-4e62-4a12-be09-4bd2915f9095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:11.779175 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.779147 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmknr\" (UniqueName: \"kubernetes.io/projected/5343eeea-4e62-4a12-be09-4bd2915f9095-kube-api-access-nmknr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" (UID: \"5343eeea-4e62-4a12-be09-4bd2915f9095\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:11.934769 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:11.934678 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:12.075585 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:12.075560 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q"] Jul 03 14:20:12.077890 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:12.077860 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5343eeea_4e62_4a12_be09_4bd2915f9095.slice/crio-e87ba12bda3035b8bc5cc360a73b8c4e1b2105e48c227357209a037a031b86fe WatchSource:0}: Error finding container e87ba12bda3035b8bc5cc360a73b8c4e1b2105e48c227357209a037a031b86fe: Status 404 returned error can't find the container with id e87ba12bda3035b8bc5cc360a73b8c4e1b2105e48c227357209a037a031b86fe Jul 03 14:20:12.539780 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:12.539749 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:12.700250 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:12.700218 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" event={"ID":"5343eeea-4e62-4a12-be09-4bd2915f9095","Type":"ContainerStarted","Data":"e87ba12bda3035b8bc5cc360a73b8c4e1b2105e48c227357209a037a031b86fe"} Jul 03 14:20:12.708183 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:12.708144 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:14.511165 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.511131 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw"] Jul 03 14:20:14.514480 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.514464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" Jul 03 14:20:14.517561 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.517541 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 03 14:20:14.517880 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.517862 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-55frq\"" Jul 03 14:20:14.531057 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.531036 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw"] Jul 03 14:20:14.589166 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.589134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4vr\" (UniqueName: \"kubernetes.io/projected/3412a6a0-53a0-4b64-80ae-d5b096096b33-kube-api-access-pq4vr\") pod \"dns-operator-controller-manager-864dd78c4c-nr9vw\" (UID: \"3412a6a0-53a0-4b64-80ae-d5b096096b33\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" Jul 03 14:20:14.690260 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.690230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4vr\" (UniqueName: \"kubernetes.io/projected/3412a6a0-53a0-4b64-80ae-d5b096096b33-kube-api-access-pq4vr\") pod \"dns-operator-controller-manager-864dd78c4c-nr9vw\" (UID: \"3412a6a0-53a0-4b64-80ae-d5b096096b33\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" Jul 03 14:20:14.704349 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.704317 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4vr\" (UniqueName: \"kubernetes.io/projected/3412a6a0-53a0-4b64-80ae-d5b096096b33-kube-api-access-pq4vr\") pod \"dns-operator-controller-manager-864dd78c4c-nr9vw\" (UID: \"3412a6a0-53a0-4b64-80ae-d5b096096b33\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" Jul 03 14:20:14.824958 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.824926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" Jul 03 14:20:14.932248 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.932217 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:14.968774 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:14.968746 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw"] Jul 03 14:20:14.969310 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:14.969281 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3412a6a0_53a0_4b64_80ae_d5b096096b33.slice/crio-a27728c24ce4998097a0b3a20e6be0e6d70a66f59ed38d445c374ec5471d2e43 WatchSource:0}: Error finding container a27728c24ce4998097a0b3a20e6be0e6d70a66f59ed38d445c374ec5471d2e43: Status 404 returned error can't find the container with id a27728c24ce4998097a0b3a20e6be0e6d70a66f59ed38d445c374ec5471d2e43 Jul 03 14:20:15.079647 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:15.079575 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:15.719000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:15.718964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" event={"ID":"3412a6a0-53a0-4b64-80ae-d5b096096b33","Type":"ContainerStarted","Data":"a27728c24ce4998097a0b3a20e6be0e6d70a66f59ed38d445c374ec5471d2e43"} Jul 03 14:20:15.909239 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:15.909202 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:17.333317 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:17.333284 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:17.731781 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:17.731699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" event={"ID":"3412a6a0-53a0-4b64-80ae-d5b096096b33","Type":"ContainerStarted","Data":"c916b3797c968a5e6f87fb7e71f97423232f8fe0ea9701490db5d9201e66a0e9"} Jul 03 14:20:17.731976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:17.731810 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" Jul 03 14:20:17.756416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:17.756364 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" podStartSLOduration=1.98514451 podStartE2EDuration="3.756348103s" totalImagesPullingTime="1.771203593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:17.755001054 +0000 UTC m=+527.868822629" watchObservedRunningTime="2026-07-03 14:20:17.756348103 +0000 UTC m=+527.870169747" Jul 03 14:20:18.238058 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.238023 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r"] Jul 03 14:20:18.241687 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.241666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" Jul 03 14:20:18.244136 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.244110 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6dmwz\"" Jul 03 14:20:18.252933 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.252910 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r"] Jul 03 14:20:18.322433 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.322401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jfnk\" (UniqueName: \"kubernetes.io/projected/11f11ebf-dc5c-486d-8ff6-65714e01ab73-kube-api-access-8jfnk\") pod \"authorino-operator-75cc8d5cb7-6wp5r\" (UID: \"11f11ebf-dc5c-486d-8ff6-65714e01ab73\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" Jul 03 14:20:18.423466 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.423430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jfnk\" (UniqueName: \"kubernetes.io/projected/11f11ebf-dc5c-486d-8ff6-65714e01ab73-kube-api-access-8jfnk\") pod \"authorino-operator-75cc8d5cb7-6wp5r\" (UID: \"11f11ebf-dc5c-486d-8ff6-65714e01ab73\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" Jul 03 14:20:18.435222 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.435194 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jfnk\" (UniqueName: \"kubernetes.io/projected/11f11ebf-dc5c-486d-8ff6-65714e01ab73-kube-api-access-8jfnk\") pod \"authorino-operator-75cc8d5cb7-6wp5r\" (UID: \"11f11ebf-dc5c-486d-8ff6-65714e01ab73\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" Jul 03 14:20:18.554355 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.554327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" Jul 03 14:20:18.687561 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.687539 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r"] Jul 03 14:20:18.689535 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:18.689505 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f11ebf_dc5c_486d_8ff6_65714e01ab73.slice/crio-0aaf41bfa6864d6c985e6f9e52a80a6d0c7aced8359d5dd6e4dd7158e3844dd0 WatchSource:0}: Error finding container 0aaf41bfa6864d6c985e6f9e52a80a6d0c7aced8359d5dd6e4dd7158e3844dd0: Status 404 returned error can't find the container with id 0aaf41bfa6864d6c985e6f9e52a80a6d0c7aced8359d5dd6e4dd7158e3844dd0 Jul 03 14:20:18.736692 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:18.736663 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" event={"ID":"11f11ebf-dc5c-486d-8ff6-65714e01ab73","Type":"ContainerStarted","Data":"0aaf41bfa6864d6c985e6f9e52a80a6d0c7aced8359d5dd6e4dd7158e3844dd0"} Jul 03 14:20:19.693725 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:19.693683 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:19.794854 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:19.794818 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:20.693195 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:20.693163 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:22.763592 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:22.763563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" event={"ID":"5343eeea-4e62-4a12-be09-4bd2915f9095","Type":"ContainerStarted","Data":"41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b"} Jul 03 14:20:22.764018 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:22.763627 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:22.765306 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:22.765274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" event={"ID":"11f11ebf-dc5c-486d-8ff6-65714e01ab73","Type":"ContainerStarted","Data":"2d01e5d5e6d2ca06e8ee570100d26bb66573e36bd99619e0bec62ac18b804a60"} Jul 03 14:20:22.765413 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:22.765377 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" Jul 03 14:20:22.785869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:22.785827 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" podStartSLOduration=1.8956685370000002 podStartE2EDuration="11.785796358s" totalImagesPullingTime="9.890127821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:22.784392978 +0000 UTC m=+532.898214553" watchObservedRunningTime="2026-07-03 14:20:22.785796358 +0000 UTC m=+532.899617930" Jul 03 14:20:22.802949 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:22.802911 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" podStartSLOduration=1.527733924 podStartE2EDuration="4.80289878s" totalImagesPullingTime="3.275164856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:22.802201794 +0000 UTC m=+532.916023367" watchObservedRunningTime="2026-07-03 14:20:22.80289878 +0000 UTC m=+532.916720357" Jul 03 14:20:22.890643 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:22.890618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:22.994945 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:22.994913 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:24.666931 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.666887 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s"] Jul 03 14:20:24.668335 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.668301 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:24.670517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.670500 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.672880 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.672859 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 03 14:20:24.672996 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.672930 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gxvzb\"" Jul 03 14:20:24.672996 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.672968 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 03 14:20:24.680867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.680845 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s"] Jul 03 14:20:24.775223 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.775194 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/577909d8-5c92-4994-bd02-8405cbb236b5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.775367 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.775251 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/577909d8-5c92-4994-bd02-8405cbb236b5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.775434 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.775363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pdrz\" (UniqueName: \"kubernetes.io/projected/577909d8-5c92-4994-bd02-8405cbb236b5-kube-api-access-6pdrz\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.876280 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.876247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/577909d8-5c92-4994-bd02-8405cbb236b5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.876444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.876324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/577909d8-5c92-4994-bd02-8405cbb236b5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.876444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.876402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pdrz\" (UniqueName: \"kubernetes.io/projected/577909d8-5c92-4994-bd02-8405cbb236b5-kube-api-access-6pdrz\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.877039 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.877012 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/577909d8-5c92-4994-bd02-8405cbb236b5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.878924 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.878905 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/577909d8-5c92-4994-bd02-8405cbb236b5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.886760 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.886736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pdrz\" (UniqueName: \"kubernetes.io/projected/577909d8-5c92-4994-bd02-8405cbb236b5-kube-api-access-6pdrz\") pod \"kuadrant-console-plugin-66b5774985-75n6s\" (UID: \"577909d8-5c92-4994-bd02-8405cbb236b5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:24.927371 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.927306 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:24.980830 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:24.980791 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" Jul 03 14:20:25.113601 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:25.113578 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s"] Jul 03 14:20:25.115362 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:25.115336 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod577909d8_5c92_4994_bd02_8405cbb236b5.slice/crio-6902c5b3cf1240ee44ebe334e4dc84455afb0c4b93ecdf68bba3ee9b477a0908 WatchSource:0}: Error finding container 6902c5b3cf1240ee44ebe334e4dc84455afb0c4b93ecdf68bba3ee9b477a0908: Status 404 returned error can't find the container with id 6902c5b3cf1240ee44ebe334e4dc84455afb0c4b93ecdf68bba3ee9b477a0908 Jul 03 14:20:25.779675 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:25.779644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" event={"ID":"577909d8-5c92-4994-bd02-8405cbb236b5","Type":"ContainerStarted","Data":"6902c5b3cf1240ee44ebe334e4dc84455afb0c4b93ecdf68bba3ee9b477a0908"} Jul 03 14:20:28.739653 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:28.739626 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nr9vw" Jul 03 14:20:28.954521 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:28.954476 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:29.057871 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:29.057759 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:33.771810 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:33.771724 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wp5r" Jul 03 14:20:33.772267 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:33.771836 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:34.992988 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:34.992952 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh"] Jul 03 14:20:35.015321 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.014863 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.016969 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.016945 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh"] Jul 03 14:20:35.135438 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.135404 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh"] Jul 03 14:20:35.135737 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.135712 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-mxqzr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" podUID="4c59eed2-98cf-47a2-b079-540811e8e0e7" Jul 03 14:20:35.171669 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.171637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxqzr\" (UniqueName: \"kubernetes.io/projected/4c59eed2-98cf-47a2-b079-540811e8e0e7-kube-api-access-mxqzr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" (UID: \"4c59eed2-98cf-47a2-b079-540811e8e0e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.171840 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.171695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c59eed2-98cf-47a2-b079-540811e8e0e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" (UID: \"4c59eed2-98cf-47a2-b079-540811e8e0e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.180950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.180921 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp"] Jul 03 14:20:35.190129 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.190101 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:35.202359 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.202331 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp"] Jul 03 14:20:35.273172 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.273099 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxqzr\" (UniqueName: \"kubernetes.io/projected/4c59eed2-98cf-47a2-b079-540811e8e0e7-kube-api-access-mxqzr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" (UID: \"4c59eed2-98cf-47a2-b079-540811e8e0e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.273172 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.273150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cmv9\" (UniqueName: \"kubernetes.io/projected/b4acc617-5896-4642-8a52-cb5075c753a5-kube-api-access-6cmv9\") pod \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" (UID: \"b4acc617-5896-4642-8a52-cb5075c753a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:35.273389 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.273180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c59eed2-98cf-47a2-b079-540811e8e0e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" (UID: \"4c59eed2-98cf-47a2-b079-540811e8e0e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.273389 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.273208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4acc617-5896-4642-8a52-cb5075c753a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" (UID: \"b4acc617-5896-4642-8a52-cb5075c753a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:35.273614 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.273594 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c59eed2-98cf-47a2-b079-540811e8e0e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" (UID: \"4c59eed2-98cf-47a2-b079-540811e8e0e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.284502 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.284466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxqzr\" (UniqueName: \"kubernetes.io/projected/4c59eed2-98cf-47a2-b079-540811e8e0e7-kube-api-access-mxqzr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" (UID: \"4c59eed2-98cf-47a2-b079-540811e8e0e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.374102 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.374064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cmv9\" (UniqueName: \"kubernetes.io/projected/b4acc617-5896-4642-8a52-cb5075c753a5-kube-api-access-6cmv9\") pod \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" (UID: \"b4acc617-5896-4642-8a52-cb5075c753a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:35.374102 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.374114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4acc617-5896-4642-8a52-cb5075c753a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" (UID: \"b4acc617-5896-4642-8a52-cb5075c753a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:35.374512 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.374491 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4acc617-5896-4642-8a52-cb5075c753a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" (UID: \"b4acc617-5896-4642-8a52-cb5075c753a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:35.390352 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.390327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cmv9\" (UniqueName: \"kubernetes.io/projected/b4acc617-5896-4642-8a52-cb5075c753a5-kube-api-access-6cmv9\") pod \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" (UID: \"b4acc617-5896-4642-8a52-cb5075c753a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:35.504440 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.504403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:35.549909 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.549867 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:35.651304 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.651240 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:35.668603 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.668577 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp"] Jul 03 14:20:35.682587 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.682562 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp"] Jul 03 14:20:35.693436 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.693411 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh"] Jul 03 14:20:35.695350 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.695327 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd"] Jul 03 14:20:35.702176 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.702154 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh"] Jul 03 14:20:35.702308 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.702258 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:35.719166 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.719136 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q"] Jul 03 14:20:35.719433 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.719358 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" containerName="manager" containerID="cri-o://41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b" gracePeriod=2 Jul 03 14:20:35.721879 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.721858 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd"] Jul 03 14:20:35.732630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.732559 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q"] Jul 03 14:20:35.744426 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.744400 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk"] Jul 03 14:20:35.744684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.744657 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" containerName="manager" containerID="cri-o://fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558" gracePeriod=2 Jul 03 14:20:35.758165 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.757945 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:35.758739 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.758678 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk"] Jul 03 14:20:35.760029 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.759992 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:35.761739 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.761711 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg"] Jul 03 14:20:35.762300 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.762252 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" containerName="manager" Jul 03 14:20:35.762300 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.762271 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" containerName="manager" Jul 03 14:20:35.762300 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.762284 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" containerName="manager" Jul 03 14:20:35.762300 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.762293 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" containerName="manager" Jul 03 14:20:35.762650 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.762394 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" containerName="manager" Jul 03 14:20:35.762650 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.762411 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" containerName="manager" Jul 03 14:20:35.767472 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.767451 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:35.772854 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.772818 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:35.773082 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.773057 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg"] Jul 03 14:20:35.778279 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.778242 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtzzm\" (UniqueName: \"kubernetes.io/projected/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-kube-api-access-jtzzm\") pod \"kuadrant-operator-controller-manager-55467d9f7-rnrkd\" (UID: \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:35.778400 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.778314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rnrkd\" (UID: \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:35.806262 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.806170 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:35.845909 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.845879 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.849433 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.849394 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:35.853902 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.853869 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="4c59eed2-98cf-47a2-b079-540811e8e0e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.855900 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.855869 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:35.863521 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.863497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.867034 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.867003 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:35.869352 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.869324 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="4c59eed2-98cf-47a2-b079-540811e8e0e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:35.871428 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:35.871392 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:35.879901 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.879872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtzzm\" (UniqueName: \"kubernetes.io/projected/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-kube-api-access-jtzzm\") pod \"kuadrant-operator-controller-manager-55467d9f7-rnrkd\" (UID: \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:35.880007 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.879936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wrpdg\" (UID: \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:35.880007 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.879992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rnrkd\" (UID: \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:35.880147 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.880058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qp5f\" (UniqueName: \"kubernetes.io/projected/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-kube-api-access-6qp5f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wrpdg\" (UID: \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:35.880333 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.880311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rnrkd\" (UID: \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:35.890251 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.890220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtzzm\" (UniqueName: \"kubernetes.io/projected/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-kube-api-access-jtzzm\") pod \"kuadrant-operator-controller-manager-55467d9f7-rnrkd\" (UID: \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:35.980808 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.980770 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxqzr\" (UniqueName: \"kubernetes.io/projected/4c59eed2-98cf-47a2-b079-540811e8e0e7-kube-api-access-mxqzr\") pod \"4c59eed2-98cf-47a2-b079-540811e8e0e7\" (UID: \"4c59eed2-98cf-47a2-b079-540811e8e0e7\") " Jul 03 14:20:35.981012 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.980858 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c59eed2-98cf-47a2-b079-540811e8e0e7-extensions-socket-volume\") pod \"4c59eed2-98cf-47a2-b079-540811e8e0e7\" (UID: \"4c59eed2-98cf-47a2-b079-540811e8e0e7\") " Jul 03 14:20:35.981107 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.981085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wrpdg\" (UID: \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:35.981211 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.981192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qp5f\" (UniqueName: \"kubernetes.io/projected/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-kube-api-access-6qp5f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wrpdg\" (UID: \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:35.981285 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.981220 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c59eed2-98cf-47a2-b079-540811e8e0e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4c59eed2-98cf-47a2-b079-540811e8e0e7" (UID: "4c59eed2-98cf-47a2-b079-540811e8e0e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:20:35.981354 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.981336 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c59eed2-98cf-47a2-b079-540811e8e0e7-extensions-socket-volume\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:35.981583 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.981554 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wrpdg\" (UID: \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:35.983435 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.983410 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c59eed2-98cf-47a2-b079-540811e8e0e7-kube-api-access-mxqzr" (OuterVolumeSpecName: "kube-api-access-mxqzr") pod "4c59eed2-98cf-47a2-b079-540811e8e0e7" (UID: "4c59eed2-98cf-47a2-b079-540811e8e0e7"). InnerVolumeSpecName "kube-api-access-mxqzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:20:35.997818 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:35.997775 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qp5f\" (UniqueName: \"kubernetes.io/projected/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-kube-api-access-6qp5f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wrpdg\" (UID: \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:36.017239 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:36.017201 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:36.082731 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:36.082644 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxqzr\" (UniqueName: \"kubernetes.io/projected/4c59eed2-98cf-47a2-b079-540811e8e0e7-kube-api-access-mxqzr\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:36.157107 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:36.157067 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:36.361355 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:36.361257 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c59eed2-98cf-47a2-b079-540811e8e0e7" path="/var/lib/kubelet/pods/4c59eed2-98cf-47a2-b079-540811e8e0e7/volumes" Jul 03 14:20:36.850425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:36.850394 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:36.854896 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:36.854857 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rpjjh\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="4c59eed2-98cf-47a2-b079-540811e8e0e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rpjjh" Jul 03 14:20:38.158365 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:38.158288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:38.305442 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:38.305403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:41.113391 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:41.113356 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:41.213660 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:41.213622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:44.546323 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:44.546287 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:44.646398 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:44.646362 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:46.666088 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.666067 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:46.666855 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.666835 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd"] Jul 03 14:20:46.668214 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:46.668096 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1d8f02_d9f1_4eec_ae87_d7f597516bb3.slice/crio-045eceb0c2cd3462b90ae2670ca7d428dc722c96ae26b42c1c01b7520a346aec WatchSource:0}: Error finding container 045eceb0c2cd3462b90ae2670ca7d428dc722c96ae26b42c1c01b7520a346aec: Status 404 returned error can't find the container with id 045eceb0c2cd3462b90ae2670ca7d428dc722c96ae26b42c1c01b7520a346aec Jul 03 14:20:46.668332 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.668298 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:46.668332 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.668300 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:46.670976 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.670952 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:46.672686 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.672657 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:46.681962 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.681941 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psdw9\" (UniqueName: \"kubernetes.io/projected/2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb-kube-api-access-psdw9\") pod \"2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb\" (UID: \"2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb\") " Jul 03 14:20:46.683644 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.683626 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb-kube-api-access-psdw9" (OuterVolumeSpecName: "kube-api-access-psdw9") pod "2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" (UID: "2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb"). InnerVolumeSpecName "kube-api-access-psdw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:20:46.689331 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.689311 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg"] Jul 03 14:20:46.690549 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:46.690521 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e85d1f1_bc5e_4e3b_aed2_6eb7da6e8b06.slice/crio-9e5bf820e2eb5bbe19eb6b5788c00858584d6f8bc087fb71848261c4173bd58f WatchSource:0}: Error finding container 9e5bf820e2eb5bbe19eb6b5788c00858584d6f8bc087fb71848261c4173bd58f: Status 404 returned error can't find the container with id 9e5bf820e2eb5bbe19eb6b5788c00858584d6f8bc087fb71848261c4173bd58f Jul 03 14:20:46.782954 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.782919 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5343eeea-4e62-4a12-be09-4bd2915f9095-extensions-socket-volume\") pod \"5343eeea-4e62-4a12-be09-4bd2915f9095\" (UID: \"5343eeea-4e62-4a12-be09-4bd2915f9095\") " Jul 03 14:20:46.782954 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.782969 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmknr\" (UniqueName: \"kubernetes.io/projected/5343eeea-4e62-4a12-be09-4bd2915f9095-kube-api-access-nmknr\") pod \"5343eeea-4e62-4a12-be09-4bd2915f9095\" (UID: \"5343eeea-4e62-4a12-be09-4bd2915f9095\") " Jul 03 14:20:46.783243 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.783227 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psdw9\" (UniqueName: \"kubernetes.io/projected/2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb-kube-api-access-psdw9\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:46.783295 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.783237 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5343eeea-4e62-4a12-be09-4bd2915f9095-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5343eeea-4e62-4a12-be09-4bd2915f9095" (UID: "5343eeea-4e62-4a12-be09-4bd2915f9095"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:20:46.784813 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.784782 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5343eeea-4e62-4a12-be09-4bd2915f9095-kube-api-access-nmknr" (OuterVolumeSpecName: "kube-api-access-nmknr") pod "5343eeea-4e62-4a12-be09-4bd2915f9095" (UID: "5343eeea-4e62-4a12-be09-4bd2915f9095"). InnerVolumeSpecName "kube-api-access-nmknr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:20:46.884013 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.883981 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5343eeea-4e62-4a12-be09-4bd2915f9095-extensions-socket-volume\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:46.884013 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.884013 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmknr\" (UniqueName: \"kubernetes.io/projected/5343eeea-4e62-4a12-be09-4bd2915f9095-kube-api-access-nmknr\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:46.907654 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.907621 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" event={"ID":"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06","Type":"ContainerStarted","Data":"d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57"} Jul 03 14:20:46.907796 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.907682 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:46.907796 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.907705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" event={"ID":"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06","Type":"ContainerStarted","Data":"9e5bf820e2eb5bbe19eb6b5788c00858584d6f8bc087fb71848261c4173bd58f"} Jul 03 14:20:46.908921 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.908896 2574 generic.go:356] "Generic (PLEG): container finished" podID="5343eeea-4e62-4a12-be09-4bd2915f9095" containerID="41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b" exitCode=0 Jul 03 14:20:46.909029 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.908933 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:46.909029 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.908997 2574 scope.go:117] "RemoveContainer" containerID="41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b" Jul 03 14:20:46.909615 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.909581 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:46.910301 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.910277 2574 generic.go:356] "Generic (PLEG): container finished" podID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" containerID="fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558" exitCode=0 Jul 03 14:20:46.910398 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.910307 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:46.911272 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.911241 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:46.912340 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.912314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" event={"ID":"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3","Type":"ContainerStarted","Data":"24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a"} Jul 03 14:20:46.912452 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.912360 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" event={"ID":"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3","Type":"ContainerStarted","Data":"045eceb0c2cd3462b90ae2670ca7d428dc722c96ae26b42c1c01b7520a346aec"} Jul 03 14:20:46.912452 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.912390 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:46.913969 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.913946 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" event={"ID":"577909d8-5c92-4994-bd02-8405cbb236b5","Type":"ContainerStarted","Data":"d42a72531b48961f53817ed83d1c49d89f30b151184b1409fb6e50de7d9ba2c4"} Jul 03 14:20:46.918884 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.918864 2574 scope.go:117] "RemoveContainer" containerID="41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b" Jul 03 14:20:46.919147 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.919124 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b\": container with ID starting with 41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b not found: ID does not exist" containerID="41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b" Jul 03 14:20:46.919216 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.919158 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b"} err="failed to get container status \"41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b\": rpc error: code = NotFound desc = could not find container \"41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b\": container with ID starting with 41e98e2da4772b2d22a779b88a254e16075561156058b55a549a9c74aff1a28b not found: ID does not exist" Jul 03 14:20:46.919216 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.919176 2574 scope.go:117] "RemoveContainer" containerID="fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558" Jul 03 14:20:46.926590 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.926574 2574 scope.go:117] "RemoveContainer" containerID="fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558" Jul 03 14:20:46.926840 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.926823 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558\": container with ID starting with fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558 not found: ID does not exist" containerID="fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558" Jul 03 14:20:46.926890 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.926847 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558"} err="failed to get container status \"fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558\": rpc error: code = NotFound desc = could not find container \"fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558\": container with ID starting with fd35e6e3c2853f46d80c7bffb7f351e60fc5eb99d226f4622f7dd9e3c3ff7558 not found: ID does not exist" Jul 03 14:20:46.930417 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.930381 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" podStartSLOduration=11.930370723 podStartE2EDuration="11.930370723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:46.92932954 +0000 UTC m=+557.043151119" watchObservedRunningTime="2026-07-03 14:20:46.930370723 +0000 UTC m=+557.044192296" Jul 03 14:20:46.931313 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.931295 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tvnmk\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tvnmk" Jul 03 14:20:46.953002 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.952955 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" podStartSLOduration=11.952939677 podStartE2EDuration="11.952939677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:46.952634235 +0000 UTC m=+557.066455811" watchObservedRunningTime="2026-07-03 14:20:46.952939677 +0000 UTC m=+557.066761256" Jul 03 14:20:46.954510 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:46.954487 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-db49q\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-db49q" Jul 03 14:20:46.974930 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:46.974894 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-75n6s" podStartSLOduration=1.502577566 podStartE2EDuration="22.974881036s" totalImagesPullingTime="21.47230347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:46.973880515 +0000 UTC m=+557.087702101" watchObservedRunningTime="2026-07-03 14:20:46.974881036 +0000 UTC m=+557.088702656" Jul 03 14:20:48.358680 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:48.358641 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb" path="/var/lib/kubelet/pods/2a09d5f5-0abb-47a3-9dfe-1d46bb5762eb/volumes" Jul 03 14:20:48.359058 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:48.359008 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5343eeea-4e62-4a12-be09-4bd2915f9095" path="/var/lib/kubelet/pods/5343eeea-4e62-4a12-be09-4bd2915f9095/volumes" Jul 03 14:20:49.043929 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:49.043888 2574 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-l5rwp_kuadrant-system_b4acc617-5896-4642-8a52-cb5075c753a5_0(a13aac00c16066701855918e5bacd85cc0c2e93f144a021d8d9b75e6702a8296): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-l5rwp to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 03 14:20:49.043999 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:49.043957 2574 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-l5rwp_kuadrant-system_b4acc617-5896-4642-8a52-cb5075c753a5_0(a13aac00c16066701855918e5bacd85cc0c2e93f144a021d8d9b75e6702a8296): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-l5rwp to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:49.310522 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:49.310490 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:49.374673 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:49.374637 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:49.931160 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:49.931125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:49.933533 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:49.933499 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="b4acc617-5896-4642-8a52-cb5075c753a5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:49.943018 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:49.942999 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:49.945254 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:49.945230 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="b4acc617-5896-4642-8a52-cb5075c753a5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:50.004253 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:50.004230 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cmv9\" (UniqueName: \"kubernetes.io/projected/b4acc617-5896-4642-8a52-cb5075c753a5-kube-api-access-6cmv9\") pod \"b4acc617-5896-4642-8a52-cb5075c753a5\" (UID: \"b4acc617-5896-4642-8a52-cb5075c753a5\") " Jul 03 14:20:50.004327 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:50.004299 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4acc617-5896-4642-8a52-cb5075c753a5-extensions-socket-volume\") pod \"b4acc617-5896-4642-8a52-cb5075c753a5\" (UID: \"b4acc617-5896-4642-8a52-cb5075c753a5\") " Jul 03 14:20:50.004585 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:50.004553 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4acc617-5896-4642-8a52-cb5075c753a5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b4acc617-5896-4642-8a52-cb5075c753a5" (UID: "b4acc617-5896-4642-8a52-cb5075c753a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:20:50.006159 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:50.006133 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4acc617-5896-4642-8a52-cb5075c753a5-kube-api-access-6cmv9" (OuterVolumeSpecName: "kube-api-access-6cmv9") pod "b4acc617-5896-4642-8a52-cb5075c753a5" (UID: "b4acc617-5896-4642-8a52-cb5075c753a5"). InnerVolumeSpecName "kube-api-access-6cmv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:20:50.104737 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:50.104709 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cmv9\" (UniqueName: \"kubernetes.io/projected/b4acc617-5896-4642-8a52-cb5075c753a5-kube-api-access-6cmv9\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:50.104737 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:50.104734 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4acc617-5896-4642-8a52-cb5075c753a5-extensions-socket-volume\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:50.357831 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:50.357774 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="b4acc617-5896-4642-8a52-cb5075c753a5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:50.359046 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:50.359027 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4acc617-5896-4642-8a52-cb5075c753a5" path="/var/lib/kubelet/pods/b4acc617-5896-4642-8a52-cb5075c753a5/volumes" Jul 03 14:20:50.936125 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:50.936099 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:50.938507 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:50.938476 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="b4acc617-5896-4642-8a52-cb5075c753a5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:50.940381 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:50.940361 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l5rwp\" is forbidden: User \"system:node:ip-10-0-137-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-36.ec2.internal' and this object" podUID="b4acc617-5896-4642-8a52-cb5075c753a5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l5rwp" Jul 03 14:20:55.093720 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:55.093683 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:55.153647 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:55.153607 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:55.704211 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:55.704171 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:55.801127 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:55.801100 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:20:57.923612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:57.923580 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:57.924128 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:57.923666 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:20:58.001197 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.001164 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg"] Jul 03 14:20:58.001348 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.001331 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" podUID="8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06" containerName="manager" containerID="cri-o://d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57" gracePeriod=10 Jul 03 14:20:58.232550 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.232468 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l"] Jul 03 14:20:58.235591 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.235569 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.248348 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.248322 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l"] Jul 03 14:20:58.267792 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.267772 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:58.274213 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.274193 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9rh4\" (UniqueName: \"kubernetes.io/projected/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-kube-api-access-m9rh4\") pod \"kuadrant-operator-controller-manager-86878c769f-65m7l\" (UID: \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.274299 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.274236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-65m7l\" (UID: \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.375009 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.374983 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qp5f\" (UniqueName: \"kubernetes.io/projected/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-kube-api-access-6qp5f\") pod \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\" (UID: \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\") " Jul 03 14:20:58.375171 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.375026 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-extensions-socket-volume\") pod \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\" (UID: \"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06\") " Jul 03 14:20:58.375171 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.375158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-65m7l\" (UID: \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.375293 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.375234 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rh4\" (UniqueName: \"kubernetes.io/projected/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-kube-api-access-m9rh4\") pod \"kuadrant-operator-controller-manager-86878c769f-65m7l\" (UID: \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.375470 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.375448 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06" (UID: "8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:20:58.375525 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.375478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-65m7l\" (UID: \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.376952 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.376924 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-kube-api-access-6qp5f" (OuterVolumeSpecName: "kube-api-access-6qp5f") pod "8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06" (UID: "8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06"). InnerVolumeSpecName "kube-api-access-6qp5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:20:58.388845 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.388823 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9rh4\" (UniqueName: \"kubernetes.io/projected/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-kube-api-access-m9rh4\") pod \"kuadrant-operator-controller-manager-86878c769f-65m7l\" (UID: \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.476136 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.476108 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qp5f\" (UniqueName: \"kubernetes.io/projected/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-kube-api-access-6qp5f\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:58.476136 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.476133 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06-extensions-socket-volume\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:20:58.564451 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.564417 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.723376 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.723351 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l"] Jul 03 14:20:58.725498 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:20:58.725462 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2795eb5b_a03b_4e58_b47b_364e5a6e59bb.slice/crio-5fb4d896d9a715743c70685b00634c68e4486a16249af14a49e829a6175c8111 WatchSource:0}: Error finding container 5fb4d896d9a715743c70685b00634c68e4486a16249af14a49e829a6175c8111: Status 404 returned error can't find the container with id 5fb4d896d9a715743c70685b00634c68e4486a16249af14a49e829a6175c8111 Jul 03 14:20:58.977111 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.977024 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06" containerID="d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57" exitCode=0 Jul 03 14:20:58.977111 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.977071 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" Jul 03 14:20:58.977111 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.977102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" event={"ID":"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06","Type":"ContainerDied","Data":"d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57"} Jul 03 14:20:58.977573 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.977155 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg" event={"ID":"8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06","Type":"ContainerDied","Data":"9e5bf820e2eb5bbe19eb6b5788c00858584d6f8bc087fb71848261c4173bd58f"} Jul 03 14:20:58.977573 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.977179 2574 scope.go:117] "RemoveContainer" containerID="d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57" Jul 03 14:20:58.979211 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.979185 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" event={"ID":"2795eb5b-a03b-4e58-b47b-364e5a6e59bb","Type":"ContainerStarted","Data":"a11cdce8646625710ba89ff1abc2840ef71b228a36d376ae58f7df1ee536f012"} Jul 03 14:20:58.979333 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.979233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" event={"ID":"2795eb5b-a03b-4e58-b47b-364e5a6e59bb","Type":"ContainerStarted","Data":"5fb4d896d9a715743c70685b00634c68e4486a16249af14a49e829a6175c8111"} Jul 03 14:20:58.979333 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.979331 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:20:58.986184 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.986170 2574 scope.go:117] "RemoveContainer" containerID="d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57" Jul 03 14:20:58.986400 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:20:58.986382 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57\": container with ID starting with d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57 not found: ID does not exist" containerID="d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57" Jul 03 14:20:58.986448 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:58.986409 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57"} err="failed to get container status \"d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57\": rpc error: code = NotFound desc = could not find container \"d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57\": container with ID starting with d5c6d5c5ca83f9fa38a4c90c672bd7a27267387573bf8f1cad60005cdfa25d57 not found: ID does not exist" Jul 03 14:20:59.005612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:59.005573 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" podStartSLOduration=1.005560322 podStartE2EDuration="1.005560322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:20:59.004712286 +0000 UTC m=+569.118533858" watchObservedRunningTime="2026-07-03 14:20:59.005560322 +0000 UTC m=+569.119381894" Jul 03 14:20:59.020987 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:59.020965 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg"] Jul 03 14:20:59.031657 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:20:59.031637 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wrpdg"] Jul 03 14:21:00.359522 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:00.359492 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06" path="/var/lib/kubelet/pods/8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06/volumes" Jul 03 14:21:01.257640 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:01.257582 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:09.987562 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:09.987532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:21:10.047477 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.047439 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd"] Jul 03 14:21:10.047656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.047635 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" podUID="ce1d8f02-d9f1-4eec-ae87-d7f597516bb3" containerName="manager" containerID="cri-o://24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a" gracePeriod=10 Jul 03 14:21:10.826776 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.826748 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:21:10.886387 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.886354 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtzzm\" (UniqueName: \"kubernetes.io/projected/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-kube-api-access-jtzzm\") pod \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\" (UID: \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\") " Jul 03 14:21:10.886542 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.886404 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-extensions-socket-volume\") pod \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\" (UID: \"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3\") " Jul 03 14:21:10.886794 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.886773 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ce1d8f02-d9f1-4eec-ae87-d7f597516bb3" (UID: "ce1d8f02-d9f1-4eec-ae87-d7f597516bb3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:21:10.888492 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.888470 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-kube-api-access-jtzzm" (OuterVolumeSpecName: "kube-api-access-jtzzm") pod "ce1d8f02-d9f1-4eec-ae87-d7f597516bb3" (UID: "ce1d8f02-d9f1-4eec-ae87-d7f597516bb3"). InnerVolumeSpecName "kube-api-access-jtzzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:21:10.987138 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.987067 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtzzm\" (UniqueName: \"kubernetes.io/projected/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-kube-api-access-jtzzm\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:21:10.987138 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:10.987094 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3-extensions-socket-volume\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:21:11.043049 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.043012 2574 generic.go:356] "Generic (PLEG): container finished" podID="ce1d8f02-d9f1-4eec-ae87-d7f597516bb3" containerID="24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a" exitCode=0 Jul 03 14:21:11.043479 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.043053 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" Jul 03 14:21:11.043479 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.043092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" event={"ID":"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3","Type":"ContainerDied","Data":"24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a"} Jul 03 14:21:11.043479 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.043169 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd" event={"ID":"ce1d8f02-d9f1-4eec-ae87-d7f597516bb3","Type":"ContainerDied","Data":"045eceb0c2cd3462b90ae2670ca7d428dc722c96ae26b42c1c01b7520a346aec"} Jul 03 14:21:11.043479 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.043194 2574 scope.go:117] "RemoveContainer" containerID="24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a" Jul 03 14:21:11.052905 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.052742 2574 scope.go:117] "RemoveContainer" containerID="24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a" Jul 03 14:21:11.053150 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:21:11.053133 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a\": container with ID starting with 24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a not found: ID does not exist" containerID="24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a" Jul 03 14:21:11.053205 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.053158 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a"} err="failed to get container status \"24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a\": rpc error: code = NotFound desc = could not find container \"24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a\": container with ID starting with 24206b65d161464432adb55ef2c50d713c2551073da8c18d1fbb332f279e673a not found: ID does not exist" Jul 03 14:21:11.067564 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.067543 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd"] Jul 03 14:21:11.075837 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:11.075790 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rnrkd"] Jul 03 14:21:12.359572 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:12.359540 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce1d8f02-d9f1-4eec-ae87-d7f597516bb3" path="/var/lib/kubelet/pods/ce1d8f02-d9f1-4eec-ae87-d7f597516bb3/volumes" Jul 03 14:21:14.432102 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.432062 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d"] Jul 03 14:21:14.432605 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.432588 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06" containerName="manager" Jul 03 14:21:14.432656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.432609 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06" containerName="manager" Jul 03 14:21:14.432656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.432630 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1d8f02-d9f1-4eec-ae87-d7f597516bb3" containerName="manager" Jul 03 14:21:14.432656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.432639 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1d8f02-d9f1-4eec-ae87-d7f597516bb3" containerName="manager" Jul 03 14:21:14.432773 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.432739 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e85d1f1-bc5e-4e3b-aed2-6eb7da6e8b06" containerName="manager" Jul 03 14:21:14.432773 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.432754 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1d8f02-d9f1-4eec-ae87-d7f597516bb3" containerName="manager" Jul 03 14:21:14.464592 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.464558 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d"] Jul 03 14:21:14.464755 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.464670 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.467064 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.467015 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:14.467241 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.467207 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 03 14:21:14.467314 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.467277 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vw8j7\"" Jul 03 14:21:14.518356 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xzr6\" (UniqueName: \"kubernetes.io/projected/72646bbd-5107-4bb4-ba89-fe17c7b9e150-kube-api-access-4xzr6\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.518570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.518570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.518570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.518570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.518570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.518570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.518570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.518570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.518564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.619944 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.619910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.619944 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.619947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.619975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xzr6\" (UniqueName: \"kubernetes.io/projected/72646bbd-5107-4bb4-ba89-fe17c7b9e150-kube-api-access-4xzr6\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620394 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620394 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620394 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620394 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620394 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620718 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.620764 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.620730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.621062 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.621047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.622864 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.622843 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.623168 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.623148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.630713 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.630641 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72646bbd-5107-4bb4-ba89-fe17c7b9e150-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.631326 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.631301 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xzr6\" (UniqueName: \"kubernetes.io/projected/72646bbd-5107-4bb4-ba89-fe17c7b9e150-kube-api-access-4xzr6\") pod \"maas-default-gateway-openshift-default-56654dcf7-dld5d\" (UID: \"72646bbd-5107-4bb4-ba89-fe17c7b9e150\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.728860 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.728735 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:14.775736 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.775703 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:14.913493 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:14.913467 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d"] Jul 03 14:21:14.916379 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:21:14.916349 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72646bbd_5107_4bb4_ba89_fe17c7b9e150.slice/crio-ce5090130bb7f7239a80f1e81187ce3ab53149ad3f148d78b1b6313d2314a7b1 WatchSource:0}: Error finding container ce5090130bb7f7239a80f1e81187ce3ab53149ad3f148d78b1b6313d2314a7b1: Status 404 returned error can't find the container with id ce5090130bb7f7239a80f1e81187ce3ab53149ad3f148d78b1b6313d2314a7b1 Jul 03 14:21:15.064011 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:15.063983 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" event={"ID":"72646bbd-5107-4bb4-ba89-fe17c7b9e150","Type":"ContainerStarted","Data":"ce5090130bb7f7239a80f1e81187ce3ab53149ad3f148d78b1b6313d2314a7b1"} Jul 03 14:21:17.790266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:17.790224 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 14:21:17.790548 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:17.790313 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 14:21:17.790548 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:17.790344 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 14:21:18.082949 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:18.082914 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" event={"ID":"72646bbd-5107-4bb4-ba89-fe17c7b9e150","Type":"ContainerStarted","Data":"4452aeea577875126b04662c1177673af440ed60af3a8bc50573b314f96cd16b"} Jul 03 14:21:18.108190 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:18.108143 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" podStartSLOduration=1.236994203 podStartE2EDuration="4.108127384s" totalImagesPullingTime="2.871133181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:21:18.107098918 +0000 UTC m=+588.220920489" watchObservedRunningTime="2026-07-03 14:21:18.108127384 +0000 UTC m=+588.221948957" Jul 03 14:21:18.776544 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:18.776509 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:18.781127 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:18.781104 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:19.088418 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:19.088385 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:19.089492 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:19.089471 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:21:26.983084 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:26.983045 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:27.006284 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.006254 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jctqt"] Jul 03 14:21:27.009794 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.009770 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:27.013038 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.013014 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 03 14:21:27.027222 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.027194 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jctqt"] Jul 03 14:21:27.099082 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.099049 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jctqt"] Jul 03 14:21:27.120665 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.120622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:27.134096 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.134059 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5nj\" (UniqueName: \"kubernetes.io/projected/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-kube-api-access-qm5nj\") pod \"limitador-limitador-64c94fd64f-jctqt\" (UID: \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:27.134096 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.134115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-config-file\") pod \"limitador-limitador-64c94fd64f-jctqt\" (UID: \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:27.234663 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.234568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5nj\" (UniqueName: \"kubernetes.io/projected/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-kube-api-access-qm5nj\") pod \"limitador-limitador-64c94fd64f-jctqt\" (UID: \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:27.234663 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.234620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-config-file\") pod \"limitador-limitador-64c94fd64f-jctqt\" (UID: \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:27.235239 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.235221 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-config-file\") pod \"limitador-limitador-64c94fd64f-jctqt\" (UID: \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:27.244155 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.244128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5nj\" (UniqueName: \"kubernetes.io/projected/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-kube-api-access-qm5nj\") pod \"limitador-limitador-64c94fd64f-jctqt\" (UID: \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:27.320938 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.320910 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:27.460703 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.460679 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jctqt"] Jul 03 14:21:27.462522 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:21:27.462493 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17cdb7c_6c89_49b4_9a38_06f0512a9cb4.slice/crio-e27a63730eb320bd6f830edf83d9b0c4cec056a74aa311c939ec93540525b450 WatchSource:0}: Error finding container e27a63730eb320bd6f830edf83d9b0c4cec056a74aa311c939ec93540525b450: Status 404 returned error can't find the container with id e27a63730eb320bd6f830edf83d9b0c4cec056a74aa311c939ec93540525b450 Jul 03 14:21:27.809722 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.809687 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-p46v4"] Jul 03 14:21:27.814218 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.814192 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p46v4" Jul 03 14:21:27.816535 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.816513 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zw7mb\"" Jul 03 14:21:27.821343 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.821323 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-p46v4"] Jul 03 14:21:27.842610 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.842579 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:27.914673 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.914642 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:27.941470 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:27.941439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vm78\" (UniqueName: \"kubernetes.io/projected/f9ebfc7a-5954-4ff6-9593-e1d4888e1913-kube-api-access-4vm78\") pod \"authorino-58cd955675-p46v4\" (UID: \"f9ebfc7a-5954-4ff6-9593-e1d4888e1913\") " pod="kuadrant-system/authorino-58cd955675-p46v4" Jul 03 14:21:28.042907 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.042868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vm78\" (UniqueName: \"kubernetes.io/projected/f9ebfc7a-5954-4ff6-9593-e1d4888e1913-kube-api-access-4vm78\") pod \"authorino-58cd955675-p46v4\" (UID: \"f9ebfc7a-5954-4ff6-9593-e1d4888e1913\") " pod="kuadrant-system/authorino-58cd955675-p46v4" Jul 03 14:21:28.051932 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.051908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vm78\" (UniqueName: \"kubernetes.io/projected/f9ebfc7a-5954-4ff6-9593-e1d4888e1913-kube-api-access-4vm78\") pod \"authorino-58cd955675-p46v4\" (UID: \"f9ebfc7a-5954-4ff6-9593-e1d4888e1913\") " pod="kuadrant-system/authorino-58cd955675-p46v4" Jul 03 14:21:28.067011 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.066955 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-szmjq"] Jul 03 14:21:28.070395 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.070381 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-szmjq" Jul 03 14:21:28.079169 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.079148 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-szmjq"] Jul 03 14:21:28.124859 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.124828 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p46v4" Jul 03 14:21:28.135780 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.135717 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" event={"ID":"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4","Type":"ContainerStarted","Data":"e27a63730eb320bd6f830edf83d9b0c4cec056a74aa311c939ec93540525b450"} Jul 03 14:21:28.246266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.244929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfhdq\" (UniqueName: \"kubernetes.io/projected/2a1aecfd-75cf-4846-adee-e031dc1f4d4c-kube-api-access-kfhdq\") pod \"authorino-75d556bd77-szmjq\" (UID: \"2a1aecfd-75cf-4846-adee-e031dc1f4d4c\") " pod="kuadrant-system/authorino-75d556bd77-szmjq" Jul 03 14:21:28.306198 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.306168 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-p46v4"] Jul 03 14:21:28.308525 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:21:28.308495 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9ebfc7a_5954_4ff6_9593_e1d4888e1913.slice/crio-a3d563607241577216cbb24e2a8baa0d0524e2575f24aa33859251def585ce5e WatchSource:0}: Error finding container a3d563607241577216cbb24e2a8baa0d0524e2575f24aa33859251def585ce5e: Status 404 returned error can't find the container with id a3d563607241577216cbb24e2a8baa0d0524e2575f24aa33859251def585ce5e Jul 03 14:21:28.346849 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.346761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfhdq\" (UniqueName: \"kubernetes.io/projected/2a1aecfd-75cf-4846-adee-e031dc1f4d4c-kube-api-access-kfhdq\") pod \"authorino-75d556bd77-szmjq\" (UID: \"2a1aecfd-75cf-4846-adee-e031dc1f4d4c\") " pod="kuadrant-system/authorino-75d556bd77-szmjq" Jul 03 14:21:28.359269 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.359002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfhdq\" (UniqueName: \"kubernetes.io/projected/2a1aecfd-75cf-4846-adee-e031dc1f4d4c-kube-api-access-kfhdq\") pod \"authorino-75d556bd77-szmjq\" (UID: \"2a1aecfd-75cf-4846-adee-e031dc1f4d4c\") " pod="kuadrant-system/authorino-75d556bd77-szmjq" Jul 03 14:21:28.381820 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.381780 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-szmjq" Jul 03 14:21:28.559976 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:28.559936 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-szmjq"] Jul 03 14:21:28.562901 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:21:28.562865 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a1aecfd_75cf_4846_adee_e031dc1f4d4c.slice/crio-427ec5c152700ed68096eccdd1cea16aacebaf4a2d87cadf262cc967cc90e0e1 WatchSource:0}: Error finding container 427ec5c152700ed68096eccdd1cea16aacebaf4a2d87cadf262cc967cc90e0e1: Status 404 returned error can't find the container with id 427ec5c152700ed68096eccdd1cea16aacebaf4a2d87cadf262cc967cc90e0e1 Jul 03 14:21:29.145741 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:29.145700 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-szmjq" event={"ID":"2a1aecfd-75cf-4846-adee-e031dc1f4d4c","Type":"ContainerStarted","Data":"427ec5c152700ed68096eccdd1cea16aacebaf4a2d87cadf262cc967cc90e0e1"} Jul 03 14:21:29.147262 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:29.147232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p46v4" event={"ID":"f9ebfc7a-5954-4ff6-9593-e1d4888e1913","Type":"ContainerStarted","Data":"a3d563607241577216cbb24e2a8baa0d0524e2575f24aa33859251def585ce5e"} Jul 03 14:21:33.170814 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.170773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-szmjq" event={"ID":"2a1aecfd-75cf-4846-adee-e031dc1f4d4c","Type":"ContainerStarted","Data":"55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45"} Jul 03 14:21:33.178621 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.178588 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" event={"ID":"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4","Type":"ContainerStarted","Data":"2f120e36cfd76534aaddc97ad27b17a67e85144c11499b9f4eec18677ceb76c2"} Jul 03 14:21:33.178784 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.178682 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:33.179989 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.179964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p46v4" event={"ID":"f9ebfc7a-5954-4ff6-9593-e1d4888e1913","Type":"ContainerStarted","Data":"125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5"} Jul 03 14:21:33.191408 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.191363 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-szmjq" podStartSLOduration=1.564492622 podStartE2EDuration="5.191350283s" totalImagesPullingTime="3.626857661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:21:33.190587912 +0000 UTC m=+603.304409485" watchObservedRunningTime="2026-07-03 14:21:33.191350283 +0000 UTC m=+603.305171855" Jul 03 14:21:33.207888 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.207830 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-p46v4" podStartSLOduration=2.378028743 podStartE2EDuration="6.207812213s" totalImagesPullingTime="3.82978347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:21:33.207236171 +0000 UTC m=+603.321057754" watchObservedRunningTime="2026-07-03 14:21:33.207812213 +0000 UTC m=+603.321633785" Jul 03 14:21:33.227979 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.227925 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" podStartSLOduration=2.504872207 podStartE2EDuration="7.227905043s" totalImagesPullingTime="4.723032836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:21:33.225846204 +0000 UTC m=+603.339667777" watchObservedRunningTime="2026-07-03 14:21:33.227905043 +0000 UTC m=+603.341726618" Jul 03 14:21:33.251031 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.251003 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-p46v4"] Jul 03 14:21:33.733725 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:33.733687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:35.191343 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:35.191306 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-p46v4" podUID="f9ebfc7a-5954-4ff6-9593-e1d4888e1913" containerName="authorino" containerID="cri-o://125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5" gracePeriod=30 Jul 03 14:21:35.441320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:35.441296 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p46v4" Jul 03 14:21:35.615725 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:35.615699 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vm78\" (UniqueName: \"kubernetes.io/projected/f9ebfc7a-5954-4ff6-9593-e1d4888e1913-kube-api-access-4vm78\") pod \"f9ebfc7a-5954-4ff6-9593-e1d4888e1913\" (UID: \"f9ebfc7a-5954-4ff6-9593-e1d4888e1913\") " Jul 03 14:21:35.617760 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:35.617731 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9ebfc7a-5954-4ff6-9593-e1d4888e1913-kube-api-access-4vm78" (OuterVolumeSpecName: "kube-api-access-4vm78") pod "f9ebfc7a-5954-4ff6-9593-e1d4888e1913" (UID: "f9ebfc7a-5954-4ff6-9593-e1d4888e1913"). InnerVolumeSpecName "kube-api-access-4vm78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:21:35.717176 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:35.717137 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vm78\" (UniqueName: \"kubernetes.io/projected/f9ebfc7a-5954-4ff6-9593-e1d4888e1913-kube-api-access-4vm78\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:21:36.197443 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.197409 2574 generic.go:356] "Generic (PLEG): container finished" podID="f9ebfc7a-5954-4ff6-9593-e1d4888e1913" containerID="125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5" exitCode=0 Jul 03 14:21:36.197904 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.197461 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p46v4" Jul 03 14:21:36.197904 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.197468 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p46v4" event={"ID":"f9ebfc7a-5954-4ff6-9593-e1d4888e1913","Type":"ContainerDied","Data":"125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5"} Jul 03 14:21:36.197904 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.197498 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p46v4" event={"ID":"f9ebfc7a-5954-4ff6-9593-e1d4888e1913","Type":"ContainerDied","Data":"a3d563607241577216cbb24e2a8baa0d0524e2575f24aa33859251def585ce5e"} Jul 03 14:21:36.197904 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.197514 2574 scope.go:117] "RemoveContainer" containerID="125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5" Jul 03 14:21:36.206524 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.206508 2574 scope.go:117] "RemoveContainer" containerID="125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5" Jul 03 14:21:36.206749 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:21:36.206733 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5\": container with ID starting with 125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5 not found: ID does not exist" containerID="125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5" Jul 03 14:21:36.206830 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.206755 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5"} err="failed to get container status \"125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5\": rpc error: code = NotFound desc = could not find container \"125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5\": container with ID starting with 125d24b2af7bf39a79372547114403be3c50c2e1724c3c1730f6d1770fea0cb5 not found: ID does not exist" Jul 03 14:21:36.226593 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.226568 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-p46v4"] Jul 03 14:21:36.228410 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.228389 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-p46v4"] Jul 03 14:21:36.359273 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:36.359240 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9ebfc7a-5954-4ff6-9593-e1d4888e1913" path="/var/lib/kubelet/pods/f9ebfc7a-5954-4ff6-9593-e1d4888e1913/volumes" Jul 03 14:21:41.720559 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:41.720524 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jctqt"] Jul 03 14:21:41.721000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:41.720718 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" podUID="a17cdb7c-6c89-49b4-9a38-06f0512a9cb4" containerName="limitador" containerID="cri-o://2f120e36cfd76534aaddc97ad27b17a67e85144c11499b9f4eec18677ceb76c2" gracePeriod=30 Jul 03 14:21:41.721487 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:41.721469 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:42.229211 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.229181 2574 generic.go:356] "Generic (PLEG): container finished" podID="a17cdb7c-6c89-49b4-9a38-06f0512a9cb4" containerID="2f120e36cfd76534aaddc97ad27b17a67e85144c11499b9f4eec18677ceb76c2" exitCode=0 Jul 03 14:21:42.229367 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.229260 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" event={"ID":"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4","Type":"ContainerDied","Data":"2f120e36cfd76534aaddc97ad27b17a67e85144c11499b9f4eec18677ceb76c2"} Jul 03 14:21:42.272365 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.272342 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:42.372734 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.372706 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm5nj\" (UniqueName: \"kubernetes.io/projected/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-kube-api-access-qm5nj\") pod \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\" (UID: \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\") " Jul 03 14:21:42.372964 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.372756 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-config-file\") pod \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\" (UID: \"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4\") " Jul 03 14:21:42.373122 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.373098 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-config-file" (OuterVolumeSpecName: "config-file") pod "a17cdb7c-6c89-49b4-9a38-06f0512a9cb4" (UID: "a17cdb7c-6c89-49b4-9a38-06f0512a9cb4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:21:42.374676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.374653 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-kube-api-access-qm5nj" (OuterVolumeSpecName: "kube-api-access-qm5nj") pod "a17cdb7c-6c89-49b4-9a38-06f0512a9cb4" (UID: "a17cdb7c-6c89-49b4-9a38-06f0512a9cb4"). InnerVolumeSpecName "kube-api-access-qm5nj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:21:42.474234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.474197 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-config-file\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:21:42.474234 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:42.474226 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm5nj\" (UniqueName: \"kubernetes.io/projected/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4-kube-api-access-qm5nj\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:21:43.235984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:43.235952 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" Jul 03 14:21:43.235984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:43.235976 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jctqt" event={"ID":"a17cdb7c-6c89-49b4-9a38-06f0512a9cb4","Type":"ContainerDied","Data":"e27a63730eb320bd6f830edf83d9b0c4cec056a74aa311c939ec93540525b450"} Jul 03 14:21:43.236433 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:43.236055 2574 scope.go:117] "RemoveContainer" containerID="2f120e36cfd76534aaddc97ad27b17a67e85144c11499b9f4eec18677ceb76c2" Jul 03 14:21:43.262192 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:43.262167 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jctqt"] Jul 03 14:21:43.267523 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:43.267500 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jctqt"] Jul 03 14:21:44.359196 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:44.359158 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a17cdb7c-6c89-49b4-9a38-06f0512a9cb4" path="/var/lib/kubelet/pods/a17cdb7c-6c89-49b4-9a38-06f0512a9cb4/volumes" Jul 03 14:21:45.911400 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.911367 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-44zct"] Jul 03 14:21:45.911955 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.911938 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9ebfc7a-5954-4ff6-9593-e1d4888e1913" containerName="authorino" Jul 03 14:21:45.912006 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.911958 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9ebfc7a-5954-4ff6-9593-e1d4888e1913" containerName="authorino" Jul 03 14:21:45.912006 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.911978 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a17cdb7c-6c89-49b4-9a38-06f0512a9cb4" containerName="limitador" Jul 03 14:21:45.912006 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.911987 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a17cdb7c-6c89-49b4-9a38-06f0512a9cb4" containerName="limitador" Jul 03 14:21:45.912106 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.912075 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9ebfc7a-5954-4ff6-9593-e1d4888e1913" containerName="authorino" Jul 03 14:21:45.912106 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.912095 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a17cdb7c-6c89-49b4-9a38-06f0512a9cb4" containerName="limitador" Jul 03 14:21:45.916654 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.916635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:45.920201 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.920174 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 03 14:21:45.920319 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.920176 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tsfsk\"" Jul 03 14:21:45.929789 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.929768 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-44zct"] Jul 03 14:21:45.970113 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:45.970088 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:46.001910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.001886 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c97j4\" (UniqueName: \"kubernetes.io/projected/579db2ae-349f-463c-9b0f-1db3c842451b-kube-api-access-c97j4\") pod \"postgres-69fb4594cf-44zct\" (UID: \"579db2ae-349f-463c-9b0f-1db3c842451b\") " pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:46.001996 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.001928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/579db2ae-349f-463c-9b0f-1db3c842451b-data\") pod \"postgres-69fb4594cf-44zct\" (UID: \"579db2ae-349f-463c-9b0f-1db3c842451b\") " pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:46.103197 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.103172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c97j4\" (UniqueName: \"kubernetes.io/projected/579db2ae-349f-463c-9b0f-1db3c842451b-kube-api-access-c97j4\") pod \"postgres-69fb4594cf-44zct\" (UID: \"579db2ae-349f-463c-9b0f-1db3c842451b\") " pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:46.103329 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.103219 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/579db2ae-349f-463c-9b0f-1db3c842451b-data\") pod \"postgres-69fb4594cf-44zct\" (UID: \"579db2ae-349f-463c-9b0f-1db3c842451b\") " pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:46.103543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.103527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/579db2ae-349f-463c-9b0f-1db3c842451b-data\") pod \"postgres-69fb4594cf-44zct\" (UID: \"579db2ae-349f-463c-9b0f-1db3c842451b\") " pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:46.115035 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.115001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c97j4\" (UniqueName: \"kubernetes.io/projected/579db2ae-349f-463c-9b0f-1db3c842451b-kube-api-access-c97j4\") pod \"postgres-69fb4594cf-44zct\" (UID: \"579db2ae-349f-463c-9b0f-1db3c842451b\") " pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:46.226690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.226631 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:46.361215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.361190 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-44zct"] Jul 03 14:21:46.362026 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:21:46.362004 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579db2ae_349f_463c_9b0f_1db3c842451b.slice/crio-c444bb83d2dce67056950ebd25d83f65939aa2bbf4eb8526d74729d573583385 WatchSource:0}: Error finding container c444bb83d2dce67056950ebd25d83f65939aa2bbf4eb8526d74729d573583385: Status 404 returned error can't find the container with id c444bb83d2dce67056950ebd25d83f65939aa2bbf4eb8526d74729d573583385 Jul 03 14:21:46.363476 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:46.363456 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 14:21:47.255644 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:47.255608 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-44zct" event={"ID":"579db2ae-349f-463c-9b0f-1db3c842451b","Type":"ContainerStarted","Data":"c444bb83d2dce67056950ebd25d83f65939aa2bbf4eb8526d74729d573583385"} Jul 03 14:21:52.287738 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:52.287656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-44zct" event={"ID":"579db2ae-349f-463c-9b0f-1db3c842451b","Type":"ContainerStarted","Data":"b28d784916a5b88e668488076010a28065905fcba191fbfe8eab1b57cbeb0c62"} Jul 03 14:21:52.287738 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:52.287720 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:52.309022 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:52.308980 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-44zct" podStartSLOduration=2.286834441 podStartE2EDuration="7.3089656s" totalImagesPullingTime="5.022131159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:21:52.30724828 +0000 UTC m=+622.421069853" watchObservedRunningTime="2026-07-03 14:21:52.3089656 +0000 UTC m=+622.422787172" Jul 03 14:21:58.323078 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:58.323049 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-44zct" Jul 03 14:21:58.673488 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:58.673376 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:58.897643 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:58.897607 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mg49r"] Jul 03 14:21:58.901360 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:58.901338 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mg49r" Jul 03 14:21:58.915606 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:58.915581 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mg49r"] Jul 03 14:21:59.015088 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.015007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4jr6\" (UniqueName: \"kubernetes.io/projected/8c59d66c-3a89-4fb8-90ff-b126c27b766e-kube-api-access-c4jr6\") pod \"authorino-5d4b67c446-mg49r\" (UID: \"8c59d66c-3a89-4fb8-90ff-b126c27b766e\") " pod="kuadrant-system/authorino-5d4b67c446-mg49r" Jul 03 14:21:59.068255 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.068191 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:21:59.116449 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.116419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4jr6\" (UniqueName: \"kubernetes.io/projected/8c59d66c-3a89-4fb8-90ff-b126c27b766e-kube-api-access-c4jr6\") pod \"authorino-5d4b67c446-mg49r\" (UID: \"8c59d66c-3a89-4fb8-90ff-b126c27b766e\") " pod="kuadrant-system/authorino-5d4b67c446-mg49r" Jul 03 14:21:59.127652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.127619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4jr6\" (UniqueName: \"kubernetes.io/projected/8c59d66c-3a89-4fb8-90ff-b126c27b766e-kube-api-access-c4jr6\") pod \"authorino-5d4b67c446-mg49r\" (UID: \"8c59d66c-3a89-4fb8-90ff-b126c27b766e\") " pod="kuadrant-system/authorino-5d4b67c446-mg49r" Jul 03 14:21:59.170989 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.170953 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mg49r"] Jul 03 14:21:59.171232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.171219 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mg49r" Jul 03 14:21:59.243335 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.243305 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59f94fb47-knkc5"] Jul 03 14:21:59.250943 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.250921 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f94fb47-knkc5" Jul 03 14:21:59.271171 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.271113 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59f94fb47-knkc5"] Jul 03 14:21:59.318475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.318429 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdhjr\" (UniqueName: \"kubernetes.io/projected/b60a5fc2-4a4b-42f8-85df-12b06425dc24-kube-api-access-gdhjr\") pod \"authorino-59f94fb47-knkc5\" (UID: \"b60a5fc2-4a4b-42f8-85df-12b06425dc24\") " pod="kuadrant-system/authorino-59f94fb47-knkc5" Jul 03 14:21:59.320587 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.320566 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mg49r"] Jul 03 14:21:59.323306 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:21:59.323277 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c59d66c_3a89_4fb8_90ff_b126c27b766e.slice/crio-c62540c0f379b1f61838bc9f093e78b48c65ae2eee76f44b54e56aa27ef7d41e WatchSource:0}: Error finding container c62540c0f379b1f61838bc9f093e78b48c65ae2eee76f44b54e56aa27ef7d41e: Status 404 returned error can't find the container with id c62540c0f379b1f61838bc9f093e78b48c65ae2eee76f44b54e56aa27ef7d41e Jul 03 14:21:59.399745 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.399700 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f94fb47-knkc5"] Jul 03 14:21:59.400063 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:21:59.400034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gdhjr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-59f94fb47-knkc5" podUID="b60a5fc2-4a4b-42f8-85df-12b06425dc24" Jul 03 14:21:59.419861 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.419828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdhjr\" (UniqueName: \"kubernetes.io/projected/b60a5fc2-4a4b-42f8-85df-12b06425dc24-kube-api-access-gdhjr\") pod \"authorino-59f94fb47-knkc5\" (UID: \"b60a5fc2-4a4b-42f8-85df-12b06425dc24\") " pod="kuadrant-system/authorino-59f94fb47-knkc5" Jul 03 14:21:59.436044 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:21:59.436009 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdhjr\" (UniqueName: \"kubernetes.io/projected/b60a5fc2-4a4b-42f8-85df-12b06425dc24-kube-api-access-gdhjr\") pod \"authorino-59f94fb47-knkc5\" (UID: \"b60a5fc2-4a4b-42f8-85df-12b06425dc24\") " pod="kuadrant-system/authorino-59f94fb47-knkc5" Jul 03 14:22:00.330183 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.330148 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mg49r" event={"ID":"8c59d66c-3a89-4fb8-90ff-b126c27b766e","Type":"ContainerStarted","Data":"490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39"} Jul 03 14:22:00.330664 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.330193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mg49r" event={"ID":"8c59d66c-3a89-4fb8-90ff-b126c27b766e","Type":"ContainerStarted","Data":"c62540c0f379b1f61838bc9f093e78b48c65ae2eee76f44b54e56aa27ef7d41e"} Jul 03 14:22:00.330664 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.330205 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f94fb47-knkc5" Jul 03 14:22:00.330664 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.330202 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-mg49r" podUID="8c59d66c-3a89-4fb8-90ff-b126c27b766e" containerName="authorino" containerID="cri-o://490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39" gracePeriod=30 Jul 03 14:22:00.337980 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.337952 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f94fb47-knkc5" Jul 03 14:22:00.358731 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.358667 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-mg49r" podStartSLOduration=1.827039331 podStartE2EDuration="2.358647222s" totalImagesPullingTime="531.607891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:22:00.355384811 +0000 UTC m=+630.469206384" watchObservedRunningTime="2026-07-03 14:22:00.358647222 +0000 UTC m=+630.472468796" Jul 03 14:22:00.427977 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.427938 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdhjr\" (UniqueName: \"kubernetes.io/projected/b60a5fc2-4a4b-42f8-85df-12b06425dc24-kube-api-access-gdhjr\") pod \"b60a5fc2-4a4b-42f8-85df-12b06425dc24\" (UID: \"b60a5fc2-4a4b-42f8-85df-12b06425dc24\") " Jul 03 14:22:00.430340 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.430304 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b60a5fc2-4a4b-42f8-85df-12b06425dc24-kube-api-access-gdhjr" (OuterVolumeSpecName: "kube-api-access-gdhjr") pod "b60a5fc2-4a4b-42f8-85df-12b06425dc24" (UID: "b60a5fc2-4a4b-42f8-85df-12b06425dc24"). InnerVolumeSpecName "kube-api-access-gdhjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:22:00.529100 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.529063 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdhjr\" (UniqueName: \"kubernetes.io/projected/b60a5fc2-4a4b-42f8-85df-12b06425dc24-kube-api-access-gdhjr\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:22:00.588880 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.588820 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mg49r" Jul 03 14:22:00.618043 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.617996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:00.630344 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.630311 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4jr6\" (UniqueName: \"kubernetes.io/projected/8c59d66c-3a89-4fb8-90ff-b126c27b766e-kube-api-access-c4jr6\") pod \"8c59d66c-3a89-4fb8-90ff-b126c27b766e\" (UID: \"8c59d66c-3a89-4fb8-90ff-b126c27b766e\") " Jul 03 14:22:00.632670 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.632639 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c59d66c-3a89-4fb8-90ff-b126c27b766e-kube-api-access-c4jr6" (OuterVolumeSpecName: "kube-api-access-c4jr6") pod "8c59d66c-3a89-4fb8-90ff-b126c27b766e" (UID: "8c59d66c-3a89-4fb8-90ff-b126c27b766e"). InnerVolumeSpecName "kube-api-access-c4jr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:22:00.731312 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:00.731274 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4jr6\" (UniqueName: \"kubernetes.io/projected/8c59d66c-3a89-4fb8-90ff-b126c27b766e-kube-api-access-c4jr6\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:22:01.336256 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.336215 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c59d66c-3a89-4fb8-90ff-b126c27b766e" containerID="490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39" exitCode=0 Jul 03 14:22:01.336746 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.336275 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mg49r" Jul 03 14:22:01.336746 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.336295 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mg49r" event={"ID":"8c59d66c-3a89-4fb8-90ff-b126c27b766e","Type":"ContainerDied","Data":"490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39"} Jul 03 14:22:01.336746 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.336338 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mg49r" event={"ID":"8c59d66c-3a89-4fb8-90ff-b126c27b766e","Type":"ContainerDied","Data":"c62540c0f379b1f61838bc9f093e78b48c65ae2eee76f44b54e56aa27ef7d41e"} Jul 03 14:22:01.336746 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.336356 2574 scope.go:117] "RemoveContainer" containerID="490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39" Jul 03 14:22:01.336746 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.336511 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f94fb47-knkc5" Jul 03 14:22:01.347943 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.347917 2574 scope.go:117] "RemoveContainer" containerID="490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39" Jul 03 14:22:01.348750 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:01.348722 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39\": container with ID starting with 490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39 not found: ID does not exist" containerID="490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39" Jul 03 14:22:01.348875 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.348759 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39"} err="failed to get container status \"490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39\": rpc error: code = NotFound desc = could not find container \"490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39\": container with ID starting with 490c3f0bf832866d0b7580bfc0c3745ffdebc01d31da5285a6394ed26b4d2d39 not found: ID does not exist" Jul 03 14:22:01.379708 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.379676 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f94fb47-knkc5"] Jul 03 14:22:01.384314 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.384255 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59f94fb47-knkc5"] Jul 03 14:22:01.397516 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.397492 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mg49r"] Jul 03 14:22:01.402545 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:01.402521 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mg49r"] Jul 03 14:22:02.359768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:02.359736 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c59d66c-3a89-4fb8-90ff-b126c27b766e" path="/var/lib/kubelet/pods/8c59d66c-3a89-4fb8-90ff-b126c27b766e/volumes" Jul 03 14:22:02.360149 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:02.360069 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b60a5fc2-4a4b-42f8-85df-12b06425dc24" path="/var/lib/kubelet/pods/b60a5fc2-4a4b-42f8-85df-12b06425dc24/volumes" Jul 03 14:22:03.867407 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:03.867374 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-szmjq"] Jul 03 14:22:03.867781 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:03.867572 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-szmjq" podUID="2a1aecfd-75cf-4846-adee-e031dc1f4d4c" containerName="authorino" containerID="cri-o://55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45" gracePeriod=30 Jul 03 14:22:04.111033 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.111003 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-szmjq" Jul 03 14:22:04.159646 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.159568 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfhdq\" (UniqueName: \"kubernetes.io/projected/2a1aecfd-75cf-4846-adee-e031dc1f4d4c-kube-api-access-kfhdq\") pod \"2a1aecfd-75cf-4846-adee-e031dc1f4d4c\" (UID: \"2a1aecfd-75cf-4846-adee-e031dc1f4d4c\") " Jul 03 14:22:04.161516 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.161494 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a1aecfd-75cf-4846-adee-e031dc1f4d4c-kube-api-access-kfhdq" (OuterVolumeSpecName: "kube-api-access-kfhdq") pod "2a1aecfd-75cf-4846-adee-e031dc1f4d4c" (UID: "2a1aecfd-75cf-4846-adee-e031dc1f4d4c"). InnerVolumeSpecName "kube-api-access-kfhdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:22:04.260227 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.260192 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfhdq\" (UniqueName: \"kubernetes.io/projected/2a1aecfd-75cf-4846-adee-e031dc1f4d4c-kube-api-access-kfhdq\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:22:04.353944 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.353910 2574 generic.go:356] "Generic (PLEG): container finished" podID="2a1aecfd-75cf-4846-adee-e031dc1f4d4c" containerID="55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45" exitCode=0 Jul 03 14:22:04.354107 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.354014 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-szmjq" Jul 03 14:22:04.360663 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.360633 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-szmjq" event={"ID":"2a1aecfd-75cf-4846-adee-e031dc1f4d4c","Type":"ContainerDied","Data":"55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45"} Jul 03 14:22:04.360844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.360675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-szmjq" event={"ID":"2a1aecfd-75cf-4846-adee-e031dc1f4d4c","Type":"ContainerDied","Data":"427ec5c152700ed68096eccdd1cea16aacebaf4a2d87cadf262cc967cc90e0e1"} Jul 03 14:22:04.360844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.360701 2574 scope.go:117] "RemoveContainer" containerID="55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45" Jul 03 14:22:04.369884 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.369864 2574 scope.go:117] "RemoveContainer" containerID="55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45" Jul 03 14:22:04.370180 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:04.370160 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45\": container with ID starting with 55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45 not found: ID does not exist" containerID="55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45" Jul 03 14:22:04.370260 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.370186 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45"} err="failed to get container status \"55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45\": rpc error: code = NotFound desc = could not find container \"55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45\": container with ID starting with 55f99ef6a9f8178a9c224d8082febca32dc3f9b75e0e3fbec157bdd6655c1c45 not found: ID does not exist" Jul 03 14:22:04.385282 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.385261 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-szmjq"] Jul 03 14:22:04.390179 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:04.390154 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-szmjq"] Jul 03 14:22:06.360216 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:06.360181 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a1aecfd-75cf-4846-adee-e031dc1f4d4c" path="/var/lib/kubelet/pods/2a1aecfd-75cf-4846-adee-e031dc1f4d4c/volumes" Jul 03 14:22:08.194178 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.194139 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:08.202307 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.202276 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77cb69d4dc-8pv9z"] Jul 03 14:22:08.202696 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.202673 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1aecfd-75cf-4846-adee-e031dc1f4d4c" containerName="authorino" Jul 03 14:22:08.202867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.202718 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1aecfd-75cf-4846-adee-e031dc1f4d4c" containerName="authorino" Jul 03 14:22:08.202867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.202766 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c59d66c-3a89-4fb8-90ff-b126c27b766e" containerName="authorino" Jul 03 14:22:08.202867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.202776 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c59d66c-3a89-4fb8-90ff-b126c27b766e" containerName="authorino" Jul 03 14:22:08.203045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.202923 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a1aecfd-75cf-4846-adee-e031dc1f4d4c" containerName="authorino" Jul 03 14:22:08.203045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.202938 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c59d66c-3a89-4fb8-90ff-b126c27b766e" containerName="authorino" Jul 03 14:22:08.207501 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.207480 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:08.210061 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.210033 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 03 14:22:08.210061 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.210053 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kfp2j\"" Jul 03 14:22:08.210242 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.210203 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 03 14:22:08.217449 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.217426 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77cb69d4dc-8pv9z"] Jul 03 14:22:08.288972 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.288931 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:08.294043 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.294009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert\") pod \"maas-controller-77cb69d4dc-8pv9z\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:08.294193 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.294158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vw4v\" (UniqueName: \"kubernetes.io/projected/83b23a07-d775-4447-9353-63acf579f607-kube-api-access-7vw4v\") pod \"maas-controller-77cb69d4dc-8pv9z\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:08.391701 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.391655 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-755bf6967f-mhdvv"] Jul 03 14:22:08.393845 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.393817 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:08.394972 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.394949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vw4v\" (UniqueName: \"kubernetes.io/projected/83b23a07-d775-4447-9353-63acf579f607-kube-api-access-7vw4v\") pod \"maas-controller-77cb69d4dc-8pv9z\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:08.395048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.395039 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert\") pod \"maas-controller-77cb69d4dc-8pv9z\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:08.395184 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:08.395166 2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 03 14:22:08.395299 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:08.395241 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert podName:83b23a07-d775-4447-9353-63acf579f607 nodeName:}" failed. No retries permitted until 2026-07-03 14:22:08.895221796 +0000 UTC m=+639.009043351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert") pod "maas-controller-77cb69d4dc-8pv9z" (UID: "83b23a07-d775-4447-9353-63acf579f607") : secret "maas-controller-webhook-cert" not found Jul 03 14:22:08.395369 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.395353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:08.409248 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.409219 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vw4v\" (UniqueName: \"kubernetes.io/projected/83b23a07-d775-4447-9353-63acf579f607-kube-api-access-7vw4v\") pod \"maas-controller-77cb69d4dc-8pv9z\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:08.409248 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.409234 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755bf6967f-mhdvv"] Jul 03 14:22:08.496043 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.495943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6vcb\" (UniqueName: \"kubernetes.io/projected/75d25bda-f3da-407a-b5f3-162cbfb0d65a-kube-api-access-c6vcb\") pod \"maas-controller-755bf6967f-mhdvv\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:08.496198 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.496072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert\") pod \"maas-controller-755bf6967f-mhdvv\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:08.597354 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.597316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert\") pod \"maas-controller-755bf6967f-mhdvv\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:08.597532 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.597405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6vcb\" (UniqueName: \"kubernetes.io/projected/75d25bda-f3da-407a-b5f3-162cbfb0d65a-kube-api-access-c6vcb\") pod \"maas-controller-755bf6967f-mhdvv\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:08.597532 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:08.597494 2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 03 14:22:08.597614 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:08.597594 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert podName:75d25bda-f3da-407a-b5f3-162cbfb0d65a nodeName:}" failed. No retries permitted until 2026-07-03 14:22:09.097570166 +0000 UTC m=+639.211391722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert") pod "maas-controller-755bf6967f-mhdvv" (UID: "75d25bda-f3da-407a-b5f3-162cbfb0d65a") : secret "maas-controller-webhook-cert" not found Jul 03 14:22:08.610500 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.610458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6vcb\" (UniqueName: \"kubernetes.io/projected/75d25bda-f3da-407a-b5f3-162cbfb0d65a-kube-api-access-c6vcb\") pod \"maas-controller-755bf6967f-mhdvv\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:08.668523 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.668485 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:08.900019 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.899979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert\") pod \"maas-controller-77cb69d4dc-8pv9z\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:08.902532 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:08.902508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert\") pod \"maas-controller-77cb69d4dc-8pv9z\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:09.101648 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:09.101539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert\") pod \"maas-controller-755bf6967f-mhdvv\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:09.104008 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:09.103973 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert\") pod \"maas-controller-755bf6967f-mhdvv\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:09.119911 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:09.119882 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:09.283074 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:09.283040 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77cb69d4dc-8pv9z"] Jul 03 14:22:09.286993 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:22:09.286962 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b23a07_d775_4447_9353_63acf579f607.slice/crio-dddd2e850c9b358bd837b581b38c8e224d89f70e7b3661d22184514a175eaf6a WatchSource:0}: Error finding container dddd2e850c9b358bd837b581b38c8e224d89f70e7b3661d22184514a175eaf6a: Status 404 returned error can't find the container with id dddd2e850c9b358bd837b581b38c8e224d89f70e7b3661d22184514a175eaf6a Jul 03 14:22:09.305973 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:09.305938 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:09.382039 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:09.382001 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" event={"ID":"83b23a07-d775-4447-9353-63acf579f607","Type":"ContainerStarted","Data":"dddd2e850c9b358bd837b581b38c8e224d89f70e7b3661d22184514a175eaf6a"} Jul 03 14:22:09.449492 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:09.449466 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755bf6967f-mhdvv"] Jul 03 14:22:09.451764 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:22:09.451731 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d25bda_f3da_407a_b5f3_162cbfb0d65a.slice/crio-30f57856c8672a3fa49ea8192215278ddb648d3987089ec0c774ce9f2d87601b WatchSource:0}: Error finding container 30f57856c8672a3fa49ea8192215278ddb648d3987089ec0c774ce9f2d87601b: Status 404 returned error can't find the container with id 30f57856c8672a3fa49ea8192215278ddb648d3987089ec0c774ce9f2d87601b Jul 03 14:22:10.394672 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:10.394568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bf6967f-mhdvv" event={"ID":"75d25bda-f3da-407a-b5f3-162cbfb0d65a","Type":"ContainerStarted","Data":"30f57856c8672a3fa49ea8192215278ddb648d3987089ec0c774ce9f2d87601b"} Jul 03 14:22:12.231617 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:12.231513 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:12.336507 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:12.336470 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:12.406623 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:12.406586 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" event={"ID":"83b23a07-d775-4447-9353-63acf579f607","Type":"ContainerStarted","Data":"5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be"} Jul 03 14:22:12.406897 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:12.406705 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:12.408174 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:12.408149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bf6967f-mhdvv" event={"ID":"75d25bda-f3da-407a-b5f3-162cbfb0d65a","Type":"ContainerStarted","Data":"505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083"} Jul 03 14:22:12.408314 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:12.408201 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:12.431637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:12.431578 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" podStartSLOduration=1.76507087 podStartE2EDuration="4.431560251s" totalImagesPullingTime="2.666489381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:22:12.429785299 +0000 UTC m=+642.543606872" watchObservedRunningTime="2026-07-03 14:22:12.431560251 +0000 UTC m=+642.545381824" Jul 03 14:22:12.457242 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:12.457188 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-755bf6967f-mhdvv" podStartSLOduration=1.943124646 podStartE2EDuration="4.457171745s" totalImagesPullingTime="2.514047099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:22:12.455260869 +0000 UTC m=+642.569082441" watchObservedRunningTime="2026-07-03 14:22:12.457171745 +0000 UTC m=+642.570993317" Jul 03 14:22:16.119641 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:16.119602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:16.221366 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:16.221334 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:23.420015 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.419984 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:23.420424 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.420324 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:22:23.530048 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.530018 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77cb69d4dc-8pv9z"] Jul 03 14:22:23.530255 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.530217 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" podUID="83b23a07-d775-4447-9353-63acf579f607" containerName="manager" containerID="cri-o://5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be" gracePeriod=30 Jul 03 14:22:23.777963 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.777941 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:23.931539 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.931511 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vw4v\" (UniqueName: \"kubernetes.io/projected/83b23a07-d775-4447-9353-63acf579f607-kube-api-access-7vw4v\") pod \"83b23a07-d775-4447-9353-63acf579f607\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " Jul 03 14:22:23.931697 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.931564 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert\") pod \"83b23a07-d775-4447-9353-63acf579f607\" (UID: \"83b23a07-d775-4447-9353-63acf579f607\") " Jul 03 14:22:23.933651 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.933620 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "83b23a07-d775-4447-9353-63acf579f607" (UID: "83b23a07-d775-4447-9353-63acf579f607"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:22:23.933761 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:23.933710 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b23a07-d775-4447-9353-63acf579f607-kube-api-access-7vw4v" (OuterVolumeSpecName: "kube-api-access-7vw4v") pod "83b23a07-d775-4447-9353-63acf579f607" (UID: "83b23a07-d775-4447-9353-63acf579f607"). InnerVolumeSpecName "kube-api-access-7vw4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:22:24.032139 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.032075 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vw4v\" (UniqueName: \"kubernetes.io/projected/83b23a07-d775-4447-9353-63acf579f607-kube-api-access-7vw4v\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:22:24.032139 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.032105 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83b23a07-d775-4447-9353-63acf579f607-webhook-cert\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:22:24.479262 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.479234 2574 generic.go:356] "Generic (PLEG): container finished" podID="83b23a07-d775-4447-9353-63acf579f607" containerID="5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be" exitCode=0 Jul 03 14:22:24.479630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.479268 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" event={"ID":"83b23a07-d775-4447-9353-63acf579f607","Type":"ContainerDied","Data":"5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be"} Jul 03 14:22:24.479630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.479321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" event={"ID":"83b23a07-d775-4447-9353-63acf579f607","Type":"ContainerDied","Data":"dddd2e850c9b358bd837b581b38c8e224d89f70e7b3661d22184514a175eaf6a"} Jul 03 14:22:24.479630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.479343 2574 scope.go:117] "RemoveContainer" containerID="5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be" Jul 03 14:22:24.479630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.479276 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77cb69d4dc-8pv9z" Jul 03 14:22:24.488026 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.488008 2574 scope.go:117] "RemoveContainer" containerID="5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be" Jul 03 14:22:24.488320 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:24.488303 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be\": container with ID starting with 5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be not found: ID does not exist" containerID="5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be" Jul 03 14:22:24.488393 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.488331 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be"} err="failed to get container status \"5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be\": rpc error: code = NotFound desc = could not find container \"5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be\": container with ID starting with 5caa453618e95b774cfd4ae46b75b3923b4ec09275490a446c17434945fed2be not found: ID does not exist" Jul 03 14:22:24.504098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.504074 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77cb69d4dc-8pv9z"] Jul 03 14:22:24.509163 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:24.509146 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77cb69d4dc-8pv9z"] Jul 03 14:22:26.359430 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:26.359390 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b23a07-d775-4447-9353-63acf579f607" path="/var/lib/kubelet/pods/83b23a07-d775-4447-9353-63acf579f607/volumes" Jul 03 14:22:44.698080 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:44.698027 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:45.166856 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.166789 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:45.175815 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.175775 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-747f7bcddc-6nk72"] Jul 03 14:22:45.176220 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.176203 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b23a07-d775-4447-9353-63acf579f607" containerName="manager" Jul 03 14:22:45.176309 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.176223 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b23a07-d775-4447-9353-63acf579f607" containerName="manager" Jul 03 14:22:45.176365 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.176319 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b23a07-d775-4447-9353-63acf579f607" containerName="manager" Jul 03 14:22:45.180891 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.180869 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.183453 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.183435 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 03 14:22:45.183557 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.183519 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-r4fqb\"" Jul 03 14:22:45.191747 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.191726 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-747f7bcddc-6nk72"] Jul 03 14:22:45.201732 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.201712 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-maas-api-tls\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.201844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.201763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgb5s\" (UniqueName: \"kubernetes.io/projected/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-kube-api-access-bgb5s\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.201897 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.201852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-openshift-service-ca\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.302384 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.302348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-maas-api-tls\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.302523 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.302411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgb5s\" (UniqueName: \"kubernetes.io/projected/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-kube-api-access-bgb5s\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.302523 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.302451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-openshift-service-ca\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.302523 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:45.302498 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 03 14:22:45.302652 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:22:45.302562 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-maas-api-tls podName:1cff1e0b-cd60-4f13-bd77-efa8155dd9fc nodeName:}" failed. No retries permitted until 2026-07-03 14:22:45.802543796 +0000 UTC m=+675.916365367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-maas-api-tls") pod "maas-api-747f7bcddc-6nk72" (UID: "1cff1e0b-cd60-4f13-bd77-efa8155dd9fc") : secret "maas-api-serving-cert" not found Jul 03 14:22:45.303084 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.303067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-openshift-service-ca\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.321768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.321742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgb5s\" (UniqueName: \"kubernetes.io/projected/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-kube-api-access-bgb5s\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.414953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.414926 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:45.802305 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.802271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:45.806340 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.806317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-maas-api-tls\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.808642 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.808622 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cff1e0b-cd60-4f13-bd77-efa8155dd9fc-maas-api-tls\") pod \"maas-api-747f7bcddc-6nk72\" (UID: \"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc\") " pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:45.925348 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:45.925319 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:46.008848 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.008813 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nknwf"] Jul 03 14:22:46.012284 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.012265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:46.015823 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.015792 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-68sk6\"" Jul 03 14:22:46.016101 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.016081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 03 14:22:46.024126 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.024107 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nknwf"] Jul 03 14:22:46.092004 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.091942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:46.109233 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.109210 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8058947-1ba4-43df-95fc-6e8005039b3b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nknwf\" (UID: \"a8058947-1ba4-43df-95fc-6e8005039b3b\") " pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:46.109341 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.109273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfpw5\" (UniqueName: \"kubernetes.io/projected/a8058947-1ba4-43df-95fc-6e8005039b3b-kube-api-access-mfpw5\") pod \"payload-pre-processing-7964457696-nknwf\" (UID: \"a8058947-1ba4-43df-95fc-6e8005039b3b\") " pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:46.138989 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.138954 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6kzfl"] Jul 03 14:22:46.143020 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.142996 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:46.165681 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.165469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6kzfl"] Jul 03 14:22:46.209786 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.209744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8058947-1ba4-43df-95fc-6e8005039b3b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nknwf\" (UID: \"a8058947-1ba4-43df-95fc-6e8005039b3b\") " pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:46.209977 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.209908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f955d87-43d3-4e0c-85ca-a2130ade2986-plugins-config-volume\") pod \"payload-processing-58f86c7798-6kzfl\" (UID: \"2f955d87-43d3-4e0c-85ca-a2130ade2986\") " pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:46.209977 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.209957 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfpw5\" (UniqueName: \"kubernetes.io/projected/a8058947-1ba4-43df-95fc-6e8005039b3b-kube-api-access-mfpw5\") pod \"payload-pre-processing-7964457696-nknwf\" (UID: \"a8058947-1ba4-43df-95fc-6e8005039b3b\") " pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:46.210104 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.210025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2xk8\" (UniqueName: \"kubernetes.io/projected/2f955d87-43d3-4e0c-85ca-a2130ade2986-kube-api-access-z2xk8\") pod \"payload-processing-58f86c7798-6kzfl\" (UID: \"2f955d87-43d3-4e0c-85ca-a2130ade2986\") " pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:46.210734 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.210710 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8058947-1ba4-43df-95fc-6e8005039b3b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nknwf\" (UID: \"a8058947-1ba4-43df-95fc-6e8005039b3b\") " pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:46.222002 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.221978 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfpw5\" (UniqueName: \"kubernetes.io/projected/a8058947-1ba4-43df-95fc-6e8005039b3b-kube-api-access-mfpw5\") pod \"payload-pre-processing-7964457696-nknwf\" (UID: \"a8058947-1ba4-43df-95fc-6e8005039b3b\") " pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:46.251504 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.251481 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-747f7bcddc-6nk72"] Jul 03 14:22:46.254153 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:22:46.254131 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cff1e0b_cd60_4f13_bd77_efa8155dd9fc.slice/crio-036221a0b292622be960d03f60a5b53c9fcdfa7826ac57a841b8af66c524979e WatchSource:0}: Error finding container 036221a0b292622be960d03f60a5b53c9fcdfa7826ac57a841b8af66c524979e: Status 404 returned error can't find the container with id 036221a0b292622be960d03f60a5b53c9fcdfa7826ac57a841b8af66c524979e Jul 03 14:22:46.310675 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.310653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2xk8\" (UniqueName: \"kubernetes.io/projected/2f955d87-43d3-4e0c-85ca-a2130ade2986-kube-api-access-z2xk8\") pod \"payload-processing-58f86c7798-6kzfl\" (UID: \"2f955d87-43d3-4e0c-85ca-a2130ade2986\") " pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:46.310772 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.310731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f955d87-43d3-4e0c-85ca-a2130ade2986-plugins-config-volume\") pod \"payload-processing-58f86c7798-6kzfl\" (UID: \"2f955d87-43d3-4e0c-85ca-a2130ade2986\") " pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:46.311361 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.311343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f955d87-43d3-4e0c-85ca-a2130ade2986-plugins-config-volume\") pod \"payload-processing-58f86c7798-6kzfl\" (UID: \"2f955d87-43d3-4e0c-85ca-a2130ade2986\") " pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:46.321720 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.321697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2xk8\" (UniqueName: \"kubernetes.io/projected/2f955d87-43d3-4e0c-85ca-a2130ade2986-kube-api-access-z2xk8\") pod \"payload-processing-58f86c7798-6kzfl\" (UID: \"2f955d87-43d3-4e0c-85ca-a2130ade2986\") " pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:46.323425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.323403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:46.461693 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.461650 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:46.464553 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.464534 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nknwf"] Jul 03 14:22:46.467370 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:22:46.467342 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8058947_1ba4_43df_95fc_6e8005039b3b.slice/crio-43690ceab7f2644cfda44c6ac0b27f9b1f619555664719222a7225e20b3d022b WatchSource:0}: Error finding container 43690ceab7f2644cfda44c6ac0b27f9b1f619555664719222a7225e20b3d022b: Status 404 returned error can't find the container with id 43690ceab7f2644cfda44c6ac0b27f9b1f619555664719222a7225e20b3d022b Jul 03 14:22:46.596213 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.596168 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" event={"ID":"a8058947-1ba4-43df-95fc-6e8005039b3b","Type":"ContainerStarted","Data":"43690ceab7f2644cfda44c6ac0b27f9b1f619555664719222a7225e20b3d022b"} Jul 03 14:22:46.598104 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.598074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-747f7bcddc-6nk72" event={"ID":"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc","Type":"ContainerStarted","Data":"036221a0b292622be960d03f60a5b53c9fcdfa7826ac57a841b8af66c524979e"} Jul 03 14:22:46.611591 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:46.611318 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6kzfl"] Jul 03 14:22:46.620064 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:22:46.620032 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f955d87_43d3_4e0c_85ca_a2130ade2986.slice/crio-904f5e983eda279e9e991f34a7cd5c65299f6304c77e7097e9f32e8156b9f47b WatchSource:0}: Error finding container 904f5e983eda279e9e991f34a7cd5c65299f6304c77e7097e9f32e8156b9f47b: Status 404 returned error can't find the container with id 904f5e983eda279e9e991f34a7cd5c65299f6304c77e7097e9f32e8156b9f47b Jul 03 14:22:47.607792 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:47.607667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" event={"ID":"2f955d87-43d3-4e0c-85ca-a2130ade2986","Type":"ContainerStarted","Data":"904f5e983eda279e9e991f34a7cd5c65299f6304c77e7097e9f32e8156b9f47b"} Jul 03 14:22:49.620497 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.620468 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" event={"ID":"2f955d87-43d3-4e0c-85ca-a2130ade2986","Type":"ContainerStarted","Data":"ca0d99218e46c354c7191b659cef5ef852d5eaea78ce589f70ccbc54c4860f14"} Jul 03 14:22:49.620977 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.620565 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:22:49.622090 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.622064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" event={"ID":"a8058947-1ba4-43df-95fc-6e8005039b3b","Type":"ContainerStarted","Data":"c342adf907cc19d8ce1c61f8f0e582c5820adce25ddc9bcb999435ff5854fd3d"} Jul 03 14:22:49.622220 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.622162 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:22:49.623466 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.623443 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-747f7bcddc-6nk72" event={"ID":"1cff1e0b-cd60-4f13-bd77-efa8155dd9fc","Type":"ContainerStarted","Data":"e1faa685b86c7c4262ecc5787c0117c2805c1c3015b52fc1abe0b450682a727c"} Jul 03 14:22:49.623574 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.623559 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:49.679160 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.679111 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-747f7bcddc-6nk72" podStartSLOduration=2.328913572 podStartE2EDuration="4.679094397s" totalImagesPullingTime="2.350180825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:22:49.678943217 +0000 UTC m=+679.792764792" watchObservedRunningTime="2026-07-03 14:22:49.679094397 +0000 UTC m=+679.792915971" Jul 03 14:22:49.680358 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.680327 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" podStartSLOduration=1.6942819569999998 podStartE2EDuration="3.680316192s" totalImagesPullingTime="1.986034235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:22:49.648421147 +0000 UTC m=+679.762242722" watchObservedRunningTime="2026-07-03 14:22:49.680316192 +0000 UTC m=+679.794137765" Jul 03 14:22:49.702297 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:49.702258 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" podStartSLOduration=2.5674526909999997 podStartE2EDuration="4.702249056s" totalImagesPullingTime="2.134796365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:22:49.700121733 +0000 UTC m=+679.813943305" watchObservedRunningTime="2026-07-03 14:22:49.702249056 +0000 UTC m=+679.816070630" Jul 03 14:22:53.647726 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:53.647690 2574 generic.go:356] "Generic (PLEG): container finished" podID="72646bbd-5107-4bb4-ba89-fe17c7b9e150" containerID="4452aeea577875126b04662c1177673af440ed60af3a8bc50573b314f96cd16b" exitCode=0 Jul 03 14:22:53.648160 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:53.647736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" event={"ID":"72646bbd-5107-4bb4-ba89-fe17c7b9e150","Type":"ContainerDied","Data":"4452aeea577875126b04662c1177673af440ed60af3a8bc50573b314f96cd16b"} Jul 03 14:22:53.648237 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:53.648220 2574 scope.go:117] "RemoveContainer" containerID="4452aeea577875126b04662c1177673af440ed60af3a8bc50573b314f96cd16b" Jul 03 14:22:53.649231 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:53.649196 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 14:22:53.649309 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:53.649268 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 14:22:53.649309 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:53.649299 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 14:22:54.658725 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:54.658691 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" event={"ID":"72646bbd-5107-4bb4-ba89-fe17c7b9e150","Type":"ContainerStarted","Data":"48edb60d5eaa98644bca7aa995a78b636145a84dc17135439990e5d49195d525"} Jul 03 14:22:54.776789 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:54.776755 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:22:54.777019 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:54.776970 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dld5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 03 14:22:54.777096 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:54.777022 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" podUID="72646bbd-5107-4bb4-ba89-fe17c7b9e150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 03 14:22:55.641842 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:55.641004 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-747f7bcddc-6nk72" Jul 03 14:22:55.776779 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:55.776749 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dld5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 03 14:22:55.777161 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:55.776818 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" podUID="72646bbd-5107-4bb4-ba89-fe17c7b9e150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 03 14:22:56.726279 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:56.726228 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:56.776338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:56.776306 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dld5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 03 14:22:56.776486 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:56.776365 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" podUID="72646bbd-5107-4bb4-ba89-fe17c7b9e150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 03 14:22:56.845709 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:56.845676 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:22:57.776505 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:57.776467 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dld5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 03 14:22:57.776670 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:57.776535 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" podUID="72646bbd-5107-4bb4-ba89-fe17c7b9e150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 03 14:22:58.779308 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:58.779278 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:22:58.779684 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:58.779545 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:22:58.780124 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:22:58.780107 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dld5d" Jul 03 14:23:00.631757 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:00.631717 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-nknwf" Jul 03 14:23:00.632186 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:00.631955 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-6kzfl" Jul 03 14:23:33.828156 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:33.828075 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9"] Jul 03 14:23:33.831538 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:33.831519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:33.834168 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:33.834139 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 03 14:23:33.834326 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:33.834231 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 03 14:23:33.834411 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:33.834386 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-smmbm\"" Jul 03 14:23:33.834466 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:33.834444 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 03 14:23:33.845688 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:33.845666 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9"] Jul 03 14:23:33.860299 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:33.860260 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:23:34.018751 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.018719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.018751 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.018754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94f5956f-4f62-45ec-a539-54d127bce401-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.019005 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.018781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbnt4\" (UniqueName: \"kubernetes.io/projected/94f5956f-4f62-45ec-a539-54d127bce401-kube-api-access-bbnt4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.019005 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.018915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.019005 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.018959 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.019138 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.019037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.119937 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.119862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.119937 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.119897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94f5956f-4f62-45ec-a539-54d127bce401-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.119937 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.119918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbnt4\" (UniqueName: \"kubernetes.io/projected/94f5956f-4f62-45ec-a539-54d127bce401-kube-api-access-bbnt4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.120166 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.119941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.120166 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.119961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.120166 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.120092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.120340 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.120320 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.120384 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.120370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.120436 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.120418 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.122172 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.122153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94f5956f-4f62-45ec-a539-54d127bce401-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.122425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.122405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94f5956f-4f62-45ec-a539-54d127bce401-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.131233 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.131209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbnt4\" (UniqueName: \"kubernetes.io/projected/94f5956f-4f62-45ec-a539-54d127bce401-kube-api-access-bbnt4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9\" (UID: \"94f5956f-4f62-45ec-a539-54d127bce401\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.143047 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.143026 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:34.286468 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.286440 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9"] Jul 03 14:23:34.287083 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:23:34.287058 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f5956f_4f62_45ec_a539_54d127bce401.slice/crio-fbd39c8f1823795f0b8adab8dfccaf98a672d55ba43ed0f5b6c0ea7f892cbdd1 WatchSource:0}: Error finding container fbd39c8f1823795f0b8adab8dfccaf98a672d55ba43ed0f5b6c0ea7f892cbdd1: Status 404 returned error can't find the container with id fbd39c8f1823795f0b8adab8dfccaf98a672d55ba43ed0f5b6c0ea7f892cbdd1 Jul 03 14:23:34.868263 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:34.868224 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" event={"ID":"94f5956f-4f62-45ec-a539-54d127bce401","Type":"ContainerStarted","Data":"fbd39c8f1823795f0b8adab8dfccaf98a672d55ba43ed0f5b6c0ea7f892cbdd1"} Jul 03 14:23:35.878127 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:35.878088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" event={"ID":"94f5956f-4f62-45ec-a539-54d127bce401","Type":"ContainerStarted","Data":"696d654d018aaa843b286bc59ade9fc85f626212e439f76fb9f410fab458650e"} Jul 03 14:23:35.903733 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:35.903688 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" podStartSLOduration=1.856982659 podStartE2EDuration="2.903673215s" totalImagesPullingTime="1.046690556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:23:35.901212672 +0000 UTC m=+726.015034256" watchObservedRunningTime="2026-07-03 14:23:35.903673215 +0000 UTC m=+726.017494960" Jul 03 14:23:38.117536 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.117500 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6"] Jul 03 14:23:38.121175 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.121154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.124226 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.124206 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 03 14:23:38.141049 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.141024 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6"] Jul 03 14:23:38.154844 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.154789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.154950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.154863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70b717d7-ca0f-4a90-925e-8177445d3da5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.154950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.154902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.154950 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.154920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqvd\" (UniqueName: \"kubernetes.io/projected/70b717d7-ca0f-4a90-925e-8177445d3da5-kube-api-access-7kqvd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.155115 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.154980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.155115 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.155036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.237222 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.237190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:23:38.256372 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.256343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.256487 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.256398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70b717d7-ca0f-4a90-925e-8177445d3da5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.256538 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.256501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.256538 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.256533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqvd\" (UniqueName: \"kubernetes.io/projected/70b717d7-ca0f-4a90-925e-8177445d3da5-kube-api-access-7kqvd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.256630 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.256583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.256681 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.256634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.256929 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.256894 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.257042 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.256989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.257108 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.257053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.258678 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.258659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70b717d7-ca0f-4a90-925e-8177445d3da5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.258885 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.258867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70b717d7-ca0f-4a90-925e-8177445d3da5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.269724 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.269701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqvd\" (UniqueName: \"kubernetes.io/projected/70b717d7-ca0f-4a90-925e-8177445d3da5-kube-api-access-7kqvd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhpl6\" (UID: \"70b717d7-ca0f-4a90-925e-8177445d3da5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.431117 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.431036 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:38.581558 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.581532 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6"] Jul 03 14:23:38.583693 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:23:38.583671 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b717d7_ca0f_4a90_925e_8177445d3da5.slice/crio-f6b0d3788d69ad14e8e5e9592b8b3e2940159b4cf95094403af4240c8e218886 WatchSource:0}: Error finding container f6b0d3788d69ad14e8e5e9592b8b3e2940159b4cf95094403af4240c8e218886: Status 404 returned error can't find the container with id f6b0d3788d69ad14e8e5e9592b8b3e2940159b4cf95094403af4240c8e218886 Jul 03 14:23:38.894528 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.894491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" event={"ID":"70b717d7-ca0f-4a90-925e-8177445d3da5","Type":"ContainerStarted","Data":"856c5bf1ac31cc1ec7e32f30df3ca8063d018df4150b6b69ac702eeb3e3eaf70"} Jul 03 14:23:38.894681 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.894552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" event={"ID":"70b717d7-ca0f-4a90-925e-8177445d3da5","Type":"ContainerStarted","Data":"f6b0d3788d69ad14e8e5e9592b8b3e2940159b4cf95094403af4240c8e218886"} Jul 03 14:23:38.929022 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:38.928971 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" podStartSLOduration=0.749047195 podStartE2EDuration="928.955169ms" totalImagesPullingTime="179.907974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:23:38.928052796 +0000 UTC m=+729.041874369" watchObservedRunningTime="2026-07-03 14:23:38.928955169 +0000 UTC m=+729.042776741" Jul 03 14:23:44.144059 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:44.144011 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:44.144059 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:44.144079 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:44.156640 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:44.156614 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:44.937906 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:44.937867 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9" Jul 03 14:23:48.431360 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:48.431324 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:48.431756 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:48.431401 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:48.443364 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:48.443341 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:48.957910 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:48.957883 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhpl6" Jul 03 14:23:50.222602 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.222574 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz"] Jul 03 14:23:50.227395 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.227378 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.241642 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.241616 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 03 14:23:50.248283 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.248256 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz"] Jul 03 14:23:50.263177 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.263151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.263287 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.263189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.263287 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.263206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8ns8\" (UniqueName: \"kubernetes.io/projected/9e465e5c-cfb1-4764-a407-b023b3f8b579-kube-api-access-n8ns8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.263287 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.263271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.263431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.263320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e465e5c-cfb1-4764-a407-b023b3f8b579-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.263431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.263342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.290693 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.290662 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:23:50.364377 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.364349 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.364567 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.364417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e465e5c-cfb1-4764-a407-b023b3f8b579-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.364896 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.364871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.365094 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.365070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.365237 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.365142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.365237 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.365174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.365237 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.365198 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8ns8\" (UniqueName: \"kubernetes.io/projected/9e465e5c-cfb1-4764-a407-b023b3f8b579-kube-api-access-n8ns8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.365440 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.365417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.365690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.365666 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.367469 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.367449 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e465e5c-cfb1-4764-a407-b023b3f8b579-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.367571 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.367554 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e465e5c-cfb1-4764-a407-b023b3f8b579-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.387414 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.387393 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8ns8\" (UniqueName: \"kubernetes.io/projected/9e465e5c-cfb1-4764-a407-b023b3f8b579-kube-api-access-n8ns8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nrgdz\" (UID: \"9e465e5c-cfb1-4764-a407-b023b3f8b579\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.538676 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.538593 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:23:50.699519 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.699493 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz"] Jul 03 14:23:50.701912 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:23:50.701887 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e465e5c_cfb1_4764_a407_b023b3f8b579.slice/crio-b2abb4ed2c74a25bd4d6dcbd22084bd854cef2b14051faa6e5dc87e5376b5c6e WatchSource:0}: Error finding container b2abb4ed2c74a25bd4d6dcbd22084bd854cef2b14051faa6e5dc87e5376b5c6e: Status 404 returned error can't find the container with id b2abb4ed2c74a25bd4d6dcbd22084bd854cef2b14051faa6e5dc87e5376b5c6e Jul 03 14:23:50.958484 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:50.958453 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" event={"ID":"9e465e5c-cfb1-4764-a407-b023b3f8b579","Type":"ContainerStarted","Data":"b2abb4ed2c74a25bd4d6dcbd22084bd854cef2b14051faa6e5dc87e5376b5c6e"} Jul 03 14:23:51.965130 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:51.965097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" event={"ID":"9e465e5c-cfb1-4764-a407-b023b3f8b579","Type":"ContainerStarted","Data":"87ddca0dffb52de0a3fa71228c509149d8c43e3f729f698e14fc98509f19d895"} Jul 03 14:23:51.998952 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:23:51.998905 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" podStartSLOduration=1.723508032 podStartE2EDuration="1.998889483s" totalImagesPullingTime="275.381451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:23:51.994937459 +0000 UTC m=+742.108759033" watchObservedRunningTime="2026-07-03 14:23:51.998889483 +0000 UTC m=+742.112711056" Jul 03 14:24:00.539556 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:00.539523 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:24:00.540027 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:00.539580 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:24:00.552268 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:00.552241 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:24:01.026639 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:01.026612 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nrgdz" Jul 03 14:24:03.149532 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:03.149499 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:24:08.810751 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.810717 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh"] Jul 03 14:24:08.817543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.817519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:08.820664 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.820636 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 03 14:24:08.831595 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.831573 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh"] Jul 03 14:24:08.852904 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.852875 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:24:08.931204 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.931180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32438969-681e-40db-ada5-3afb3321ef66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:08.931338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.931209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:08.931338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.931251 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vz9\" (UniqueName: \"kubernetes.io/projected/32438969-681e-40db-ada5-3afb3321ef66-kube-api-access-49vz9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:08.931458 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.931330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:08.931458 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.931387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:08.931553 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:08.931458 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032226 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032194 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032420 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32438969-681e-40db-ada5-3afb3321ef66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032420 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032420 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vz9\" (UniqueName: \"kubernetes.io/projected/32438969-681e-40db-ada5-3afb3321ef66-kube-api-access-49vz9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032420 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032420 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032719 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032779 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.032779 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.032769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.034973 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.034939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32438969-681e-40db-ada5-3afb3321ef66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.035441 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.035417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32438969-681e-40db-ada5-3afb3321ef66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.041724 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.041699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vz9\" (UniqueName: \"kubernetes.io/projected/32438969-681e-40db-ada5-3afb3321ef66-kube-api-access-49vz9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nz2xh\" (UID: \"32438969-681e-40db-ada5-3afb3321ef66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.128875 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.128772 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:09.290702 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:09.290664 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh"] Jul 03 14:24:09.291940 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:24:09.291910 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32438969_681e_40db_ada5_3afb3321ef66.slice/crio-dc319e68432b1d77e7794bbc5a33989c9edc5482e99497cd2a8f56dae115fac4 WatchSource:0}: Error finding container dc319e68432b1d77e7794bbc5a33989c9edc5482e99497cd2a8f56dae115fac4: Status 404 returned error can't find the container with id dc319e68432b1d77e7794bbc5a33989c9edc5482e99497cd2a8f56dae115fac4 Jul 03 14:24:10.064559 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:10.064521 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" event={"ID":"32438969-681e-40db-ada5-3afb3321ef66","Type":"ContainerStarted","Data":"d74a26cba8f9ac72efcc3f032399cfb92379ffa0ec771d03cb83b968a24e5ce1"} Jul 03 14:24:10.065018 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:10.064582 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" event={"ID":"32438969-681e-40db-ada5-3afb3321ef66","Type":"ContainerStarted","Data":"dc319e68432b1d77e7794bbc5a33989c9edc5482e99497cd2a8f56dae115fac4"} Jul 03 14:24:10.085379 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:10.085331 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" podStartSLOduration=1.902270302 podStartE2EDuration="2.085316117s" totalImagesPullingTime="183.045815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:24:10.083532126 +0000 UTC m=+760.197353718" watchObservedRunningTime="2026-07-03 14:24:10.085316117 +0000 UTC m=+760.199137689" Jul 03 14:24:15.701024 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:15.700986 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:24:15.798010 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:15.797975 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:24:16.300899 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:16.300857 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:24:19.129462 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:19.129429 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:19.129940 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:19.129494 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:19.142913 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:19.142890 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:24:20.134880 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:24:20.134853 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nz2xh" Jul 03 14:25:36.449921 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.449892 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7474965594-pbk4q"] Jul 03 14:25:36.453528 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.453512 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7474965594-pbk4q" Jul 03 14:25:36.456013 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.455990 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 03 14:25:36.456553 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.456535 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zw7mb\"" Jul 03 14:25:36.462766 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.462742 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7474965594-pbk4q"] Jul 03 14:25:36.528183 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.528156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f6adf77-3a62-4247-b127-fd8cba03bb8f-tls-cert\") pod \"authorino-7474965594-pbk4q\" (UID: \"9f6adf77-3a62-4247-b127-fd8cba03bb8f\") " pod="kuadrant-system/authorino-7474965594-pbk4q" Jul 03 14:25:36.528332 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.528267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h4vc\" (UniqueName: \"kubernetes.io/projected/9f6adf77-3a62-4247-b127-fd8cba03bb8f-kube-api-access-6h4vc\") pod \"authorino-7474965594-pbk4q\" (UID: \"9f6adf77-3a62-4247-b127-fd8cba03bb8f\") " pod="kuadrant-system/authorino-7474965594-pbk4q" Jul 03 14:25:36.629146 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.629109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4vc\" (UniqueName: \"kubernetes.io/projected/9f6adf77-3a62-4247-b127-fd8cba03bb8f-kube-api-access-6h4vc\") pod \"authorino-7474965594-pbk4q\" (UID: \"9f6adf77-3a62-4247-b127-fd8cba03bb8f\") " pod="kuadrant-system/authorino-7474965594-pbk4q" Jul 03 14:25:36.629307 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.629197 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f6adf77-3a62-4247-b127-fd8cba03bb8f-tls-cert\") pod \"authorino-7474965594-pbk4q\" (UID: \"9f6adf77-3a62-4247-b127-fd8cba03bb8f\") " pod="kuadrant-system/authorino-7474965594-pbk4q" Jul 03 14:25:36.631554 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.631535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f6adf77-3a62-4247-b127-fd8cba03bb8f-tls-cert\") pod \"authorino-7474965594-pbk4q\" (UID: \"9f6adf77-3a62-4247-b127-fd8cba03bb8f\") " pod="kuadrant-system/authorino-7474965594-pbk4q" Jul 03 14:25:36.638414 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.638387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4vc\" (UniqueName: \"kubernetes.io/projected/9f6adf77-3a62-4247-b127-fd8cba03bb8f-kube-api-access-6h4vc\") pod \"authorino-7474965594-pbk4q\" (UID: \"9f6adf77-3a62-4247-b127-fd8cba03bb8f\") " pod="kuadrant-system/authorino-7474965594-pbk4q" Jul 03 14:25:36.763971 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.763844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7474965594-pbk4q" Jul 03 14:25:36.769381 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.769351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:25:36.872580 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.872485 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:25:36.905254 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:36.905230 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7474965594-pbk4q"] Jul 03 14:25:36.907013 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:25:36.906991 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f6adf77_3a62_4247_b127_fd8cba03bb8f.slice/crio-7d609734a32defff5dbc0aabe81d94232319d1fea238710b4db690806b241aa0 WatchSource:0}: Error finding container 7d609734a32defff5dbc0aabe81d94232319d1fea238710b4db690806b241aa0: Status 404 returned error can't find the container with id 7d609734a32defff5dbc0aabe81d94232319d1fea238710b4db690806b241aa0 Jul 03 14:25:37.550557 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:37.550522 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7474965594-pbk4q" event={"ID":"9f6adf77-3a62-4247-b127-fd8cba03bb8f","Type":"ContainerStarted","Data":"4430134534b7986819f76f0fd78956d3facc4ac99732192d2b803ff6ccc18438"} Jul 03 14:25:37.551046 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:37.550574 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7474965594-pbk4q" event={"ID":"9f6adf77-3a62-4247-b127-fd8cba03bb8f","Type":"ContainerStarted","Data":"7d609734a32defff5dbc0aabe81d94232319d1fea238710b4db690806b241aa0"} Jul 03 14:25:37.575095 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:37.575004 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7474965594-pbk4q" podStartSLOduration=1.159317598 podStartE2EDuration="1.574989377s" totalImagesPullingTime="415.671779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:25:37.57228087 +0000 UTC m=+847.686102443" watchObservedRunningTime="2026-07-03 14:25:37.574989377 +0000 UTC m=+847.688810949" Jul 03 14:25:37.929387 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:37.929294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:25:38.028565 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:25:38.028520 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:26:17.150794 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:26:17.150755 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:08.308081 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.308042 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:08.407149 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.407115 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-755bf6967f-mhdvv"] Jul 03 14:27:08.407361 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.407336 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-755bf6967f-mhdvv" podUID="75d25bda-f3da-407a-b5f3-162cbfb0d65a" containerName="manager" containerID="cri-o://505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083" gracePeriod=30 Jul 03 14:27:08.657526 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.657504 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:27:08.769402 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.769372 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6vcb\" (UniqueName: \"kubernetes.io/projected/75d25bda-f3da-407a-b5f3-162cbfb0d65a-kube-api-access-c6vcb\") pod \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " Jul 03 14:27:08.769562 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.769480 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert\") pod \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\" (UID: \"75d25bda-f3da-407a-b5f3-162cbfb0d65a\") " Jul 03 14:27:08.771500 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.771462 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d25bda-f3da-407a-b5f3-162cbfb0d65a-kube-api-access-c6vcb" (OuterVolumeSpecName: "kube-api-access-c6vcb") pod "75d25bda-f3da-407a-b5f3-162cbfb0d65a" (UID: "75d25bda-f3da-407a-b5f3-162cbfb0d65a"). InnerVolumeSpecName "kube-api-access-c6vcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:27:08.771500 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.771471 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "75d25bda-f3da-407a-b5f3-162cbfb0d65a" (UID: "75d25bda-f3da-407a-b5f3-162cbfb0d65a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:27:08.870945 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.870914 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75d25bda-f3da-407a-b5f3-162cbfb0d65a-webhook-cert\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:27:08.870945 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:08.870940 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6vcb\" (UniqueName: \"kubernetes.io/projected/75d25bda-f3da-407a-b5f3-162cbfb0d65a-kube-api-access-c6vcb\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:27:09.050120 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.050085 2574 generic.go:356] "Generic (PLEG): container finished" podID="75d25bda-f3da-407a-b5f3-162cbfb0d65a" containerID="505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083" exitCode=0 Jul 03 14:27:09.050312 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.050139 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bf6967f-mhdvv" Jul 03 14:27:09.050312 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.050194 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bf6967f-mhdvv" event={"ID":"75d25bda-f3da-407a-b5f3-162cbfb0d65a","Type":"ContainerDied","Data":"505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083"} Jul 03 14:27:09.050312 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.050257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bf6967f-mhdvv" event={"ID":"75d25bda-f3da-407a-b5f3-162cbfb0d65a","Type":"ContainerDied","Data":"30f57856c8672a3fa49ea8192215278ddb648d3987089ec0c774ce9f2d87601b"} Jul 03 14:27:09.050312 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.050279 2574 scope.go:117] "RemoveContainer" containerID="505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083" Jul 03 14:27:09.060399 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.060384 2574 scope.go:117] "RemoveContainer" containerID="505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083" Jul 03 14:27:09.060678 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:27:09.060651 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083\": container with ID starting with 505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083 not found: ID does not exist" containerID="505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083" Jul 03 14:27:09.060776 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.060685 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083"} err="failed to get container status \"505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083\": rpc error: code = NotFound desc = could not find container \"505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083\": container with ID starting with 505b669d558e8e2cdb6281c613469ba51d3b7ec748db4cc557fba1a835ec9083 not found: ID does not exist" Jul 03 14:27:09.074850 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.074824 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-755bf6967f-mhdvv"] Jul 03 14:27:09.080190 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.080131 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-755bf6967f-mhdvv"] Jul 03 14:27:09.841921 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.841872 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:09.963605 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.963572 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-755bf6967f-qjh2l"] Jul 03 14:27:09.964039 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.964024 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d25bda-f3da-407a-b5f3-162cbfb0d65a" containerName="manager" Jul 03 14:27:09.964100 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.964040 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d25bda-f3da-407a-b5f3-162cbfb0d65a" containerName="manager" Jul 03 14:27:09.964137 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.964102 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d25bda-f3da-407a-b5f3-162cbfb0d65a" containerName="manager" Jul 03 14:27:09.968397 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.968382 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:09.971838 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.971815 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kfp2j\"" Jul 03 14:27:09.971956 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.971842 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 03 14:27:09.971956 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.971923 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 03 14:27:09.977380 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:09.977361 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755bf6967f-qjh2l"] Jul 03 14:27:10.080720 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.080691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ks5h\" (UniqueName: \"kubernetes.io/projected/02a440c4-f811-4b47-93a7-707bc1db9539-kube-api-access-5ks5h\") pod \"maas-controller-755bf6967f-qjh2l\" (UID: \"02a440c4-f811-4b47-93a7-707bc1db9539\") " pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:10.080938 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.080824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02a440c4-f811-4b47-93a7-707bc1db9539-webhook-cert\") pod \"maas-controller-755bf6967f-qjh2l\" (UID: \"02a440c4-f811-4b47-93a7-707bc1db9539\") " pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:10.181432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.181350 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ks5h\" (UniqueName: \"kubernetes.io/projected/02a440c4-f811-4b47-93a7-707bc1db9539-kube-api-access-5ks5h\") pod \"maas-controller-755bf6967f-qjh2l\" (UID: \"02a440c4-f811-4b47-93a7-707bc1db9539\") " pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:10.181432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.181411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02a440c4-f811-4b47-93a7-707bc1db9539-webhook-cert\") pod \"maas-controller-755bf6967f-qjh2l\" (UID: \"02a440c4-f811-4b47-93a7-707bc1db9539\") " pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:10.183809 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.183777 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02a440c4-f811-4b47-93a7-707bc1db9539-webhook-cert\") pod \"maas-controller-755bf6967f-qjh2l\" (UID: \"02a440c4-f811-4b47-93a7-707bc1db9539\") " pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:10.192898 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.192868 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ks5h\" (UniqueName: \"kubernetes.io/projected/02a440c4-f811-4b47-93a7-707bc1db9539-kube-api-access-5ks5h\") pod \"maas-controller-755bf6967f-qjh2l\" (UID: \"02a440c4-f811-4b47-93a7-707bc1db9539\") " pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:10.280276 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.280250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:10.360943 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.360907 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d25bda-f3da-407a-b5f3-162cbfb0d65a" path="/var/lib/kubelet/pods/75d25bda-f3da-407a-b5f3-162cbfb0d65a/volumes" Jul 03 14:27:10.418224 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.418196 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755bf6967f-qjh2l"] Jul 03 14:27:10.419313 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:27:10.419282 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a440c4_f811_4b47_93a7_707bc1db9539.slice/crio-ee046de4a234f7c9746c0d27ebbf6a6363cb87f085f6f99d8ace53c86694b682 WatchSource:0}: Error finding container ee046de4a234f7c9746c0d27ebbf6a6363cb87f085f6f99d8ace53c86694b682: Status 404 returned error can't find the container with id ee046de4a234f7c9746c0d27ebbf6a6363cb87f085f6f99d8ace53c86694b682 Jul 03 14:27:10.420540 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:10.420522 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 14:27:11.062635 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:11.062604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bf6967f-qjh2l" event={"ID":"02a440c4-f811-4b47-93a7-707bc1db9539","Type":"ContainerStarted","Data":"ee046de4a234f7c9746c0d27ebbf6a6363cb87f085f6f99d8ace53c86694b682"} Jul 03 14:27:12.076711 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:12.076668 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bf6967f-qjh2l" event={"ID":"02a440c4-f811-4b47-93a7-707bc1db9539","Type":"ContainerStarted","Data":"7282d2c8438e0ef9fe6f8751151f050df56d9fb83ba5aa225f37c6f88a5bac87"} Jul 03 14:27:12.077152 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:12.076767 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:12.096690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:12.096649 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-755bf6967f-qjh2l" podStartSLOduration=2.3965393649999998 podStartE2EDuration="3.096634657s" totalImagesPullingTime="700.095292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:27:12.094427407 +0000 UTC m=+942.208248992" watchObservedRunningTime="2026-07-03 14:27:12.096634657 +0000 UTC m=+942.210456229" Jul 03 14:27:23.087427 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:23.087397 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-755bf6967f-qjh2l" Jul 03 14:27:44.256093 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:44.256058 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:44.358693 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:44.358661 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:44.477532 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:44.477502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:50.820341 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:50.820291 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:50.917921 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:50.917880 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:51.017427 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:51.017395 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:51.117989 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:51.117915 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:56.541837 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:56.541787 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:57.070014 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:57.069981 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:27:57.138195 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:27:57.138160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:29:12.436114 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:29:12.436080 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:29:12.534836 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:29:12.534782 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:29:14.518559 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:29:14.518519 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:30:09.716307 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:30:09.716272 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:30:09.835648 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:30:09.835604 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:31:53.353494 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:53.353461 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l"] Jul 03 14:31:53.354065 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:53.353689 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" podUID="2795eb5b-a03b-4e58-b47b-364e5a6e59bb" containerName="manager" containerID="cri-o://a11cdce8646625710ba89ff1abc2840ef71b228a36d376ae58f7df1ee536f012" gracePeriod=10 Jul 03 14:31:55.643095 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:55.643064 2574 generic.go:356] "Generic (PLEG): container finished" podID="2795eb5b-a03b-4e58-b47b-364e5a6e59bb" containerID="a11cdce8646625710ba89ff1abc2840ef71b228a36d376ae58f7df1ee536f012" exitCode=0 Jul 03 14:31:55.643447 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:55.643142 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" event={"ID":"2795eb5b-a03b-4e58-b47b-364e5a6e59bb","Type":"ContainerDied","Data":"a11cdce8646625710ba89ff1abc2840ef71b228a36d376ae58f7df1ee536f012"} Jul 03 14:31:55.911778 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:55.911751 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:31:55.983902 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:55.983874 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-extensions-socket-volume\") pod \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\" (UID: \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\") " Jul 03 14:31:55.984057 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:55.983958 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9rh4\" (UniqueName: \"kubernetes.io/projected/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-kube-api-access-m9rh4\") pod \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\" (UID: \"2795eb5b-a03b-4e58-b47b-364e5a6e59bb\") " Jul 03 14:31:55.984338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:55.984305 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2795eb5b-a03b-4e58-b47b-364e5a6e59bb" (UID: "2795eb5b-a03b-4e58-b47b-364e5a6e59bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:31:55.985879 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:55.985854 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-kube-api-access-m9rh4" (OuterVolumeSpecName: "kube-api-access-m9rh4") pod "2795eb5b-a03b-4e58-b47b-364e5a6e59bb" (UID: "2795eb5b-a03b-4e58-b47b-364e5a6e59bb"). InnerVolumeSpecName "kube-api-access-m9rh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:31:56.085129 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:56.085099 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9rh4\" (UniqueName: \"kubernetes.io/projected/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-kube-api-access-m9rh4\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:31:56.085129 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:56.085126 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2795eb5b-a03b-4e58-b47b-364e5a6e59bb-extensions-socket-volume\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:31:56.649662 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:56.649573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" event={"ID":"2795eb5b-a03b-4e58-b47b-364e5a6e59bb","Type":"ContainerDied","Data":"5fb4d896d9a715743c70685b00634c68e4486a16249af14a49e829a6175c8111"} Jul 03 14:31:56.649662 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:56.649609 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l" Jul 03 14:31:56.649662 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:56.649649 2574 scope.go:117] "RemoveContainer" containerID="a11cdce8646625710ba89ff1abc2840ef71b228a36d376ae58f7df1ee536f012" Jul 03 14:31:56.671156 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:56.671130 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l"] Jul 03 14:31:56.674749 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:56.674728 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-65m7l"] Jul 03 14:31:58.362323 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:31:58.362283 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2795eb5b-a03b-4e58-b47b-364e5a6e59bb" path="/var/lib/kubelet/pods/2795eb5b-a03b-4e58-b47b-364e5a6e59bb/volumes" Jul 03 14:32:54.500506 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.500471 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq"] Jul 03 14:32:54.500953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.500897 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2795eb5b-a03b-4e58-b47b-364e5a6e59bb" containerName="manager" Jul 03 14:32:54.500953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.500909 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2795eb5b-a03b-4e58-b47b-364e5a6e59bb" containerName="manager" Jul 03 14:32:54.501046 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.500991 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2795eb5b-a03b-4e58-b47b-364e5a6e59bb" containerName="manager" Jul 03 14:32:54.505326 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.505310 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:54.508107 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.508084 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dhz9f\"" Jul 03 14:32:54.522534 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.522510 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq"] Jul 03 14:32:54.614569 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.614528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ada985-83ef-4bec-9b32-03dcf845bebb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4slzq\" (UID: \"05ada985-83ef-4bec-9b32-03dcf845bebb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:54.614760 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.614584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nxhq\" (UniqueName: \"kubernetes.io/projected/05ada985-83ef-4bec-9b32-03dcf845bebb-kube-api-access-7nxhq\") pod \"kuadrant-operator-controller-manager-86878c769f-4slzq\" (UID: \"05ada985-83ef-4bec-9b32-03dcf845bebb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:54.715232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.715174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ada985-83ef-4bec-9b32-03dcf845bebb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4slzq\" (UID: \"05ada985-83ef-4bec-9b32-03dcf845bebb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:54.715417 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.715250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nxhq\" (UniqueName: \"kubernetes.io/projected/05ada985-83ef-4bec-9b32-03dcf845bebb-kube-api-access-7nxhq\") pod \"kuadrant-operator-controller-manager-86878c769f-4slzq\" (UID: \"05ada985-83ef-4bec-9b32-03dcf845bebb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:54.715637 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.715613 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ada985-83ef-4bec-9b32-03dcf845bebb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4slzq\" (UID: \"05ada985-83ef-4bec-9b32-03dcf845bebb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:54.726509 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.726475 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nxhq\" (UniqueName: \"kubernetes.io/projected/05ada985-83ef-4bec-9b32-03dcf845bebb-kube-api-access-7nxhq\") pod \"kuadrant-operator-controller-manager-86878c769f-4slzq\" (UID: \"05ada985-83ef-4bec-9b32-03dcf845bebb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:54.815142 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.815109 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:54.960881 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:54.960857 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq"] Jul 03 14:32:54.963531 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:32:54.963494 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ada985_83ef_4bec_9b32_03dcf845bebb.slice/crio-764b74e33dc9485eec153cd158a8509b8a5267bc4f061c9045c429414ecfeb1e WatchSource:0}: Error finding container 764b74e33dc9485eec153cd158a8509b8a5267bc4f061c9045c429414ecfeb1e: Status 404 returned error can't find the container with id 764b74e33dc9485eec153cd158a8509b8a5267bc4f061c9045c429414ecfeb1e Jul 03 14:32:55.965658 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:55.965620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" event={"ID":"05ada985-83ef-4bec-9b32-03dcf845bebb","Type":"ContainerStarted","Data":"7f2174c878fbb1a228bb178b058f063225a8b2bdc6262d0cd890e01c8738a69a"} Jul 03 14:32:55.966165 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:55.965679 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" event={"ID":"05ada985-83ef-4bec-9b32-03dcf845bebb","Type":"ContainerStarted","Data":"764b74e33dc9485eec153cd158a8509b8a5267bc4f061c9045c429414ecfeb1e"} Jul 03 14:32:55.966165 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:55.965747 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:32:55.988428 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:32:55.988373 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" podStartSLOduration=1.98835053 podStartE2EDuration="1.98835053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:32:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:32:55.987146818 +0000 UTC m=+1286.100968392" watchObservedRunningTime="2026-07-03 14:32:55.98835053 +0000 UTC m=+1286.102172103" Jul 03 14:33:06.973848 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:33:06.973792 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4slzq" Jul 03 14:33:40.917302 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:33:40.917262 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:34:20.615456 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:34:20.615413 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:34:20.712320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:34:20.712285 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:36:41.758968 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:36:41.758931 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:44.182188 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:44.182092 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:45.372191 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:45.372156 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:50.714695 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:50.714660 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:50.814703 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:50.814662 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:50.965328 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:50.965234 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:51.061762 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:51.061713 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:52.226663 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.226628 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:52.298590 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.298555 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2"] Jul 03 14:38:52.302330 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.302309 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.304788 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.304761 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-69718436-serving-cert\"" Jul 03 14:38:52.312253 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.311619 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2"] Jul 03 14:38:52.313514 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.313482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:52.384010 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.383970 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:52.462357 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.462314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66385bbe-c979-4498-87f4-4164900d2b5d-openshift-service-ca\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.462555 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.462385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.462555 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.462453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf7gr\" (UniqueName: \"kubernetes.io/projected/66385bbe-c979-4498-87f4-4164900d2b5d-kube-api-access-jf7gr\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.563563 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.563519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66385bbe-c979-4498-87f4-4164900d2b5d-openshift-service-ca\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.563787 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.563580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.563787 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.563646 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf7gr\" (UniqueName: \"kubernetes.io/projected/66385bbe-c979-4498-87f4-4164900d2b5d-kube-api-access-jf7gr\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.563787 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:38:52.563695 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-69718436-serving-cert: secret "maas-api-e2e-ait-69718436-serving-cert" not found Jul 03 14:38:52.563787 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:38:52.563785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls podName:66385bbe-c979-4498-87f4-4164900d2b5d nodeName:}" failed. No retries permitted until 2026-07-03 14:38:53.063764381 +0000 UTC m=+1643.177585935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls") pod "maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" (UID: "66385bbe-c979-4498-87f4-4164900d2b5d") : secret "maas-api-e2e-ait-69718436-serving-cert" not found Jul 03 14:38:52.564258 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.564237 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66385bbe-c979-4498-87f4-4164900d2b5d-openshift-service-ca\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.574374 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.574344 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf7gr\" (UniqueName: \"kubernetes.io/projected/66385bbe-c979-4498-87f4-4164900d2b5d-kube-api-access-jf7gr\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:52.925496 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:52.925385 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:53.025462 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:53.025424 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:53.068886 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:53.068845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:53.071364 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:53.071333 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls\") pod \"maas-api-e2e-ait-69718436-7cf8467fc4-hmng2\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:53.217040 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:53.216948 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:53.381569 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:53.381541 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2"] Jul 03 14:38:53.383619 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:38:53.383590 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66385bbe_c979_4498_87f4_4164900d2b5d.slice/crio-adda1cfc58adb8887857ea94232166373e45250c05612680121e6b95eb8ef26d WatchSource:0}: Error finding container adda1cfc58adb8887857ea94232166373e45250c05612680121e6b95eb8ef26d: Status 404 returned error can't find the container with id adda1cfc58adb8887857ea94232166373e45250c05612680121e6b95eb8ef26d Jul 03 14:38:53.385054 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:53.385030 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 14:38:53.948332 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:53.948290 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" event={"ID":"66385bbe-c979-4498-87f4-4164900d2b5d","Type":"ContainerStarted","Data":"adda1cfc58adb8887857ea94232166373e45250c05612680121e6b95eb8ef26d"} Jul 03 14:38:54.239954 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:54.239920 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:54.955654 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:54.955620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" event={"ID":"66385bbe-c979-4498-87f4-4164900d2b5d","Type":"ContainerStarted","Data":"9567d82dc4891ba96637cb6269c7b3a49ec14b5ffa16cf5e41bf0e73e79cef0b"} Jul 03 14:38:54.956077 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:54.955693 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:54.975492 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:54.975439 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" podStartSLOduration=2.478897268 podStartE2EDuration="2.975423585s" totalImagesPullingTime="496.526317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:38:54.9747363 +0000 UTC m=+1645.088557902" watchObservedRunningTime="2026-07-03 14:38:54.975423585 +0000 UTC m=+1645.089245179" Jul 03 14:38:57.403643 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:57.403605 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:57.552253 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:57.552209 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:57.652282 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:57.652246 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:57.762733 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:57.762627 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2"] Jul 03 14:38:57.762933 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:57.762870 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" podUID="66385bbe-c979-4498-87f4-4164900d2b5d" containerName="maas-api" containerID="cri-o://9567d82dc4891ba96637cb6269c7b3a49ec14b5ffa16cf5e41bf0e73e79cef0b" gracePeriod=30 Jul 03 14:38:57.793673 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:57.793640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:38:57.975608 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:57.975566 2574 generic.go:356] "Generic (PLEG): container finished" podID="66385bbe-c979-4498-87f4-4164900d2b5d" containerID="9567d82dc4891ba96637cb6269c7b3a49ec14b5ffa16cf5e41bf0e73e79cef0b" exitCode=0 Jul 03 14:38:57.975774 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:57.975634 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" event={"ID":"66385bbe-c979-4498-87f4-4164900d2b5d","Type":"ContainerDied","Data":"9567d82dc4891ba96637cb6269c7b3a49ec14b5ffa16cf5e41bf0e73e79cef0b"} Jul 03 14:38:58.023817 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.023727 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:58.117014 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.116972 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66385bbe-c979-4498-87f4-4164900d2b5d-openshift-service-ca\") pod \"66385bbe-c979-4498-87f4-4164900d2b5d\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " Jul 03 14:38:58.117201 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.117033 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls\") pod \"66385bbe-c979-4498-87f4-4164900d2b5d\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " Jul 03 14:38:58.117201 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.117063 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf7gr\" (UniqueName: \"kubernetes.io/projected/66385bbe-c979-4498-87f4-4164900d2b5d-kube-api-access-jf7gr\") pod \"66385bbe-c979-4498-87f4-4164900d2b5d\" (UID: \"66385bbe-c979-4498-87f4-4164900d2b5d\") " Jul 03 14:38:58.117400 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.117375 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66385bbe-c979-4498-87f4-4164900d2b5d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "66385bbe-c979-4498-87f4-4164900d2b5d" (UID: "66385bbe-c979-4498-87f4-4164900d2b5d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:38:58.119321 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.119289 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "66385bbe-c979-4498-87f4-4164900d2b5d" (UID: "66385bbe-c979-4498-87f4-4164900d2b5d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:38:58.119439 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.119337 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66385bbe-c979-4498-87f4-4164900d2b5d-kube-api-access-jf7gr" (OuterVolumeSpecName: "kube-api-access-jf7gr") pod "66385bbe-c979-4498-87f4-4164900d2b5d" (UID: "66385bbe-c979-4498-87f4-4164900d2b5d"). InnerVolumeSpecName "kube-api-access-jf7gr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:38:58.218596 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.218551 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66385bbe-c979-4498-87f4-4164900d2b5d-openshift-service-ca\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:38:58.218596 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.218589 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66385bbe-c979-4498-87f4-4164900d2b5d-maas-api-tls\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:38:58.218596 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.218600 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf7gr\" (UniqueName: \"kubernetes.io/projected/66385bbe-c979-4498-87f4-4164900d2b5d-kube-api-access-jf7gr\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:38:58.982615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.982585 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" Jul 03 14:38:58.982615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.982608 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2" event={"ID":"66385bbe-c979-4498-87f4-4164900d2b5d","Type":"ContainerDied","Data":"adda1cfc58adb8887857ea94232166373e45250c05612680121e6b95eb8ef26d"} Jul 03 14:38:58.983130 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:58.982669 2574 scope.go:117] "RemoveContainer" containerID="9567d82dc4891ba96637cb6269c7b3a49ec14b5ffa16cf5e41bf0e73e79cef0b" Jul 03 14:38:59.006770 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:59.006728 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2"] Jul 03 14:38:59.012975 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:38:59.012941 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-69718436-7cf8467fc4-hmng2"] Jul 03 14:39:00.317962 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:00.317923 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:00.361545 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:00.361502 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66385bbe-c979-4498-87f4-4164900d2b5d" path="/var/lib/kubelet/pods/66385bbe-c979-4498-87f4-4164900d2b5d/volumes" Jul 03 14:39:03.891097 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:03.891061 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:03.995559 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:03.995520 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:04.116557 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:04.116523 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:04.188118 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:04.188023 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:05.391380 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:05.391320 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:05.486583 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:05.486546 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:05.565133 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:05.565078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:05.666396 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:05.666297 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:05.976958 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:05.976864 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:06.077319 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:06.077285 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:07.445875 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:07.445836 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:10.521601 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:10.521564 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:10.891408 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:10.891361 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:16.808872 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:16.808837 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:16.909309 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:16.909215 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:18.840706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:18.840666 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:22.968173 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:22.968118 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:23.068702 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:23.068658 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:23.229280 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:23.229187 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:23.325538 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:23.325491 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:24.468122 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:24.468079 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:24.567014 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:24.566972 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:24.752775 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:24.752671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:25.315692 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:25.315648 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:25.401452 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:25.401415 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:25.499065 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:25.499025 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:26.396664 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:26.396621 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:28.835571 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:28.835529 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:29.025588 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:29.025547 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:29.121935 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:29.121827 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:29.292878 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:29.292840 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:30.609850 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:30.609776 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:35.371095 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:35.371055 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:35.470656 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:35.470620 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:35.897352 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:35.897318 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:35.997373 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:35.997332 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:36.096860 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:36.096822 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:37.441680 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:37.441644 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:43.627416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:43.627377 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:43.733101 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:43.733059 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:43.830519 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:43.830489 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:43.928110 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:43.928014 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:39:44.363415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:39:44.363372 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:10.358960 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:10.358922 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:16.327666 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:16.327629 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:16.431657 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:16.431624 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:16.528188 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:16.528148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:32.450991 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:32.450958 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:38.546413 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:38.546372 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:38.657985 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:38.657946 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:38.761774 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:38.761741 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:49.262426 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:49.262392 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:50.065376 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:50.065338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:56.231444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:56.231405 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:56.295187 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:56.295152 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:56.377636 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:56.377597 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:56.477453 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:56.477416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:56.544648 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:56.544618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:57.333928 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:57.333887 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:57.421282 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:57.421236 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:40:59.105223 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:40:59.105188 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:05.317081 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:05.317040 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:05.396116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:05.396070 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:05.999778 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:05.999739 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:12.359451 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:12.359417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:12.438473 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:12.438432 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:12.596415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:12.596378 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:13.075195 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:13.075156 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:13.458565 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:13.458461 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:16.120508 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:16.120441 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:16.220101 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:16.220065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:16.340215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:16.340164 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:16.476196 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:16.476104 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:16.840311 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:16.840272 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:16.940465 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:16.940430 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:20.610709 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:20.610676 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:21.260612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:21.260577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:21.360847 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:21.360816 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:21.677389 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:21.677332 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:27.825270 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:27.825228 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:27.924520 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:27.924488 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:28.254293 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:28.254197 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:28.600659 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:28.600606 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:28.703973 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:28.703938 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:34.877014 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:34.876971 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:34.974528 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:34.974478 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:35.131154 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:35.131072 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:35.347780 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:35.347747 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:35.470875 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:35.470772 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:35.580152 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:35.580118 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:35.854931 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:35.854892 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:41.721400 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:41.721359 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:41.842491 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:41.842455 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:41.959024 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:41.958983 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:42.084702 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:42.084664 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:48.830868 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:48.830836 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:48.937943 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:48.937902 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:55.267264 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:55.267215 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:55.738827 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:55.738082 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:55.968148 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:55.968107 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:58.572520 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:58.572480 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:58.748492 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:58.748458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:58.973505 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:58.973412 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:59.198237 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:59.198206 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:59.787787 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:59.787750 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:41:59.883751 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:41:59.883708 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:02.990583 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:02.990543 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:05.920571 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:05.920531 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:07.970230 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:07.970190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:31.721743 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:31.721710 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:31.825997 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:31.825961 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:40.736691 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:40.736648 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:41.372448 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:41.372410 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:41.464529 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:41.464490 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:41.680638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:41.680534 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:46.762335 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:46.762288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:51.839699 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:51.839640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:42:58.388266 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:42:58.388214 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:28.860454 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:28.860393 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:29.534942 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:29.534902 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:35.430130 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:35.430090 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:35.531577 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:35.531543 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:35.718354 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:35.718271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:35.975781 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:35.975688 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:37.055325 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:37.055289 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:37.155600 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:37.155561 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:37.255098 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:37.255063 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:38.041320 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:38.041280 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:38.141754 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:38.141711 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:38.240351 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:38.240318 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:39.730903 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:39.730870 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:45.715947 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:45.715905 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:47.204447 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:47.204413 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:52.594496 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:52.594453 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:52.695368 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:52.695329 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:43:52.798289 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:43:52.798255 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:03.347789 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:03.347757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:03.707509 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:03.707419 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:24.720892 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:24.720832 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:30.713878 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:30.713837 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:30.813616 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:30.813580 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:31.115690 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:31.115653 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:31.451499 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:31.451406 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:31.618335 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:31.618299 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:34.176837 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:34.176780 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:34.259064 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:34.259015 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:34.327153 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:34.327112 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:34.427880 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:34.427767 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:34.863609 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:34.863574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:34.963337 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:34.963302 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:38.704638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:38.704593 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:39.080745 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:39.080699 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:39.408536 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:39.408435 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:39.520230 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:39.520190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:42.274981 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:42.274942 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:42.360106 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:42.360074 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:42.433484 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:42.433444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:42.779470 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:42.779429 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:42.902453 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:42.902420 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:42.998430 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:42.998394 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:46.762103 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:46.762071 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:55.097338 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.097300 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv"] Jul 03 14:44:55.097856 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.097773 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66385bbe-c979-4498-87f4-4164900d2b5d" containerName="maas-api" Jul 03 14:44:55.097856 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.097788 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="66385bbe-c979-4498-87f4-4164900d2b5d" containerName="maas-api" Jul 03 14:44:55.097982 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.097873 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="66385bbe-c979-4498-87f4-4164900d2b5d" containerName="maas-api" Jul 03 14:44:55.101238 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.101221 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.103595 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.103572 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c1cb72\"/\"openshift-service-ca.crt\"" Jul 03 14:44:55.103713 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.103577 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c1cb72\"/\"default-dockercfg-6ks4v\"" Jul 03 14:44:55.104525 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.104496 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c1cb72\"/\"kube-root-ca.crt\"" Jul 03 14:44:55.104525 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.104519 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c1cb72\"/\"test-model-c1cb72-kserve-self-signed-certs\"" Jul 03 14:44:55.110651 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.110629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv"] Jul 03 14:44:55.124664 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.124622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:55.281220 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.281179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-dshm\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.281415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.281249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b58028a-33ed-4728-b4b4-fadd3074e960-tls-certs\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.281415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.281309 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-home\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.281415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.281329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zmrs\" (UniqueName: \"kubernetes.io/projected/3b58028a-33ed-4728-b4b4-fadd3074e960-kube-api-access-4zmrs\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.281415 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.281366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-tmp-dir\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.281567 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.281427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-model-cache\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382283 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382196 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-model-cache\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382283 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-dshm\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b58028a-33ed-4728-b4b4-fadd3074e960-tls-certs\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-home\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zmrs\" (UniqueName: \"kubernetes.io/projected/3b58028a-33ed-4728-b4b4-fadd3074e960-kube-api-access-4zmrs\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382543 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-tmp-dir\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382762 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382683 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-model-cache\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382888 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-tmp-dir\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.382993 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.382976 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-home\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.384566 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.384542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-dshm\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.384929 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.384913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b58028a-33ed-4728-b4b4-fadd3074e960-tls-certs\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.391536 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.391512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zmrs\" (UniqueName: \"kubernetes.io/projected/3b58028a-33ed-4728-b4b4-fadd3074e960-kube-api-access-4zmrs\") pod \"test-model-c1cb72-kserve-56fd5b64b9-bnzvv\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.411598 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.411558 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:44:55.553972 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.553939 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv"] Jul 03 14:44:55.555287 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:44:55.555253 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b58028a_33ed_4728_b4b4_fadd3074e960.slice/crio-6321b3dbceaca76b36b2906ca1813be8e76d2f206d471fa82f5698623091d2f9 WatchSource:0}: Error finding container 6321b3dbceaca76b36b2906ca1813be8e76d2f206d471fa82f5698623091d2f9: Status 404 returned error can't find the container with id 6321b3dbceaca76b36b2906ca1813be8e76d2f206d471fa82f5698623091d2f9 Jul 03 14:44:55.943085 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.943052 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" event={"ID":"3b58028a-33ed-4728-b4b4-fadd3074e960","Type":"ContainerStarted","Data":"25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205"} Jul 03 14:44:55.943302 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.943097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" event={"ID":"3b58028a-33ed-4728-b4b4-fadd3074e960","Type":"ContainerStarted","Data":"6321b3dbceaca76b36b2906ca1813be8e76d2f206d471fa82f5698623091d2f9"} Jul 03 14:44:55.962194 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:55.962126 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" podStartSLOduration=0.962103153 podStartE2EDuration="962.103153ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:44:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:44:55.961725175 +0000 UTC m=+2006.075546779" watchObservedRunningTime="2026-07-03 14:44:55.962103153 +0000 UTC m=+2006.075924729" Jul 03 14:44:56.531076 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:56.531041 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:44:56.633055 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:44:56.633015 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:00.137237 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.137192 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29718165-lmc8h"] Jul 03 14:45:00.141119 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.141094 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc"] Jul 03 14:45:00.141257 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.141221 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" Jul 03 14:45:00.144889 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.144853 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk"] Jul 03 14:45:00.145051 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.144970 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" Jul 03 14:45:00.148914 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.148887 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718165-lmc8h"] Jul 03 14:45:00.149059 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.149010 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" Jul 03 14:45:00.150787 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.150759 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc"] Jul 03 14:45:00.166890 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.166862 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk"] Jul 03 14:45:00.232718 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.232681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvql\" (UniqueName: \"kubernetes.io/projected/6932d2d2-12f1-4dc2-b43b-553a9b77dc2d-kube-api-access-fbvql\") pod \"maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk\" (UID: \"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" Jul 03 14:45:00.333362 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.333323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlzml\" (UniqueName: \"kubernetes.io/projected/2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5-kube-api-access-zlzml\") pod \"maas-api-key-cleanup-29718165-lmc8h\" (UID: \"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5\") " pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" Jul 03 14:45:00.333570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.333379 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjv4\" (UniqueName: \"kubernetes.io/projected/c088f378-fa87-45d2-b23e-7aee2763a322-kube-api-access-fsjv4\") pod \"maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc\" (UID: \"c088f378-fa87-45d2-b23e-7aee2763a322\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" Jul 03 14:45:00.333634 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.333573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvql\" (UniqueName: \"kubernetes.io/projected/6932d2d2-12f1-4dc2-b43b-553a9b77dc2d-kube-api-access-fbvql\") pod \"maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk\" (UID: \"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" Jul 03 14:45:00.344247 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.344206 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvql\" (UniqueName: \"kubernetes.io/projected/6932d2d2-12f1-4dc2-b43b-553a9b77dc2d-kube-api-access-fbvql\") pod \"maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk\" (UID: \"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" Jul 03 14:45:00.434272 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.434170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjv4\" (UniqueName: \"kubernetes.io/projected/c088f378-fa87-45d2-b23e-7aee2763a322-kube-api-access-fsjv4\") pod \"maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc\" (UID: \"c088f378-fa87-45d2-b23e-7aee2763a322\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" Jul 03 14:45:00.434458 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.434312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlzml\" (UniqueName: \"kubernetes.io/projected/2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5-kube-api-access-zlzml\") pod \"maas-api-key-cleanup-29718165-lmc8h\" (UID: \"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5\") " pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" Jul 03 14:45:00.445030 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.444999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjv4\" (UniqueName: \"kubernetes.io/projected/c088f378-fa87-45d2-b23e-7aee2763a322-kube-api-access-fsjv4\") pod \"maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc\" (UID: \"c088f378-fa87-45d2-b23e-7aee2763a322\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" Jul 03 14:45:00.445825 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.445782 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlzml\" (UniqueName: \"kubernetes.io/projected/2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5-kube-api-access-zlzml\") pod \"maas-api-key-cleanup-29718165-lmc8h\" (UID: \"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5\") " pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" Jul 03 14:45:00.456731 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.456706 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" Jul 03 14:45:00.467503 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.467481 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" Jul 03 14:45:00.476613 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.476584 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" Jul 03 14:45:00.634115 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.634077 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718165-lmc8h"] Jul 03 14:45:00.643367 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:45:00.643319 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d143d4e_f5ad_4f75_82a9_fabe0fecf7c5.slice/crio-3504bdec26d85ad3e8aa8b3ab9cc4c0a7ef769d4a6c7df2fdde3f90bd4dfd1fe WatchSource:0}: Error finding container 3504bdec26d85ad3e8aa8b3ab9cc4c0a7ef769d4a6c7df2fdde3f90bd4dfd1fe: Status 404 returned error can't find the container with id 3504bdec26d85ad3e8aa8b3ab9cc4c0a7ef769d4a6c7df2fdde3f90bd4dfd1fe Jul 03 14:45:00.646288 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.646264 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 14:45:00.696328 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.696302 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk"] Jul 03 14:45:00.699066 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:45:00.699035 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6932d2d2_12f1_4dc2_b43b_553a9b77dc2d.slice/crio-c658d9d99cca54cbb10289885bf0ded1a8c4c42afec613c2b121ad1806f8e2d1 WatchSource:0}: Error finding container c658d9d99cca54cbb10289885bf0ded1a8c4c42afec613c2b121ad1806f8e2d1: Status 404 returned error can't find the container with id c658d9d99cca54cbb10289885bf0ded1a8c4c42afec613c2b121ad1806f8e2d1 Jul 03 14:45:00.869577 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.869547 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc"] Jul 03 14:45:00.871986 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:45:00.871956 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc088f378_fa87_45d2_b23e_7aee2763a322.slice/crio-4abb3b51f84e520e7aef71fd4523dabb7c5bb6fd3470a3824e43f2bef0d51207 WatchSource:0}: Error finding container 4abb3b51f84e520e7aef71fd4523dabb7c5bb6fd3470a3824e43f2bef0d51207: Status 404 returned error can't find the container with id 4abb3b51f84e520e7aef71fd4523dabb7c5bb6fd3470a3824e43f2bef0d51207 Jul 03 14:45:00.973106 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.973007 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" event={"ID":"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d","Type":"ContainerStarted","Data":"c658d9d99cca54cbb10289885bf0ded1a8c4c42afec613c2b121ad1806f8e2d1"} Jul 03 14:45:00.974127 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.974102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" event={"ID":"c088f378-fa87-45d2-b23e-7aee2763a322","Type":"ContainerStarted","Data":"4abb3b51f84e520e7aef71fd4523dabb7c5bb6fd3470a3824e43f2bef0d51207"} Jul 03 14:45:00.975353 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:00.975328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" event={"ID":"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5","Type":"ContainerStarted","Data":"3504bdec26d85ad3e8aa8b3ab9cc4c0a7ef769d4a6c7df2fdde3f90bd4dfd1fe"} Jul 03 14:45:03.941085 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:03.941044 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:04.003337 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:04.003289 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" event={"ID":"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5","Type":"ContainerStarted","Data":"7bf4f140cb8b91e20ff15de8a2ee99b79b8cb14b1c5d86fc90fac47cfebe7cb7"} Jul 03 14:45:04.004780 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:04.004749 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" event={"ID":"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d","Type":"ContainerStarted","Data":"fdcdfe10bb6f741a7c3154f20d765b8c5e2f87cd52a746ca8f0b6a0381ce5492"} Jul 03 14:45:04.006332 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:04.006306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" event={"ID":"c088f378-fa87-45d2-b23e-7aee2763a322","Type":"ContainerStarted","Data":"12d245a7833afe446c8829b04e06b0e9ddf78c419e7a446c72b628b9d37210e4"} Jul 03 14:45:04.021375 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:04.021322 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" podStartSLOduration=1.447777945 podStartE2EDuration="4.021304952s" totalImagesPullingTime="2.573527007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:45:04.019089958 +0000 UTC m=+2014.132911531" watchObservedRunningTime="2026-07-03 14:45:04.021304952 +0000 UTC m=+2014.135126524" Jul 03 14:45:04.024867 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:04.024829 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:04.037975 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:04.037927 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" podStartSLOduration=1.68708092 podStartE2EDuration="4.037909118s" totalImagesPullingTime="2.350828198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:45:04.034363212 +0000 UTC m=+2014.148184806" watchObservedRunningTime="2026-07-03 14:45:04.037909118 +0000 UTC m=+2014.151730691" Jul 03 14:45:04.053416 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:04.053360 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" podStartSLOduration=1.585392429 podStartE2EDuration="4.053341603s" totalImagesPullingTime="2.467949174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:45:04.052086507 +0000 UTC m=+2014.165908072" watchObservedRunningTime="2026-07-03 14:45:04.053341603 +0000 UTC m=+2014.167163175" Jul 03 14:45:05.013974 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.013936 2574 generic.go:356] "Generic (PLEG): container finished" podID="6932d2d2-12f1-4dc2-b43b-553a9b77dc2d" containerID="fdcdfe10bb6f741a7c3154f20d765b8c5e2f87cd52a746ca8f0b6a0381ce5492" exitCode=0 Jul 03 14:45:05.014407 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.014021 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" event={"ID":"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d","Type":"ContainerDied","Data":"fdcdfe10bb6f741a7c3154f20d765b8c5e2f87cd52a746ca8f0b6a0381ce5492"} Jul 03 14:45:05.015447 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.015425 2574 generic.go:356] "Generic (PLEG): container finished" podID="c088f378-fa87-45d2-b23e-7aee2763a322" containerID="12d245a7833afe446c8829b04e06b0e9ddf78c419e7a446c72b628b9d37210e4" exitCode=0 Jul 03 14:45:05.015564 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.015512 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" event={"ID":"c088f378-fa87-45d2-b23e-7aee2763a322","Type":"ContainerDied","Data":"12d245a7833afe446c8829b04e06b0e9ddf78c419e7a446c72b628b9d37210e4"} Jul 03 14:45:05.017031 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.017014 2574 generic.go:356] "Generic (PLEG): container finished" podID="2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5" containerID="7bf4f140cb8b91e20ff15de8a2ee99b79b8cb14b1c5d86fc90fac47cfebe7cb7" exitCode=0 Jul 03 14:45:05.017087 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.017077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" event={"ID":"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5","Type":"ContainerDied","Data":"7bf4f140cb8b91e20ff15de8a2ee99b79b8cb14b1c5d86fc90fac47cfebe7cb7"} Jul 03 14:45:05.412357 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.412318 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:45:05.412675 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.412370 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:45:05.425678 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:05.425643 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:45:06.039022 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.038958 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:45:06.212078 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.212051 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" Jul 03 14:45:06.216331 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.216305 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" Jul 03 14:45:06.233239 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.233120 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" Jul 03 14:45:06.305562 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.305522 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlzml\" (UniqueName: \"kubernetes.io/projected/2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5-kube-api-access-zlzml\") pod \"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5\" (UID: \"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5\") " Jul 03 14:45:06.305562 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.305560 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsjv4\" (UniqueName: \"kubernetes.io/projected/c088f378-fa87-45d2-b23e-7aee2763a322-kube-api-access-fsjv4\") pod \"c088f378-fa87-45d2-b23e-7aee2763a322\" (UID: \"c088f378-fa87-45d2-b23e-7aee2763a322\") " Jul 03 14:45:06.305857 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.305592 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbvql\" (UniqueName: \"kubernetes.io/projected/6932d2d2-12f1-4dc2-b43b-553a9b77dc2d-kube-api-access-fbvql\") pod \"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d\" (UID: \"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d\") " Jul 03 14:45:06.307821 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.307783 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6932d2d2-12f1-4dc2-b43b-553a9b77dc2d-kube-api-access-fbvql" (OuterVolumeSpecName: "kube-api-access-fbvql") pod "6932d2d2-12f1-4dc2-b43b-553a9b77dc2d" (UID: "6932d2d2-12f1-4dc2-b43b-553a9b77dc2d"). InnerVolumeSpecName "kube-api-access-fbvql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:45:06.308197 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.308173 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5-kube-api-access-zlzml" (OuterVolumeSpecName: "kube-api-access-zlzml") pod "2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5" (UID: "2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5"). InnerVolumeSpecName "kube-api-access-zlzml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:45:06.308268 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.308203 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c088f378-fa87-45d2-b23e-7aee2763a322-kube-api-access-fsjv4" (OuterVolumeSpecName: "kube-api-access-fsjv4") pod "c088f378-fa87-45d2-b23e-7aee2763a322" (UID: "c088f378-fa87-45d2-b23e-7aee2763a322"). InnerVolumeSpecName "kube-api-access-fsjv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:45:06.406951 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.406910 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlzml\" (UniqueName: \"kubernetes.io/projected/2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5-kube-api-access-zlzml\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:45:06.407151 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.407041 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsjv4\" (UniqueName: \"kubernetes.io/projected/c088f378-fa87-45d2-b23e-7aee2763a322-kube-api-access-fsjv4\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:45:06.407151 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:06.407074 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbvql\" (UniqueName: \"kubernetes.io/projected/6932d2d2-12f1-4dc2-b43b-553a9b77dc2d-kube-api-access-fbvql\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:45:07.029935 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.029899 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" Jul 03 14:45:07.029935 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.029912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk" event={"ID":"6932d2d2-12f1-4dc2-b43b-553a9b77dc2d","Type":"ContainerDied","Data":"c658d9d99cca54cbb10289885bf0ded1a8c4c42afec613c2b121ad1806f8e2d1"} Jul 03 14:45:07.030168 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.029999 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c658d9d99cca54cbb10289885bf0ded1a8c4c42afec613c2b121ad1806f8e2d1" Jul 03 14:45:07.031324 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.031303 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" Jul 03 14:45:07.031433 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.031356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc" event={"ID":"c088f378-fa87-45d2-b23e-7aee2763a322","Type":"ContainerDied","Data":"4abb3b51f84e520e7aef71fd4523dabb7c5bb6fd3470a3824e43f2bef0d51207"} Jul 03 14:45:07.031433 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.031398 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4abb3b51f84e520e7aef71fd4523dabb7c5bb6fd3470a3824e43f2bef0d51207" Jul 03 14:45:07.032747 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.032730 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" Jul 03 14:45:07.032877 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.032787 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718165-lmc8h" event={"ID":"2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5","Type":"ContainerDied","Data":"3504bdec26d85ad3e8aa8b3ab9cc4c0a7ef769d4a6c7df2fdde3f90bd4dfd1fe"} Jul 03 14:45:07.032877 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:07.032863 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3504bdec26d85ad3e8aa8b3ab9cc4c0a7ef769d4a6c7df2fdde3f90bd4dfd1fe" Jul 03 14:45:16.638627 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:16.638591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:19.184669 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:19.184625 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:19.285033 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:19.284993 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:49.448879 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:49.448843 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv"] Jul 03 14:45:49.476607 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:49.476574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:50.574411 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:50.574375 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:50.889827 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:50.889712 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:51.275782 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:51.275689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:51.425478 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:51.425441 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:51.526451 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:51.526354 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:51.693682 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:51.693645 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:51.704824 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:51.704772 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk"] Jul 03 14:45:51.707440 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:51.707410 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-c1cb72-29718165-rbsqk"] Jul 03 14:45:52.361000 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:52.360915 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6932d2d2-12f1-4dc2-b43b-553a9b77dc2d" path="/var/lib/kubelet/pods/6932d2d2-12f1-4dc2-b43b-553a9b77dc2d/volumes" Jul 03 14:45:52.979540 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:52.979502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:45:56.353720 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:45:56.353683 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:04.469743 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.469697 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" podUID="3b58028a-33ed-4728-b4b4-fadd3074e960" containerName="main" containerID="cri-o://25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205" gracePeriod=45 Jul 03 14:46:04.732402 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.732328 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:46:04.880517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880477 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-model-cache\") pod \"3b58028a-33ed-4728-b4b4-fadd3074e960\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " Jul 03 14:46:04.880736 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880562 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-home\") pod \"3b58028a-33ed-4728-b4b4-fadd3074e960\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " Jul 03 14:46:04.880736 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880585 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-tmp-dir\") pod \"3b58028a-33ed-4728-b4b4-fadd3074e960\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " Jul 03 14:46:04.880736 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880604 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-dshm\") pod \"3b58028a-33ed-4728-b4b4-fadd3074e960\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " Jul 03 14:46:04.880736 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880629 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b58028a-33ed-4728-b4b4-fadd3074e960-tls-certs\") pod \"3b58028a-33ed-4728-b4b4-fadd3074e960\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " Jul 03 14:46:04.880736 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880663 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zmrs\" (UniqueName: \"kubernetes.io/projected/3b58028a-33ed-4728-b4b4-fadd3074e960-kube-api-access-4zmrs\") pod \"3b58028a-33ed-4728-b4b4-fadd3074e960\" (UID: \"3b58028a-33ed-4728-b4b4-fadd3074e960\") " Jul 03 14:46:04.881038 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880882 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b58028a-33ed-4728-b4b4-fadd3074e960" (UID: "3b58028a-33ed-4728-b4b4-fadd3074e960"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:46:04.881038 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880896 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-home" (OuterVolumeSpecName: "home") pod "3b58028a-33ed-4728-b4b4-fadd3074e960" (UID: "3b58028a-33ed-4728-b4b4-fadd3074e960"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:46:04.881038 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.880910 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b58028a-33ed-4728-b4b4-fadd3074e960" (UID: "3b58028a-33ed-4728-b4b4-fadd3074e960"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:46:04.882953 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.882929 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b58028a-33ed-4728-b4b4-fadd3074e960-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b58028a-33ed-4728-b4b4-fadd3074e960" (UID: "3b58028a-33ed-4728-b4b4-fadd3074e960"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:46:04.883079 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.882983 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-dshm" (OuterVolumeSpecName: "dshm") pod "3b58028a-33ed-4728-b4b4-fadd3074e960" (UID: "3b58028a-33ed-4728-b4b4-fadd3074e960"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 14:46:04.883079 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.882991 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b58028a-33ed-4728-b4b4-fadd3074e960-kube-api-access-4zmrs" (OuterVolumeSpecName: "kube-api-access-4zmrs") pod "3b58028a-33ed-4728-b4b4-fadd3074e960" (UID: "3b58028a-33ed-4728-b4b4-fadd3074e960"). InnerVolumeSpecName "kube-api-access-4zmrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:46:04.981728 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.981683 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-model-cache\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:46:04.981728 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.981718 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-home\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:46:04.981728 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.981729 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-tmp-dir\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:46:04.981994 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.981742 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b58028a-33ed-4728-b4b4-fadd3074e960-dshm\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:46:04.981994 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.981753 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b58028a-33ed-4728-b4b4-fadd3074e960-tls-certs\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:46:04.981994 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:04.981764 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zmrs\" (UniqueName: \"kubernetes.io/projected/3b58028a-33ed-4728-b4b4-fadd3074e960-kube-api-access-4zmrs\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:46:05.359558 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.359519 2574 generic.go:356] "Generic (PLEG): container finished" podID="3b58028a-33ed-4728-b4b4-fadd3074e960" containerID="25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205" exitCode=0 Jul 03 14:46:05.359756 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.359582 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" Jul 03 14:46:05.359756 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.359586 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" event={"ID":"3b58028a-33ed-4728-b4b4-fadd3074e960","Type":"ContainerDied","Data":"25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205"} Jul 03 14:46:05.359756 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.359708 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv" event={"ID":"3b58028a-33ed-4728-b4b4-fadd3074e960","Type":"ContainerDied","Data":"6321b3dbceaca76b36b2906ca1813be8e76d2f206d471fa82f5698623091d2f9"} Jul 03 14:46:05.359756 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.359728 2574 scope.go:117] "RemoveContainer" containerID="25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205" Jul 03 14:46:05.370108 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.370085 2574 scope.go:117] "RemoveContainer" containerID="25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205" Jul 03 14:46:05.370405 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:46:05.370384 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205\": container with ID starting with 25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205 not found: ID does not exist" containerID="25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205" Jul 03 14:46:05.370461 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.370417 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205"} err="failed to get container status \"25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205\": rpc error: code = NotFound desc = could not find container \"25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205\": container with ID starting with 25cf4a13177ca7af1377c29eaacf14a6b9438687a7fb958820bafef2bfd9f205 not found: ID does not exist" Jul 03 14:46:05.389367 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.388788 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv"] Jul 03 14:46:05.390970 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:05.390943 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c1cb72/test-model-c1cb72-kserve-56fd5b64b9-bnzvv"] Jul 03 14:46:06.360199 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:06.360161 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b58028a-33ed-4728-b4b4-fadd3074e960" path="/var/lib/kubelet/pods/3b58028a-33ed-4728-b4b4-fadd3074e960/volumes" Jul 03 14:46:28.736560 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:28.736525 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:33.623670 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:33.623626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:33.965995 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:33.965903 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:34.206022 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:34.205987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:34.366598 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:34.366559 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:34.835086 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:34.835051 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:34.942471 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:34.942427 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:35.168620 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:35.168520 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc"] Jul 03 14:46:35.173531 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:35.173497 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:35.173860 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:35.173837 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e58844-29718165-6sxnc"] Jul 03 14:46:36.360245 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:36.360198 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c088f378-fa87-45d2-b23e-7aee2763a322" path="/var/lib/kubelet/pods/c088f378-fa87-45d2-b23e-7aee2763a322/volumes" Jul 03 14:46:41.022475 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:41.022439 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:41.136431 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:41.136387 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:41.320135 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:41.320102 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:41.527898 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:41.527856 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:41.867374 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:41.867338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:42.184060 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:42.183957 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:42.358646 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:42.358600 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:44.995958 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:44.995919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:45.144624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:45.144591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:45.307394 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:45.307355 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:45.672706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:45.672608 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:45.774245 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:45.774202 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:49.368047 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:49.368009 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:49.845464 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:49.845430 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:50.176298 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:50.176185 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:50.311609 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:50.311559 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:53.849347 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:53.849309 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:53.949469 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:53.949403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:54.084884 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.084847 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r"] Jul 03 14:46:54.085508 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085488 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b58028a-33ed-4728-b4b4-fadd3074e960" containerName="main" Jul 03 14:46:54.085508 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085507 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b58028a-33ed-4728-b4b4-fadd3074e960" containerName="main" Jul 03 14:46:54.085659 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085518 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c088f378-fa87-45d2-b23e-7aee2763a322" containerName="cleanup" Jul 03 14:46:54.085659 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085527 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c088f378-fa87-45d2-b23e-7aee2763a322" containerName="cleanup" Jul 03 14:46:54.085659 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085543 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6932d2d2-12f1-4dc2-b43b-553a9b77dc2d" containerName="cleanup" Jul 03 14:46:54.085659 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085552 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6932d2d2-12f1-4dc2-b43b-553a9b77dc2d" containerName="cleanup" Jul 03 14:46:54.085659 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085567 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5" containerName="cleanup" Jul 03 14:46:54.085659 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085575 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5" containerName="cleanup" Jul 03 14:46:54.085870 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085676 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6932d2d2-12f1-4dc2-b43b-553a9b77dc2d" containerName="cleanup" Jul 03 14:46:54.085870 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085689 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c088f378-fa87-45d2-b23e-7aee2763a322" containerName="cleanup" Jul 03 14:46:54.085870 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085702 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b58028a-33ed-4728-b4b4-fadd3074e960" containerName="main" Jul 03 14:46:54.085870 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.085713 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5" containerName="cleanup" Jul 03 14:46:54.089304 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.089281 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.092002 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.091980 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-e921af-serving-cert\"" Jul 03 14:46:54.100604 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.100533 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r"] Jul 03 14:46:54.128139 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.128111 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:54.252017 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.251972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd4b33d-319a-4872-ad7c-d64b91c76d59-openshift-service-ca\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.252215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.252070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.252215 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.252087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btbbs\" (UniqueName: \"kubernetes.io/projected/8fd4b33d-319a-4872-ad7c-d64b91c76d59-kube-api-access-btbbs\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.353713 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.353611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd4b33d-319a-4872-ad7c-d64b91c76d59-openshift-service-ca\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.353713 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.353673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.353713 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.353695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btbbs\" (UniqueName: \"kubernetes.io/projected/8fd4b33d-319a-4872-ad7c-d64b91c76d59-kube-api-access-btbbs\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.354042 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:46:54.353900 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-e921af-serving-cert: secret "maas-api-e2e-api-b-e921af-serving-cert" not found Jul 03 14:46:54.354042 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:46:54.353962 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls podName:8fd4b33d-319a-4872-ad7c-d64b91c76d59 nodeName:}" failed. No retries permitted until 2026-07-03 14:46:54.853942726 +0000 UTC m=+2124.967764276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls") pod "maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" (UID: "8fd4b33d-319a-4872-ad7c-d64b91c76d59") : secret "maas-api-e2e-api-b-e921af-serving-cert" not found Jul 03 14:46:54.354479 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.354445 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd4b33d-319a-4872-ad7c-d64b91c76d59-openshift-service-ca\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.365187 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.365156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btbbs\" (UniqueName: \"kubernetes.io/projected/8fd4b33d-319a-4872-ad7c-d64b91c76d59-kube-api-access-btbbs\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.540069 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.540038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:54.652552 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.652461 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:54.754018 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.753963 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:46:54.857949 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.857909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:54.860782 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:54.860757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls\") pod \"maas-api-e2e-api-b-e921af-67b46bc459-fnp7r\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:55.004075 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:55.003974 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:55.153823 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:55.153774 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r"] Jul 03 14:46:55.155376 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:46:55.155342 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd4b33d_319a_4872_ad7c_d64b91c76d59.slice/crio-4c729f358d32cf25a8848c2b633981d409a53ec5ba0e4ce2d0d8ee28bd8553d9 WatchSource:0}: Error finding container 4c729f358d32cf25a8848c2b633981d409a53ec5ba0e4ce2d0d8ee28bd8553d9: Status 404 returned error can't find the container with id 4c729f358d32cf25a8848c2b633981d409a53ec5ba0e4ce2d0d8ee28bd8553d9 Jul 03 14:46:55.644262 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:55.644229 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" event={"ID":"8fd4b33d-319a-4872-ad7c-d64b91c76d59","Type":"ContainerStarted","Data":"0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff"} Jul 03 14:46:55.644434 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:55.644288 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" event={"ID":"8fd4b33d-319a-4872-ad7c-d64b91c76d59","Type":"ContainerStarted","Data":"4c729f358d32cf25a8848c2b633981d409a53ec5ba0e4ce2d0d8ee28bd8553d9"} Jul 03 14:46:55.644622 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:55.644594 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:46:55.662984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:55.662934 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" podStartSLOduration=1.31449111 podStartE2EDuration="1.662919548s" totalImagesPullingTime="348.428438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 14:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:46:55.661457171 +0000 UTC m=+2125.775278743" watchObservedRunningTime="2026-07-03 14:46:55.662919548 +0000 UTC m=+2125.776741165" Jul 03 14:46:58.386141 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:46:58.386108 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:01.656117 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:01.656087 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:47:06.697444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:06.697400 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:07.089959 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:07.089922 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:07.189304 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:07.189268 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:07.291533 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:07.291497 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:07.495706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:07.495596 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:13.329570 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:13.329534 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:13.431309 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:13.431212 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:13.635652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:13.635558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:13.866932 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:13.866890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:14.224869 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:14.224833 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:14.613773 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:14.613735 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:14.787024 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:14.786988 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:14.892540 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:14.892437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:15.045361 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.045324 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r"] Jul 03 14:47:15.045624 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.045592 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" podUID="8fd4b33d-319a-4872-ad7c-d64b91c76d59" containerName="maas-api" containerID="cri-o://0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff" gracePeriod=30 Jul 03 14:47:15.070291 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.070256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:15.303456 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.303428 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:47:15.352893 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.352856 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls\") pod \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " Jul 03 14:47:15.353060 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.352965 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btbbs\" (UniqueName: \"kubernetes.io/projected/8fd4b33d-319a-4872-ad7c-d64b91c76d59-kube-api-access-btbbs\") pod \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " Jul 03 14:47:15.353060 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.353012 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd4b33d-319a-4872-ad7c-d64b91c76d59-openshift-service-ca\") pod \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\" (UID: \"8fd4b33d-319a-4872-ad7c-d64b91c76d59\") " Jul 03 14:47:15.353446 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.353412 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fd4b33d-319a-4872-ad7c-d64b91c76d59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8fd4b33d-319a-4872-ad7c-d64b91c76d59" (UID: "8fd4b33d-319a-4872-ad7c-d64b91c76d59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 14:47:15.354883 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.354855 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8fd4b33d-319a-4872-ad7c-d64b91c76d59" (UID: "8fd4b33d-319a-4872-ad7c-d64b91c76d59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 14:47:15.355091 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.355075 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fd4b33d-319a-4872-ad7c-d64b91c76d59-kube-api-access-btbbs" (OuterVolumeSpecName: "kube-api-access-btbbs") pod "8fd4b33d-319a-4872-ad7c-d64b91c76d59" (UID: "8fd4b33d-319a-4872-ad7c-d64b91c76d59"). InnerVolumeSpecName "kube-api-access-btbbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 14:47:15.454706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.454559 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fd4b33d-319a-4872-ad7c-d64b91c76d59-maas-api-tls\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:47:15.454706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.454593 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btbbs\" (UniqueName: \"kubernetes.io/projected/8fd4b33d-319a-4872-ad7c-d64b91c76d59-kube-api-access-btbbs\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:47:15.454706 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.454609 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd4b33d-319a-4872-ad7c-d64b91c76d59-openshift-service-ca\") on node \"ip-10-0-137-36.ec2.internal\" DevicePath \"\"" Jul 03 14:47:15.762464 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.762374 2574 generic.go:356] "Generic (PLEG): container finished" podID="8fd4b33d-319a-4872-ad7c-d64b91c76d59" containerID="0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff" exitCode=0 Jul 03 14:47:15.762464 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.762422 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" Jul 03 14:47:15.762464 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.762439 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" event={"ID":"8fd4b33d-319a-4872-ad7c-d64b91c76d59","Type":"ContainerDied","Data":"0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff"} Jul 03 14:47:15.762997 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.762484 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r" event={"ID":"8fd4b33d-319a-4872-ad7c-d64b91c76d59","Type":"ContainerDied","Data":"4c729f358d32cf25a8848c2b633981d409a53ec5ba0e4ce2d0d8ee28bd8553d9"} Jul 03 14:47:15.762997 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.762505 2574 scope.go:117] "RemoveContainer" containerID="0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff" Jul 03 14:47:15.772068 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.772048 2574 scope.go:117] "RemoveContainer" containerID="0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff" Jul 03 14:47:15.772350 ip-10-0-137-36 kubenswrapper[2574]: E0703 14:47:15.772330 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff\": container with ID starting with 0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff not found: ID does not exist" containerID="0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff" Jul 03 14:47:15.772391 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.772359 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff"} err="failed to get container status \"0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff\": rpc error: code = NotFound desc = could not find container \"0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff\": container with ID starting with 0c1e8957b885249894144afbb251b29e24aa01dfb90f6711f96cd4b4f613b5ff not found: ID does not exist" Jul 03 14:47:15.785708 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.785677 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r"] Jul 03 14:47:15.789816 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:15.789783 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e921af-67b46bc459-fnp7r"] Jul 03 14:47:16.360351 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:16.360313 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fd4b33d-319a-4872-ad7c-d64b91c76d59" path="/var/lib/kubelet/pods/8fd4b33d-319a-4872-ad7c-d64b91c76d59/volumes" Jul 03 14:47:20.780964 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:20.780924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:20.878432 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:20.878386 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:21.076901 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:21.076860 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:21.338791 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:21.338690 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:21.678683 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:21.678588 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:22.015274 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:22.015151 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:22.412599 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:22.412563 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:25.172638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:25.172561 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:25.263387 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:25.263350 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:25.342835 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:25.342772 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:25.762494 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:25.762454 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:25.862450 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:25.862412 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:29.664050 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:29.664011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:30.066791 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:30.066757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:30.399135 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:30.399042 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:30.651440 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:30.651346 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:32.649009 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:32.648921 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:32.750097 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:32.750060 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:33.248533 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:33.248499 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:33.338595 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:33.338548 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:33.422355 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:33.422320 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:33.537738 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:33.537655 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:33.944593 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:33.944558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:34.031609 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:34.031574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:37.719054 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:37.719006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:38.821311 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:38.821272 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:46.678176 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:46.678136 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:46.780563 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:46.780528 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:54.708779 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:54.708735 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:54.809370 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:54.809328 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:47:56.100541 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:47:56.100508 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:48:29.041686 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:48:29.041638 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:49:29.823650 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:49:29.823610 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:49:30.947954 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:49:30.947918 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:50:32.738688 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:50:32.738574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:50:33.635031 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:50:33.634992 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:50:46.639737 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:50:46.639675 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:51:24.912971 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:51:24.912935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:51:32.415782 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:51:32.415751 2574 scope.go:117] "RemoveContainer" containerID="fdcdfe10bb6f741a7c3154f20d765b8c5e2f87cd52a746ca8f0b6a0381ce5492" Jul 03 14:51:32.424517 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:51:32.424489 2574 scope.go:117] "RemoveContainer" containerID="12d245a7833afe446c8829b04e06b0e9ddf78c419e7a446c72b628b9d37210e4" Jul 03 14:51:59.721258 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:51:59.721177 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:00.651158 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:00.651120 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:06.515412 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:06.515371 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:26.908390 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:26.908350 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:33.702011 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:33.701971 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:33.861615 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:33.861576 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:47.448232 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:47.448186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:47.548425 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:47.548381 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:55.752638 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:55.752593 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:52:55.854164 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:52:55.854128 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:09.463555 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:09.463495 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:10.337159 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:10.337122 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:11.377744 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:11.377700 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:11.759563 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:11.759455 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:11.857537 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:11.857498 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:11.957770 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:11.957709 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:12.096345 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:12.096308 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:16.832579 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:16.832546 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:32.563816 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:32.563695 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:54.245940 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:54.245902 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:54.516452 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:54.516365 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:54.748768 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:54.748727 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:54.946652 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:54.946606 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:55.336622 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:55.336571 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:55.450377 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:55.450336 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:55.556434 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:55.556399 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:53:55.670620 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:53:55.670528 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:02.173446 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:02.173407 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:02.272194 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:02.272158 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:02.456666 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:02.456575 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:02.669365 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:02.669323 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:03.115984 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:03.115952 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7474965594-pbk4q_9f6adf77-3a62-4247-b127-fd8cba03bb8f/authorino/0.log" Jul 03 14:54:07.765721 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:07.765688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wj9sb_c31c7962-fad8-45bb-80a8-bec7420d0fea/manager/0.log" Jul 03 14:54:07.891930 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:07.891890 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-747f7bcddc-6nk72_1cff1e0b-cd60-4f13-bd77-efa8155dd9fc/maas-api/0.log" Jul 03 14:54:08.110002 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:08.109965 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718165-lmc8h_2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5/cleanup/0.log" Jul 03 14:54:08.238760 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:08.238727 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-755bf6967f-qjh2l_02a440c4-f811-4b47-93a7-707bc1db9539/manager/0.log" Jul 03 14:54:08.501496 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:08.501411 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5mlqh_c5c89fc2-cc4e-4101-997d-f427d187d4de/manager/0.log" Jul 03 14:54:08.873924 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:08.873896 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6554f4cb-ktn5l_86951c11-f206-484d-b67d-f76fd7482834/copy-manifests/0.log" Jul 03 14:54:08.882642 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:08.882613 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6554f4cb-ktn5l_86951c11-f206-484d-b67d-f76fd7482834/manager/0.log" Jul 03 14:54:08.992812 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:08.992770 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-44zct_579db2ae-349f-463c-9b0f-1db3c842451b/postgres/0.log" Jul 03 14:54:09.775133 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:09.775100 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2_a4bb0c38-feab-4f94-beb1-39c56551dd70/util/0.log" Jul 03 14:54:09.783015 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:09.782981 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2_a4bb0c38-feab-4f94-beb1-39c56551dd70/pull/0.log" Jul 03 14:54:09.790160 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:09.790140 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2_a4bb0c38-feab-4f94-beb1-39c56551dd70/extract/0.log" Jul 03 14:54:09.909321 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:09.909295 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj_31ec4b14-c858-41b1-915c-73ed5dc393b6/util/0.log" Jul 03 14:54:09.918150 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:09.918117 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj_31ec4b14-c858-41b1-915c-73ed5dc393b6/pull/0.log" Jul 03 14:54:09.926413 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:09.926386 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj_31ec4b14-c858-41b1-915c-73ed5dc393b6/extract/0.log" Jul 03 14:54:10.038381 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.038298 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8_ca556750-9d1a-4434-812b-7f3fa6868544/pull/0.log" Jul 03 14:54:10.049470 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.049441 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8_ca556750-9d1a-4434-812b-7f3fa6868544/extract/0.log" Jul 03 14:54:10.057341 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.057315 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8_ca556750-9d1a-4434-812b-7f3fa6868544/util/0.log" Jul 03 14:54:10.168703 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.168670 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8_4a65e02d-ec9f-4127-bab7-852cd2fe4009/extract/0.log" Jul 03 14:54:10.176227 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.176198 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8_4a65e02d-ec9f-4127-bab7-852cd2fe4009/util/0.log" Jul 03 14:54:10.184361 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.184339 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8_4a65e02d-ec9f-4127-bab7-852cd2fe4009/pull/0.log" Jul 03 14:54:10.316138 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.316094 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7474965594-pbk4q_9f6adf77-3a62-4247-b127-fd8cba03bb8f/authorino/0.log" Jul 03 14:54:10.445083 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.445048 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6wp5r_11f11ebf-dc5c-486d-8ff6-65714e01ab73/manager/0.log" Jul 03 14:54:10.557669 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.557636 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nr9vw_3412a6a0-53a0-4b64-80ae-d5b096096b33/manager/0.log" Jul 03 14:54:10.678654 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.678570 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-75n6s_577909d8-5c92-4994-bd02-8405cbb236b5/kuadrant-console-plugin/0.log" Jul 03 14:54:10.817696 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.817659 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m9dks_a03087dc-6075-40d3-b629-58b7f37f5b07/registry-server/0.log" Jul 03 14:54:10.952147 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:10.952058 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4slzq_05ada985-83ef-4bec-9b32-03dcf845bebb/manager/0.log" Jul 03 14:54:11.947886 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:11.947858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b86bc795-nghdw_adcf49e0-31e4-481b-89be-2732174ebbdf/kube-auth-proxy/0.log" Jul 03 14:54:12.075596 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:12.075560 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dld5d_72646bbd-5107-4bb4-ba89-fe17c7b9e150/istio-proxy/1.log" Jul 03 14:54:12.199782 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:12.199702 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nknwf_a8058947-1ba4-43df-95fc-6e8005039b3b/payload-pre-processing/0.log" Jul 03 14:54:12.323506 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:12.323471 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6kzfl_2f955d87-43d3-4e0c-85ca-a2130ade2986/payload-processing/0.log" Jul 03 14:54:12.793397 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:12.793367 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4wbb9_94f5956f-4f62-45ec-a539-54d127bce401/main/0.log" Jul 03 14:54:12.919450 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:12.919423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fhpl6_70b717d7-ca0f-4a90-925e-8177445d3da5/main/0.log" Jul 03 14:54:13.035722 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:13.035692 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nrgdz_9e465e5c-cfb1-4764-a407-b023b3f8b579/main/0.log" Jul 03 14:54:13.261621 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:13.261532 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-nz2xh_32438969-681e-40db-ada5-3afb3321ef66/main/0.log" Jul 03 14:54:17.630930 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:17.630892 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:17.704616 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:17.704579 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:20.578885 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:20.578857 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ln6k5_6b1febaf-1350-48a6-b149-00f607eaaf3b/global-pull-secret-syncer/0.log" Jul 03 14:54:20.641826 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:20.641775 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" Jul 03 14:54:20.786596 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:20.786562 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-36.ec2.internal_6e954a9731eeec410262c7374d29cc9b/haproxy/0.log" Jul 03 14:54:25.086118 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.086089 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2_a4bb0c38-feab-4f94-beb1-39c56551dd70/extract/0.log" Jul 03 14:54:25.129100 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.129066 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2_a4bb0c38-feab-4f94-beb1-39c56551dd70/util/0.log" Jul 03 14:54:25.158642 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.158608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597tdk2_a4bb0c38-feab-4f94-beb1-39c56551dd70/pull/0.log" Jul 03 14:54:25.197372 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.197343 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj_31ec4b14-c858-41b1-915c-73ed5dc393b6/extract/0.log" Jul 03 14:54:25.222181 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.222148 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj_31ec4b14-c858-41b1-915c-73ed5dc393b6/util/0.log" Jul 03 14:54:25.249719 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.249693 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6fjj_31ec4b14-c858-41b1-915c-73ed5dc393b6/pull/0.log" Jul 03 14:54:25.284287 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.284257 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8_ca556750-9d1a-4434-812b-7f3fa6868544/extract/0.log" Jul 03 14:54:25.316034 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.316003 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8_ca556750-9d1a-4434-812b-7f3fa6868544/util/0.log" Jul 03 14:54:25.344389 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.344295 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734z4q8_ca556750-9d1a-4434-812b-7f3fa6868544/pull/0.log" Jul 03 14:54:25.378220 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.378184 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8_4a65e02d-ec9f-4127-bab7-852cd2fe4009/extract/0.log" Jul 03 14:54:25.412909 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.412879 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8_4a65e02d-ec9f-4127-bab7-852cd2fe4009/util/0.log" Jul 03 14:54:25.443663 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.443616 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7xl8_4a65e02d-ec9f-4127-bab7-852cd2fe4009/pull/0.log" Jul 03 14:54:25.713244 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.713155 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7474965594-pbk4q_9f6adf77-3a62-4247-b127-fd8cba03bb8f/authorino/0.log" Jul 03 14:54:25.766361 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.766330 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6wp5r_11f11ebf-dc5c-486d-8ff6-65714e01ab73/manager/0.log" Jul 03 14:54:25.803383 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.803347 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nr9vw_3412a6a0-53a0-4b64-80ae-d5b096096b33/manager/0.log" Jul 03 14:54:25.845485 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.845456 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-75n6s_577909d8-5c92-4994-bd02-8405cbb236b5/kuadrant-console-plugin/0.log" Jul 03 14:54:25.902603 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:25.902571 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m9dks_a03087dc-6075-40d3-b629-58b7f37f5b07/registry-server/0.log" Jul 03 14:54:26.044018 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:26.043977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4slzq_05ada985-83ef-4bec-9b32-03dcf845bebb/manager/0.log" Jul 03 14:54:27.854602 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:27.854569 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2778f628-cbd1-4262-859e-a61e83ebf594/alertmanager/0.log" Jul 03 14:54:27.882572 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:27.882537 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2778f628-cbd1-4262-859e-a61e83ebf594/config-reloader/0.log" Jul 03 14:54:27.907369 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:27.907341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2778f628-cbd1-4262-859e-a61e83ebf594/kube-rbac-proxy-web/0.log" Jul 03 14:54:27.932962 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:27.932924 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2778f628-cbd1-4262-859e-a61e83ebf594/kube-rbac-proxy/0.log" Jul 03 14:54:27.958589 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:27.958555 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2778f628-cbd1-4262-859e-a61e83ebf594/kube-rbac-proxy-metric/0.log" Jul 03 14:54:27.983293 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:27.983270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2778f628-cbd1-4262-859e-a61e83ebf594/prom-label-proxy/0.log" Jul 03 14:54:28.017971 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.017947 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2778f628-cbd1-4262-859e-a61e83ebf594/init-config-reloader/0.log" Jul 03 14:54:28.429973 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.429946 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9grgn_f043d7b1-832c-4ba2-b339-81aca5d6e6af/node-exporter/0.log" Jul 03 14:54:28.468774 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.468748 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9grgn_f043d7b1-832c-4ba2-b339-81aca5d6e6af/kube-rbac-proxy/0.log" Jul 03 14:54:28.506357 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.506332 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9grgn_f043d7b1-832c-4ba2-b339-81aca5d6e6af/init-textfile/0.log" Jul 03 14:54:28.859361 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.859323 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9rxn6_2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c/prometheus-operator/0.log" Jul 03 14:54:28.879764 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.879739 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9rxn6_2a8d4401-f6bb-4c7b-bcda-db4ba0c6249c/kube-rbac-proxy/0.log" Jul 03 14:54:28.906905 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.906873 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-c5wsh_cc0f0228-48d4-491e-a3fe-1d841e4bd21c/prometheus-operator-admission-webhook/0.log" Jul 03 14:54:28.936949 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.936922 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d94454b75-fqp8f_bccf4a83-ea9c-430f-94ec-1f697ae99724/telemeter-client/0.log" Jul 03 14:54:28.974056 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.974019 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d94454b75-fqp8f_bccf4a83-ea9c-430f-94ec-1f697ae99724/reload/0.log" Jul 03 14:54:28.999657 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:28.999631 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d94454b75-fqp8f_bccf4a83-ea9c-430f-94ec-1f697ae99724/kube-rbac-proxy/0.log" Jul 03 14:54:30.119246 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.119206 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8"] Jul 03 14:54:30.119944 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.119919 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd4b33d-319a-4872-ad7c-d64b91c76d59" containerName="maas-api" Jul 03 14:54:30.119944 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.119945 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd4b33d-319a-4872-ad7c-d64b91c76d59" containerName="maas-api" Jul 03 14:54:30.120118 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.120045 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fd4b33d-319a-4872-ad7c-d64b91c76d59" containerName="maas-api" Jul 03 14:54:30.123333 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.123311 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.125780 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.125750 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-29ndn\"/\"default-dockercfg-cz7zd\"" Jul 03 14:54:30.125929 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.125761 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-29ndn\"/\"openshift-service-ca.crt\"" Jul 03 14:54:30.126634 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.126618 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-29ndn\"/\"kube-root-ca.crt\"" Jul 03 14:54:30.147407 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.147374 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8"] Jul 03 14:54:30.169249 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.169217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-podres\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.169444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.169264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rvd2\" (UniqueName: \"kubernetes.io/projected/3f742ec9-f094-47f1-8a7c-abe769710777-kube-api-access-7rvd2\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.169444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.169289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-sys\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.169444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.169362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-proc\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.169444 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.169425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-lib-modules\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-podres\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270116 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rvd2\" (UniqueName: \"kubernetes.io/projected/3f742ec9-f094-47f1-8a7c-abe769710777-kube-api-access-7rvd2\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270334 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-sys\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270334 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-proc\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270334 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-lib-modules\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270334 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-sys\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270334 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270257 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-podres\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270334 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270295 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-proc\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.270524 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.270351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f742ec9-f094-47f1-8a7c-abe769710777-lib-modules\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.280254 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.280230 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-29ndn\"/\"kube-root-ca.crt\"" Jul 03 14:54:30.290790 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.290770 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-29ndn\"/\"openshift-service-ca.crt\"" Jul 03 14:54:30.301259 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.301238 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rvd2\" (UniqueName: \"kubernetes.io/projected/3f742ec9-f094-47f1-8a7c-abe769710777-kube-api-access-7rvd2\") pod \"perf-node-gather-daemonset-xmgf8\" (UID: \"3f742ec9-f094-47f1-8a7c-abe769710777\") " pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.436036 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.435949 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-29ndn\"/\"default-dockercfg-cz7zd\"" Jul 03 14:54:30.444058 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.444032 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:30.586951 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:30.586923 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8"] Jul 03 14:54:30.589034 ip-10-0-137-36 kubenswrapper[2574]: W0703 14:54:30.589008 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f742ec9_f094_47f1_8a7c_abe769710777.slice/crio-30e41a83eaf6fac242a6634e2b9c3d571479e0183baced7ae3103ee706a6de4a WatchSource:0}: Error finding container 30e41a83eaf6fac242a6634e2b9c3d571479e0183baced7ae3103ee706a6de4a: Status 404 returned error can't find the container with id 30e41a83eaf6fac242a6634e2b9c3d571479e0183baced7ae3103ee706a6de4a Jul 03 14:54:31.214216 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:31.214151 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" event={"ID":"3f742ec9-f094-47f1-8a7c-abe769710777","Type":"ContainerStarted","Data":"a2b091ff33d6d44ab75a28b6652c3c074ad6a7f4dfe5576f77579d44c0b35f2f"} Jul 03 14:54:31.214612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:31.214254 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" event={"ID":"3f742ec9-f094-47f1-8a7c-abe769710777","Type":"ContainerStarted","Data":"30e41a83eaf6fac242a6634e2b9c3d571479e0183baced7ae3103ee706a6de4a"} Jul 03 14:54:31.214612 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:31.214274 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:31.235350 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:31.235300 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" podStartSLOduration=1.235284867 podStartE2EDuration="1.235284867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 14:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 14:54:31.232933698 +0000 UTC m=+2581.346755262" watchObservedRunningTime="2026-07-03 14:54:31.235284867 +0000 UTC m=+2581.349106439" Jul 03 14:54:31.641971 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:31.641940 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-867884bcc7-pzwln_4d313fd3-8e2d-4830-a9e5-aca0da100246/console/0.log" Jul 03 14:54:31.691972 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:31.691935 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-tb846_8bd73305-36c7-4dbe-97a8-e202d09f3936/download-server/0.log" Jul 03 14:54:33.564255 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:33.564214 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pvzjl_dc353f9d-855e-4828-b3e9-8dc09ae85739/dns/0.log" Jul 03 14:54:33.595921 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:33.595894 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pvzjl_dc353f9d-855e-4828-b3e9-8dc09ae85739/kube-rbac-proxy/0.log" Jul 03 14:54:33.625228 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:33.625200 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4xx8z_2c2d956b-66dc-4751-8a97-69fedf0f5c14/dns-node-resolver/0.log" Jul 03 14:54:34.323604 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:34.323573 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2hwlt_b9645511-9ec8-42ad-85fb-d42ec2ba9df1/node-ca/0.log" Jul 03 14:54:35.885562 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:35.885528 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b86bc795-nghdw_adcf49e0-31e4-481b-89be-2732174ebbdf/kube-auth-proxy/0.log" Jul 03 14:54:35.950699 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:35.950664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dld5d_72646bbd-5107-4bb4-ba89-fe17c7b9e150/istio-proxy/0.log" Jul 03 14:54:36.001977 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:36.001941 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dld5d_72646bbd-5107-4bb4-ba89-fe17c7b9e150/istio-proxy/1.log" Jul 03 14:54:36.090208 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:36.090171 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nknwf_a8058947-1ba4-43df-95fc-6e8005039b3b/payload-pre-processing/0.log" Jul 03 14:54:36.205494 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:36.205410 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6kzfl_2f955d87-43d3-4e0c-85ca-a2130ade2986/payload-processing/0.log" Jul 03 14:54:37.064539 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:37.064510 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5jlw_59e6d9dd-8374-4a65-bec0-20ffd23d6492/serve-healthcheck-canary/0.log" Jul 03 14:54:37.229978 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:37.229946 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-29ndn/perf-node-gather-daemonset-xmgf8" Jul 03 14:54:37.933883 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:37.933848 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swrwp_6b314532-4b37-4f71-b32f-508436a20846/kube-rbac-proxy/0.log" Jul 03 14:54:37.965258 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:37.965228 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swrwp_6b314532-4b37-4f71-b32f-508436a20846/exporter/0.log" Jul 03 14:54:37.995876 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:37.995842 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swrwp_6b314532-4b37-4f71-b32f-508436a20846/extractor/0.log" Jul 03 14:54:40.682034 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:40.681997 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:40.819605 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:40.819568 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wj9sb_c31c7962-fad8-45bb-80a8-bec7420d0fea/manager/0.log" Jul 03 14:54:40.876937 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:40.876901 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-747f7bcddc-6nk72_1cff1e0b-cd60-4f13-bd77-efa8155dd9fc/maas-api/0.log" Jul 03 14:54:40.921744 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:40.921713 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b86bc795-nghdw_adcf49e0-31e4-481b-89be-2732174ebbdf/kube-auth-proxy/0.log" Jul 03 14:54:40.943603 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:40.943514 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dld5d_72646bbd-5107-4bb4-ba89-fe17c7b9e150/istio-proxy/0.log" Jul 03 14:54:40.946716 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:40.946691 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718165-lmc8h_2d143d4e-f5ad-4f75-82a9-fabe0fecf7c5/cleanup/0.log" Jul 03 14:54:41.002344 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.002305 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dld5d_72646bbd-5107-4bb4-ba89-fe17c7b9e150/istio-proxy/1.log" Jul 03 14:54:41.039608 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.039578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nknwf_a8058947-1ba4-43df-95fc-6e8005039b3b/payload-pre-processing/0.log" Jul 03 14:54:41.137045 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.137012 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6kzfl_2f955d87-43d3-4e0c-85ca-a2130ade2986/payload-processing/0.log" Jul 03 14:54:41.142772 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.142734 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-755bf6967f-qjh2l_02a440c4-f811-4b47-93a7-707bc1db9539/manager/0.log" Jul 03 14:54:41.296471 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.296439 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5mlqh_c5c89fc2-cc4e-4101-997d-f427d187d4de/manager/0.log" Jul 03 14:54:41.507993 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.507910 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6554f4cb-ktn5l_86951c11-f206-484d-b67d-f76fd7482834/manager/0.log" Jul 03 14:54:41.535604 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.535575 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6554f4cb-ktn5l_86951c11-f206-484d-b67d-f76fd7482834/copy-manifests/0.log" Jul 03 14:54:41.569439 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.569393 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-44zct_579db2ae-349f-463c-9b0f-1db3c842451b/postgres/0.log" Jul 03 14:54:41.981063 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:41.981023 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbgc_7b7bb7a5-3be2-4080-a698-eae0a9729fb4/konnectivity-agent/0.log" limit=1024 Jul 03 14:54:42.471751 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:42.471723 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b86bc795-nghdw_adcf49e0-31e4-481b-89be-2732174ebbdf/kube-auth-proxy/0.log" Jul 03 14:54:42.499364 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:42.499333 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dld5d_72646bbd-5107-4bb4-ba89-fe17c7b9e150/istio-proxy/0.log" Jul 03 14:54:42.554634 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:42.554600 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dld5d_72646bbd-5107-4bb4-ba89-fe17c7b9e150/istio-proxy/1.log" Jul 03 14:54:42.589579 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:42.589544 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nknwf_a8058947-1ba4-43df-95fc-6e8005039b3b/payload-pre-processing/0.log" Jul 03 14:54:42.657876 ip-10-0-137-36 kubenswrapper[2574]: I0703 14:54:42.657843 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6kzfl_2f955d87-43d3-4e0c-85ca-a2130ade2986/payload-processing/0.log"